-- Logs begin at Mon 2022-08-29 09:52:56 UTC, end at Mon 2022-08-29 12:25:58 UTC. -- Aug 29 10:23:53.592028 n-d-854121-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 10:23:53.600928 n-d-854121-10 devstack@n-api.service[106202]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 10:23:53 2022] *** Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: nodename: n-d-854121-10 Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: machine: x86_64 Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: clock source: unix Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: pcre jit disabled Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: detected number of CPU cores: 4 Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: current working directory: / Aug 29 10:23:53.602974 n-d-854121-10 devstack@n-api.service[106202]: detected binary path: /usr/bin/uwsgi-core Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: your processes number limit is 47680 Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: your memory page size is 4096 bytes Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: detected max file descriptor number: 2048 Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: lock engine: pthread robust mutexes Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: thunder lock: enabled Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 10:23:53.603672 n-d-854121-10 devstack@n-api.service[106202]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 10:23:53.642478 n-d-854121-10 devstack@n-api.service[106202]: Python main interpreter initialized at 0x5576f51a19c0 Aug 29 10:23:53.642478 n-d-854121-10 devstack@n-api.service[106202]: python threads support enabled Aug 29 10:23:53.642478 n-d-854121-10 devstack@n-api.service[106202]: your server socket listen backlog is limited to 100 connections Aug 29 10:23:53.642478 n-d-854121-10 devstack@n-api.service[106202]: your mercy for graceful operations on workers is 90 seconds Aug 29 10:23:53.642839 n-d-854121-10 devstack@n-api.service[106202]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 10:23:53.642916 n-d-854121-10 devstack@n-api.service[106202]: *** Operational MODE: preforking *** Aug 29 10:23:53.643139 n-d-854121-10 devstack@n-api.service[106202]: *** uWSGI is running in multiple interpreter mode *** Aug 29 10:23:53.643139 n-d-854121-10 devstack@n-api.service[106202]: spawned uWSGI master process (pid: 106202) Aug 29 10:23:53.643321 n-d-854121-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 10:23:53.645898 n-d-854121-10 devstack@n-api.service[106202]: spawned uWSGI worker 1 (pid: 106203, cores: 1) Aug 29 10:23:53.645898 n-d-854121-10 devstack@n-api.service[106202]: spawned uWSGI worker 2 (pid: 106204, cores: 1) Aug 29 10:23:53.645898 n-d-854121-10 devstack@n-api.service[106202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 10:23:54.297997 n-d-854121-10 devstack@n-api.service[106204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 10:23:54.306893 n-d-854121-10 devstack@n-api.service[106203]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 10:23:55.380053 n-d-854121-10 devstack@n-api.service[106204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:23:55.380053 n-d-854121-10 devstack@n-api.service[106204]: from cryptography.utils import int_from_bytes Aug 29 10:23:55.380643 n-d-854121-10 devstack@n-api.service[106204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:23:55.380643 n-d-854121-10 devstack@n-api.service[106204]: from cryptography.utils import int_from_bytes Aug 29 10:23:55.381719 n-d-854121-10 devstack@n-api.service[106203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:23:55.381719 n-d-854121-10 devstack@n-api.service[106203]: from cryptography.utils import int_from_bytes Aug 29 10:23:55.382159 n-d-854121-10 devstack@n-api.service[106203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:23:55.382159 n-d-854121-10 devstack@n-api.service[106203]: from cryptography.utils import int_from_bytes Aug 29 10:23:57.869515 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 10:23:57.870137 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 10:23:57.870296 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 10:23:57.870657 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 10:23:57.870913 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 10:23:57.871300 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.871624 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.871721 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 10:23:57.872082 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.872167 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 10:23:57.872248 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.872454 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 10:23:57.872562 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.872822 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 10:23:57.872919 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.873082 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 10:23:57.873181 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.873458 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.873562 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.873817 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.873922 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874074 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874175 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874392 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874494 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874711 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.874798 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875030 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875119 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875333 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875423 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875639 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875733 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.875959 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876057 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876259 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876354 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876577 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876665 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876878 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.876973 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.877222 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.877374 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.877535 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.877874 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878017 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878173 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878279 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878483 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878590 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878813 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.878920 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879121 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879212 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879426 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879634 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879746 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.879951 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880042 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880259 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880352 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880576 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880681 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.880919 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.881030 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.881816 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.881926 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882132 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882292 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882460 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882613 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.882996 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883095 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883305 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883404 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883611 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883779 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.883928 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884099 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884283 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884448 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884537 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884731 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.884888 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885147 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885251 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885463 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885556 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885802 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.885907 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886100 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886192 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886404 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886500 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886710 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.886801 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887026 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887129 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887326 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887418 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887627 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887726 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.887874 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888028 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888167 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888306 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888483 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888644 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888802 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.888964 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889110 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889271 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889410 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889558 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889718 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.889866 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890002 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890140 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890292 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890432 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890575 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890712 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.890848 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891069 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891306 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891453 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891601 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891737 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.891874 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892024 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892172 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892315 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892459 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892602 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892760 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.892906 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893049 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893203 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893343 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893478 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893624 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893807 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.893949 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894085 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894227 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894364 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894500 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894654 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894798 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.894935 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895070 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895294 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895446 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895585 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895720 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.895863 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896000 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896141 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896287 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896449 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896610 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896827 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.896970 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.897250 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.897416 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.897556 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.897691 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.897884 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898022 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898198 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898351 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898490 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898637 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898773 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.898908 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899052 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899189 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899331 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899475 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899612 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899757 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.899903 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900040 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900176 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900358 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900519 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900700 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900853 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.900992 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901146 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901353 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901522 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901668 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901854 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.901994 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902130 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902273 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902410 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902567 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902714 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.902858 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903002 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903150 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903294 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903439 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903576 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903720 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903857 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.903992 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904134 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904280 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904438 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904574 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904708 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904844 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.904989 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905133 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905290 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905503 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905645 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905807 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.905945 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906100 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906246 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906400 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906536 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906672 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906807 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.906966 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907104 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907247 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907389 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907532 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907668 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907813 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.907959 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908106 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908242 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908377 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908512 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908656 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908792 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.908927 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909077 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909213 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909349 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909497 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909633 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909838 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.909997 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910136 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910281 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910419 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910560 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910697 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910832 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.910977 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911124 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911261 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911488 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911633 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911769 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.911915 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912061 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912199 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912385 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912692 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912831 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912975 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.912975 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.913257 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.913414 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.913552 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.913694 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.913884 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.914033 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.914177 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.914314 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.914449 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.914592 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.914740 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.914878 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.915028 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.915165 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.915301 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.915436 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.915668 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.915831 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.915969 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.916111 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.916248 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.916397 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.916535 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:23:57.916670 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.916812 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.916965 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917113 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917330 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917483 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917621 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917816 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.917958 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918102 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918250 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918389 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918524 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918694 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.918838 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919010 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919168 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919306 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919454 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919622 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919769 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.919907 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920051 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920225 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920369 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920534 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920677 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.920863 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921020 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921188 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921332 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921487 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921735 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.921896 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922035 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922172 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922315 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922459 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922598 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922749 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.922886 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923022 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923158 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923316 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923461 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923643 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923790 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.923954 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924098 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924266 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924417 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924568 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924707 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.924878 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925023 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925185 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925337 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925485 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925645 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.925915 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926054 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926201 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926352 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926489 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926625 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926761 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.926898 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.927033 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.927193 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.927332 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.927484 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.927639 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.928371 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.928639 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.928797 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.928943 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929082 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929244 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929390 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929568 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929746 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.929893 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930031 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930218 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930365 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930511 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930655 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930814 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.930959 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931117 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931262 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931432 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931577 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931801 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.931953 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932092 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932238 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932383 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932522 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932664 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932800 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.932936 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933073 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933243 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933396 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933540 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933683 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.933900 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934047 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934196 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934341 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934480 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934615 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934759 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.934905 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935050 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935188 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935332 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935469 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935613 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935759 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.935924 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936150 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936294 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936431 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936568 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936714 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936858 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.936995 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937141 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937281 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937426 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937564 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937720 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.937875 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938012 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938184 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938350 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938490 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938626 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938801 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.938945 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939132 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939285 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939431 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939568 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939744 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.939906 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940069 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940298 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940440 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940576 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940711 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.940860 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941010 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941154 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941290 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941426 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941573 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.941754 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942011 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942157 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942301 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942438 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942575 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942711 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.942865 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.943002 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.943138 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.943281 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.943424 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.944193 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.944443 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.944608 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.944747 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.944883 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945019 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945167 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945305 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945442 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945584 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945750 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.945911 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946059 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946283 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946439 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946577 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946714 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946851 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.946997 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947135 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947278 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947425 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947647 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947793 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.947944 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948094 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948232 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948379 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948516 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948660 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948799 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.948943 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949080 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949217 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949354 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949503 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949642 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949841 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.949988 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950126 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950272 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950417 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950555 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950701 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950838 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.950982 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951124 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951275 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951418 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951559 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951701 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.951843 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952014 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952242 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952395 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952545 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952694 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952838 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.952996 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953141 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953283 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953425 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953567 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953728 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.953891 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954049 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954193 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954334 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954475 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954617 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954768 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.954911 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955054 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955197 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955365 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955516 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955694 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.955847 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956000 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956145 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956305 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956528 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956686 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956829 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.956971 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957114 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957269 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957421 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957565 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.957934 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958090 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958234 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958388 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958541 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958684 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958832 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.958975 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959124 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959284 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959480 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959629 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959824 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.959973 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960135 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960280 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960423 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960565 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960714 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.960856 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961007 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961179 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961329 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961495 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961653 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961830 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.961992 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962154 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962390 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962544 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962687 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962828 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.962980 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963124 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963303 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963446 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963589 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963730 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.963880 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964041 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964186 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964336 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964479 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964630 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.964923 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965066 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965274 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965424 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965577 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965781 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.965934 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966088 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966238 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966381 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966553 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966769 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.966919 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967062 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967204 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967358 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967517 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967662 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967804 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.967946 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968099 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968251 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968395 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968537 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968679 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968822 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.968963 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.969187 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.969332 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.969475 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.969617 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.969795 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970008 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970177 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970387 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970549 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970694 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970837 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.970979 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971130 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971275 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971417 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971558 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971701 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971852 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.971998 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.972150 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.972293 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.972521 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.972672 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.972830 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.973228 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.973373 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.973523 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.973667 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.973853 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974012 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974157 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974311 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974455 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974598 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974739 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.974987 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975143 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975287 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975437 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975589 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975744 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.975889 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976031 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976212 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976373 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976517 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976669 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.976900 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977061 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977213 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977371 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977524 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977668 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.977853 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978000 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978143 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978286 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978440 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978583 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978734 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.978878 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979022 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979164 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979308 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979451 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979607 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979751 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.979912 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.980494 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.980660 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.980804 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.980958 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.980958 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.981232 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.981375 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.981518 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.981668 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.981882 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982029 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982171 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982315 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982458 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982716 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.982869 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983023 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983023 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983312 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983455 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983598 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983754 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.983898 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.984040 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.984182 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.984323 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.984475 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985195 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985344 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985489 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985632 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985801 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.985961 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986107 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986250 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986393 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986537 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986689 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986833 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.986833 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987223 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987368 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987519 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987674 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987820 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.987969 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988113 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988255 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988397 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988553 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988699 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.988848 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989004 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989148 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989290 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989441 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989585 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989585 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.989916 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.990066 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.990225 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.990856 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991006 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991156 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991311 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991615 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991787 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.991934 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992078 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992228 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992372 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992514 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992666 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.992914 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993065 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993216 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993216 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993500 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993653 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993825 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.993945 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994044 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994131 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994299 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994394 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994481 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994572 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994661 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994743 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994833 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994916 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.994995 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995082 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995163 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995250 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995341 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995435 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995523 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995616 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995706 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995787 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995875 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.995964 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996045 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996125 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996212 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996301 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996390 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996471 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996550 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996703 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.996840 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997014 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997153 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997315 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997459 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997614 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997789 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.997944 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998104 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998267 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998418 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998581 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998726 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.998883 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999053 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999194 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999357 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999516 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999670 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999815 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:57.999957 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000113 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000259 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000402 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000553 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000698 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000841 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.000992 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001135 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001287 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001450 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001595 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001789 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.001948 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002092 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002235 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002388 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002534 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002677 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.002820 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003046 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003208 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003354 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003508 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003652 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003796 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.003939 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004090 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004242 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004394 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004539 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004681 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004830 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.004982 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005132 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005293 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005438 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005581 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005781 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.005944 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.006626 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.006936 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007081 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007309 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007474 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007622 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007764 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.007912 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008067 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008211 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008366 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008511 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008662 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008806 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.008949 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009090 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009278 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009427 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009570 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009733 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.009883 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010038 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010202 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010351 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010493 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010637 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010637 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.010963 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011120 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011271 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011414 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011557 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011714 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.011869 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012064 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012220 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012365 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012507 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012649 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012802 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.012946 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.013197 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.013348 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.013491 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.013633 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.013868 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014015 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014209 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014361 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014505 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014647 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014800 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.014953 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015098 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015240 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015383 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015535 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015680 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015831 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.015987 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016131 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016273 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016424 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016568 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016710 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.016860 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017005 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017005 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017312 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017312 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017662 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017832 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.017987 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018131 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018286 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018432 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018583 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018727 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.018869 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019026 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019173 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019324 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019476 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019627 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019778 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.019942 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020094 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020242 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020386 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020529 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020679 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020840 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.020992 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.021144 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.021289 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.021433 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.021575 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.021869 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022041 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022186 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022329 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022472 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022624 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022624 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.022915 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023113 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023359 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023511 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023664 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023809 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.023962 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024106 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024248 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024393 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024550 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024695 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024844 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.024987 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025130 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025272 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025425 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025570 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025753 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.025915 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026069 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026222 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026422 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026578 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026729 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.026872 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027015 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027174 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027319 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027462 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027698 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.027873 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028042 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028197 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028349 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028494 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028637 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028779 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.028921 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029077 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029222 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029372 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029523 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029667 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.029850 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030037 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030198 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030352 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030498 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030652 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030798 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.030948 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031101 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031257 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031402 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031546 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031690 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.031844 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032071 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032217 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032217 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032496 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032640 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032784 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.032935 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033081 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033224 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033384 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033598 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.033948 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034101 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034246 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034389 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034532 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034684 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034830 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.034973 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035117 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035259 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035401 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035554 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035699 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035854 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.035998 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036141 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036290 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036444 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036588 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036732 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.036877 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037019 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037161 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037347 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037495 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037649 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037879 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.037879 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038228 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038228 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038502 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038502 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.038917 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039069 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039213 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039356 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039498 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039652 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039802 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.039960 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040113 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040257 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040400 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040549 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040693 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040845 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.040990 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041134 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041283 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041434 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041604 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.041927 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042070 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042214 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042357 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042357 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042650 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042795 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.042937 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043080 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043223 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043382 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043539 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043539 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.043916 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044064 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044216 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044373 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044519 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044663 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044812 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.044957 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045110 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045265 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045422 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045565 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045770 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.045923 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046084 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046231 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046375 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046518 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046668 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046812 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.046964 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047123 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047268 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047434 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047579 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047723 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.047874 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048019 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048170 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048313 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048457 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048683 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048833 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.048979 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049122 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049272 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049272 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049566 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049729 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.049880 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050035 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050188 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050333 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050485 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050631 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050774 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.050923 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051066 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051219 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051376 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051521 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051664 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051807 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.051949 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.052108 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.052271 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.052416 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.052567 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.052711 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.053370 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.053543 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.053807 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.053807 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054089 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054234 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054388 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054542 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054688 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054840 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.054991 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055136 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055285 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055438 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055584 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055747 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.055894 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056037 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056189 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056335 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056478 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056622 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056765 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.056910 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057061 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057207 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057351 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057511 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057656 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.057840 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058002 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058149 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058292 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058435 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058577 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058577 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.058869 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059014 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059164 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059309 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059472 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059472 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059762 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.059923 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060068 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060068 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060426 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060573 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060716 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.060859 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061013 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061158 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061321 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061473 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061618 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061812 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.061971 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062118 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062271 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062422 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062567 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062710 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062710 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.062981 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063145 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063297 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063442 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063585 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063728 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063883 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.063883 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064167 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064311 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064461 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064461 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064749 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.064906 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065061 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065272 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065420 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065420 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065718 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.065871 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066026 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066170 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066322 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066477 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066624 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066792 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.066976 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067126 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067273 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067426 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067572 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067716 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.067867 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.068011 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.068200 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.068352 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.068517 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069209 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069365 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069521 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069675 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069675 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069986 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.069986 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070142 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070247 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070341 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070551 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070653 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070867 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.070957 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.071185 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.071288 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.071502 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.071718 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.071832 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072063 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072160 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072377 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072465 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072702 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.072790 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073027 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073124 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073343 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073437 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073648 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.073930 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074032 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074250 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074351 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074571 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074658 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074886 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.074982 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075196 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075293 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075497 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075593 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075796 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.075892 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076102 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076189 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076406 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076502 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076709 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.076806 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077014 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077103 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077329 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077421 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077639 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077761 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.077982 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078069 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078287 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078387 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078586 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078675 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078892 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.078979 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.079195 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.079281 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.079496 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.079735 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.079823 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080081 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080167 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080391 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080486 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080693 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080792 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.080997 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081084 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081297 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081393 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081606 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081728 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.081932 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082020 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082255 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082342 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082564 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082658 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082882 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.082969 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083179 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083266 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083479 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083565 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083782 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.083868 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084087 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084241 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084422 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084567 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084816 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.084902 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085025 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085175 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085330 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085519 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085661 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085866 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.085994 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.086304 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.086390 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.086613 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.086722 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.086929 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087040 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087238 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087367 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087545 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087692 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087853 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.087995 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088160 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088301 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088478 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088601 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088783 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.088922 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089100 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089276 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089408 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089578 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089740 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.089911 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090053 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090222 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090415 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090519 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090729 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.090834 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091058 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091152 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091366 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091471 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091675 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091767 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.091991 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092092 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092294 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092395 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092600 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092693 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.092902 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093000 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093209 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093309 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093520 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093613 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093877 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.093982 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.094188 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.094417 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.094518 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.094761 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.094916 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095087 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095249 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095395 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095548 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095694 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095837 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.095996 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096142 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096286 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096429 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096572 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096716 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.096868 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097016 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097159 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097321 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097467 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097609 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.097877 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.098285 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.098430 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.098572 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.098738 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.098891 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099046 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099189 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099343 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099505 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099651 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099836 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.099984 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100128 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100301 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100448 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100592 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100750 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.100897 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101042 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101185 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101371 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101538 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101691 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.101876 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102033 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102186 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102331 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102484 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102628 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102773 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.102922 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103068 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103211 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103385 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103531 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103674 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103818 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.103976 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104130 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104285 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104430 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104574 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104717 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.104859 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105011 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105157 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105313 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105464 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105609 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105769 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.105932 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106088 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106231 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106377 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106520 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106663 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106816 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.106961 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107115 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107267 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107412 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107565 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107710 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.107853 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108026 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108179 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108330 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108488 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108634 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108778 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.108943 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109103 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109249 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109402 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109548 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109691 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.109884 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110029 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110173 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110332 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110478 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110622 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110773 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.110928 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111087 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111233 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111377 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111520 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111663 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111806 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.111962 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112120 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112264 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112418 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112562 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112705 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.112867 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113013 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113156 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113309 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113455 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113599 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113773 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.113933 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114085 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114229 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114373 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114527 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114678 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114841 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.114986 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.115130 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.115272 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.115947 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116095 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116239 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116388 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116532 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116676 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116829 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.116981 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117126 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117280 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117424 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117576 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117747 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.117899 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118054 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118199 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118343 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118561 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118709 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118853 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.118997 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119154 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119298 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119451 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119637 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119791 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.119936 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120080 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120224 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120376 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120520 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120671 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120823 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.120978 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121131 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121276 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121420 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121570 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121747 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.121901 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122058 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122203 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122354 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122498 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122643 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122786 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.122952 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123097 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123241 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123384 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123527 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123685 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123842 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.123988 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124130 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124314 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124467 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124620 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124764 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.124919 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.125065 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.125216 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.125360 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.125513 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 10:23:58.125659 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.125895 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.126214 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.126530 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.126861 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.127175 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.127489 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.127800 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.128112 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.128425 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.128742 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.129059 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.129373 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.129693 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.130035 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.130366 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.130697 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.131089 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.131503 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.131838 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.132191 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.132510 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.132861 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.133195 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.133514 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.133860 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.134170 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:23:58.134417 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 10:23:58.278703 n-d-854121-10 devstack@n-api.service[106204]: INFO dbcounter [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Registered counter for database nova_api Aug 29 10:23:58.288294 n-d-854121-10 devstack@n-api.service[106203]: INFO dbcounter [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Registered counter for database nova_api Aug 29 10:23:58.300320 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_db.sqlalchemy.engines [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.307578 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writer thread running {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.308573 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_db.sqlalchemy.engines [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.315049 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writer thread running {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.364144 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.context [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=106204) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 10:23:58.368626 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:23:58.369078 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:23:58.370857 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:23:58.371528 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:23:58.371966 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:23:58.372965 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.context [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=106203) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 10:23:58.373955 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_concurrency.lockutils [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:23:58.375909 n-d-854121-10 devstack@n-api.service[106204]: INFO dbcounter [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Registered counter for database nova_cell0 Aug 29 10:23:58.376806 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:23:58.377281 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:23:58.378917 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:23:58.379642 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:23:58.379864 n-d-854121-10 devstack@n-api.service[106204]: INFO dbcounter [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Registered counter for database nova_cell1 Aug 29 10:23:58.380088 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:23:58.382328 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:23:58.384376 n-d-854121-10 devstack@n-api.service[106203]: INFO dbcounter [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Registered counter for database nova_cell0 Aug 29 10:23:58.387582 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_db.sqlalchemy.engines [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.388618 n-d-854121-10 devstack@n-api.service[106203]: INFO dbcounter [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Registered counter for database nova_cell1 Aug 29 10:23:58.389207 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_db.sqlalchemy.engines [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.395243 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writer thread running {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.395757 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_db.sqlalchemy.engines [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.400345 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writer thread running {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.400473 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_db.sqlalchemy.engines [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.401080 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writer thread running {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.542541 n-d-854121-10 devstack@n-api.service[106204]: INFO dbcounter [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Registered counter for database nova_cell0 Aug 29 10:23:58.545571 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writer thread running {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.551266 n-d-854121-10 devstack@n-api.service[106204]: DEBUG oslo_db.sqlalchemy.engines [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.554600 n-d-854121-10 devstack@n-api.service[106203]: INFO dbcounter [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Registered counter for database nova_cell0 Aug 29 10:23:58.555927 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writer thread running {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.563012 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_db.sqlalchemy.engines [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:23:58.567836 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writer thread running {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:23:58.894589 n-d-854121-10 devstack@n-api.service[106204]: WARNING keystonemiddleware.auth_token [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:23:58.899081 n-d-854121-10 devstack@n-api.service[106203]: WARNING keystonemiddleware.auth_token [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:23:58.902539 n-d-854121-10 devstack@n-api.service[106204]: WARNING keystonemiddleware.auth_token [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:23:58.906433 n-d-854121-10 devstack@n-api.service[106203]: WARNING keystonemiddleware.auth_token [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:23:59.249581 n-d-854121-10 devstack@n-api.service[106203]: WARNING keystonemiddleware.auth_token [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:23:59.255600 n-d-854121-10 devstack@n-api.service[106203]: WARNING keystonemiddleware.auth_token [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:23:59.258481 n-d-854121-10 devstack@n-api.service[106204]: WARNING keystonemiddleware.auth_token [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:23:59.260953 n-d-854121-10 devstack@n-api.service[106203]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576f51a19c0 pid: 106203 (default app) Aug 29 10:23:59.263068 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:23:59.264271 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Aug 29 10:23:59.264397 n-d-854121-10 devstack@n-api.service[106204]: WARNING keystonemiddleware.auth_token [None req-bd66d2d0-5e9e-4f58-9bdc-b153de7fb523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:23:59.264665 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Mon Aug 29 10:23:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:23:59.269638 n-d-854121-10 devstack@n-api.service[106204]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576f51a19c0 pid: 106204 (default app) Aug 29 10:25:17.960456 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:17.962131 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 29 10:25:17.962667 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:17.981753 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_api:SELECT=3 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:17.981753 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_cell1:SELECT=3 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:17.984600 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_cell0:SELECT=3 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:17.984600 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:18.862538 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-7c0b1169-4ba5-422c-89e7-623ae07a3538 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:18.899157 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-7c0b1169-4ba5-422c-89e7-623ae07a3538 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929577 Aug 29 10:25:18.899898 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:25:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:21.324614 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:21.325625 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-7e024aa4-d26d-473a-a4bc-aba789a1413d None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 10:25:21.326270 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:21.774425 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-3f026995-4605-4b67-98a6-f9c6e2a45e8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:21.822985 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-3f026995-4605-4b67-98a6-f9c6e2a45e8d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490103 Aug 29 10:25:21.824072 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:22.048981 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-63633684-e709-4c3a-84e1-e73dcc6f99e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:22.055436 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_api:SELECT=3 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:22.056249 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_cell0:SELECT=3 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:22.057155 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_cell1:SELECT=3 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:22.057887 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:22.117674 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-63633684-e709-4c3a-84e1-e73dcc6f99e6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284979 Aug 29 10:25:22.118290 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1336 bytes} [Mon Aug 29 10:25:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:24.520310 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-3f026995-4605-4b67-98a6-f9c6e2a45e8d admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:24.521431 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-3f026995-4605-4b67-98a6-f9c6e2a45e8d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Aug 29 10:25:24.522161 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:25.261625 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-01aee300-7f5d-4d1a-a721-009ba401d37f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:25.334411 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-01aee300-7f5d-4d1a-a721-009ba401d37f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.806087 Aug 29 10:25:25.335093 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 10:25:25.351429 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-57673257-71bd-4eb4-8f88-f29ddaecb82b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:25.402440 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-57673257-71bd-4eb4-8f88-f29ddaecb82b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058694 Aug 29 10:25:25.405340 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1336 bytes} [Mon Aug 29 10:25:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:28.027956 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-01aee300-7f5d-4d1a-a721-009ba401d37f admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:28.028980 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-01aee300-7f5d-4d1a-a721-009ba401d37f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 29 10:25:28.029572 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:28.487762 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-144c9788-dc22-430c-8307-e653cd2a49e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "vcpus": 1}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:28.511218 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-144c9788-dc22-430c-8307-e653cd2a49e5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474247 Aug 29 10:25:28.520259 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:28.525875 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-d4b7681c-62f8-45ce-9025-ddce26e2b56a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:28.556387 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-d4b7681c-62f8-45ce-9025-ddce26e2b56a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034290 Aug 29 10:25:28.565253 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1336 bytes} [Mon Aug 29 10:25:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:25:31.191140 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-144c9788-dc22-430c-8307-e653cd2a49e5 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:31.192172 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-144c9788-dc22-430c-8307-e653cd2a49e5 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 29 10:25:31.192574 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:31.733195 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-e91f591a-e929-4dce-9386-afdda5a16c95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:31.754568 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-e91f591a-e929-4dce-9386-afdda5a16c95 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.555243 Aug 29 10:25:31.757746 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:31.767899 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-96d2236c-7a48-4d0a-be37-53643af72d0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:31.794131 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-96d2236c-7a48-4d0a-be37-53643af72d0f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030289 Aug 29 10:25:31.795256 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1336 bytes} [Mon Aug 29 10:25:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:25:34.176709 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-e91f591a-e929-4dce-9386-afdda5a16c95 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:34.177744 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-e91f591a-e929-4dce-9386-afdda5a16c95 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 29 10:25:34.189302 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:34.703559 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:34.736949 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552133 Aug 29 10:25:34.737909 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:34.750492 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-6996164f-6f9f-4314-8dd4-631281612040 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:34.792306 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-6996164f-6f9f-4314-8dd4-631281612040 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045632 Aug 29 10:25:34.792891 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1336 bytes} [Mon Aug 29 10:25:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:37.247656 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:37.248569 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 29 10:25:37.249126 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:37.729499 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-71d2642b-4114-44b8-b1e6-8aa8384bcef3 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:37.756128 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-71d2642b-4114-44b8-b1e6-8aa8384bcef3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.499501 Aug 29 10:25:37.756677 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:25:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:25:40.184607 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:40.185745 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-f6f78c10-5776-49e9-8340-24c912a9ce18 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 29 10:25:40.186149 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:40.617732 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-9bd8b014-dcbc-40a4-b09b-b6f98ca0f729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "vcpus": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:40.637420 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-9bd8b014-dcbc-40a4-b09b-b6f98ca0f729 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443891 Aug 29 10:25:40.638001 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:40.651286 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-a3a914bf-92bc-48be-b307-008aaee46446 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:40.676728 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-a3a914bf-92bc-48be-b307-008aaee46446 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029064 Aug 29 10:25:40.677288 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1333 bytes} [Mon Aug 29 10:25:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:43.381914 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-9bd8b014-dcbc-40a4-b09b-b6f98ca0f729 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:43.382871 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-9bd8b014-dcbc-40a4-b09b-b6f98ca0f729 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 29 10:25:43.383279 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:43.816014 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-34899283-09b4-443c-8a34-34ea3913f0d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:43.836224 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-34899283-09b4-443c-8a34-34ea3913f0d9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446741 Aug 29 10:25:43.836812 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:43.851448 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-680144c0-315c-48cb-99ef-5c98daaac96a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:43.884850 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-680144c0-315c-48cb-99ef-5c98daaac96a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038300 Aug 29 10:25:43.885618 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1333 bytes} [Mon Aug 29 10:25:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:46.303361 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-34899283-09b4-443c-8a34-34ea3913f0d9 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:46.304432 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-34899283-09b4-443c-8a34-34ea3913f0d9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 10:25:46.304818 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:46.765973 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-532eecb3-d7aa-41c1-8fbf-82987c2a7c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:46.785248 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-532eecb3-d7aa-41c1-8fbf-82987c2a7c2b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474102 Aug 29 10:25:46.785987 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:46.800371 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-0b697b4c-b986-47b6-8ca3-b5e6fd54f0ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:46.825341 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-0b697b4c-b986-47b6-8ca3-b5e6fd54f0ce admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028603 Aug 29 10:25:46.825932 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1333 bytes} [Mon Aug 29 10:25:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:49.209665 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-532eecb3-d7aa-41c1-8fbf-82987c2a7c2b admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:49.210774 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-532eecb3-d7aa-41c1-8fbf-82987c2a7c2b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Aug 29 10:25:49.211174 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:49.644819 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-aa1e1828-966d-4902-acc9-1107503f0a2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "name": "m1.large"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:49.656254 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:49.719040 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-aa1e1828-966d-4902-acc9-1107503f0a2b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501453 Aug 29 10:25:49.725983 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:49.734810 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-43bc3ae4-3176-4dce-81d5-dd7297a1a235 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:49.767032 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-43bc3ae4-3176-4dce-81d5-dd7297a1a235 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034908 Aug 29 10:25:49.767955 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1333 bytes} [Mon Aug 29 10:25:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:25:52.156695 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-aa1e1828-966d-4902-acc9-1107503f0a2b admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:25:52.157724 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-aa1e1828-966d-4902-acc9-1107503f0a2b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 29 10:25:52.158137 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:25:52.611703 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:52.617800 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:25:52.634245 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469760 Aug 29 10:25:52.634808 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1283 bytes} [Mon Aug 29 10:25:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:25:52.649085 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-1553f86d-3abe-4f30-aaaa-a0fae28d86e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:25:52.675564 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-1553f86d-3abe-4f30-aaaa-a0fae28d86e8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031549 Aug 29 10:25:52.676249 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1333 bytes} [Mon Aug 29 10:25:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:26:15.391949 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:15.393272 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001850 Aug 29 10:26:15.393817 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:15.404320 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:26:15.781850 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-49c8cf2a-bcc4-4b82-b40b-1dbe8cbd1648 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:15.802238 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-49c8cf2a-bcc4-4b82-b40b-1dbe8cbd1648 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402449 Aug 29 10:26:15.802764 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:26:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:16.862665 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:16.863797 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-d344add8-52e6-4614-a150-55e87b3d3a2e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 29 10:26:16.864202 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:17.412098 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-272f9065-b54c-4f90-945a-a4c98e9a98e0 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:17.417748 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.wsgi [None req-272f9065-b54c-4f90-945a-a4c98e9a98e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-272f9065-b54c-4f90-945a-a4c98e9a98e0 admin admin] Request method failure captured: Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Accept: application/json Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Accept-Encoding: gzip, deflate Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Connection: keep-alive Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Content-Length: 0 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Host: 10.222.0.47 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: Openstack-System-Scope: None Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: User-Agent: python-novaclient Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Auth-Token: gAAAAABjDJRIIGsm5rXY2BEPiNadh9aJwxmNHicHoQxzzEH_EuEQjcb7ZdPjQyjc42iIaP3z_JUvUljOBgkw4oPi7j_CbqF1qVIA0O2Ii129Bj4j3N-YLnNcFX8o0L270N8WKJ6OgK9lEqpgRwiYAi3x6PR4WEFXJ5zkT-uedpNSLmRe9a_X_8E Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Id: None Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Name: None Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Identity-Status: Confirmed Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Is-Admin-Project: True Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Id: default Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Name: Default Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Name: admin Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Role: member,reader,admin Aug 29 10:26:17.421563 n-d-854121-10 devstack@n-api.service[106204]: X-Roles: member,reader,admin Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant: admin Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Name: admin Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-User: admin Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Id: default Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Name: Default Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: X-User-Name: admin Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: method: > Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: exception: Flavor 42 could not be found. Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: action_args: {'id': '42'} Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:17.423288 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:17.424174 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.425403 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-272f9065-b54c-4f90-945a-a4c98e9a98e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:17.426568 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-272f9065-b54c-4f90-945a-a4c98e9a98e0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394130 Aug 29 10:26:17.426568 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:26:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:17.432964 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-07db3e24-e1a9-4d35-b56b-2124cd783326 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:17.457514 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-07db3e24-e1a9-4d35-b56b-2124cd783326 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028479 Aug 29 10:26:17.458083 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:17.473400 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-22533ad5-48db-4754-8c59-afc7265b2c0b admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:17.496307 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-22533ad5-48db-4754-8c59-afc7265b2c0b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026443 Aug 29 10:26:17.496832 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:26:17.506426 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-33cad707-9c48-4f1e-bbd7-3d28cb096d2b admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:17.512131 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.wsgi [None req-33cad707-9c48-4f1e-bbd7-3d28cb096d2b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-33cad707-9c48-4f1e-bbd7-3d28cb096d2b admin admin] Request method failure captured: Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Accept: application/json Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Accept-Encoding: gzip, deflate Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Connection: keep-alive Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Content-Length: 0 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Host: 10.222.0.47 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: Openstack-System-Scope: None Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: User-Agent: python-novaclient Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Auth-Token: gAAAAABjDJRIIGsm5rXY2BEPiNadh9aJwxmNHicHoQxzzEH_EuEQjcb7ZdPjQyjc42iIaP3z_JUvUljOBgkw4oPi7j_CbqF1qVIA0O2Ii129Bj4j3N-YLnNcFX8o0L270N8WKJ6OgK9lEqpgRwiYAi3x6PR4WEFXJ5zkT-uedpNSLmRe9a_X_8E Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Id: None Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Name: None Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Identity-Status: Confirmed Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Is-Admin-Project: True Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Id: default Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Name: Default Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Name: admin Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Role: member,reader,admin Aug 29 10:26:17.515554 n-d-854121-10 devstack@n-api.service[106203]: X-Roles: member,reader,admin Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant: admin Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Name: admin Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-User: admin Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Id: default Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Name: Default Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: X-User-Name: admin Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: method: > Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: exception: Flavor 42 could not be found. Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: action_args: {'id': '42'} Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:17.517097 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:17.518174 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:17.519741 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-33cad707-9c48-4f1e-bbd7-3d28cb096d2b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:17.520999 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-33cad707-9c48-4f1e-bbd7-3d28cb096d2b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014398 Aug 29 10:26:17.520999 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:26:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:18.487156 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-22533ad5-48db-4754-8c59-afc7265b2c0b admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:18.488167 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-22533ad5-48db-4754-8c59-afc7265b2c0b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 29 10:26:18.488559 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:26:19.003416 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-b21a4f85-c77c-41d8-8037-34a0721c39c0 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:19.008946 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.wsgi [None req-b21a4f85-c77c-41d8-8037-34a0721c39c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-b21a4f85-c77c-41d8-8037-34a0721c39c0 admin admin] Request method failure captured: Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Accept: application/json Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Accept-Encoding: gzip, deflate Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Connection: keep-alive Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Content-Length: 0 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Host: 10.222.0.47 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: Openstack-System-Scope: None Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: User-Agent: python-novaclient Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Auth-Token: gAAAAABjDJRKN05m49ggIGnA5eedAR7JXY3_KYyQiSZchhu7FETNCpd_mMeCAM9hAfy1t6QZeatuIHIGoiyraNlD6CzSiLfQStm5yvfSZtojyFihsXec7qdDAAuZuDRw6h7o0GSnuTKGHYFaONj0nLFJUnYzKt2o2gkXkxBCDpeLv8ZLNU0AswU Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Id: None Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Name: None Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Identity-Status: Confirmed Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Is-Admin-Project: True Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Id: default Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Name: Default Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Name: admin Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Role: member,reader,admin Aug 29 10:26:19.010499 n-d-854121-10 devstack@n-api.service[106203]: X-Roles: member,reader,admin Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant: admin Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Name: admin Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-User: admin Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Id: default Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Name: Default Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: X-User-Name: admin Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: method: > Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: exception: Flavor 84 could not be found. Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: action_args: {'id': '84'} Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:19.012048 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:19.013005 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.015099 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-b21a4f85-c77c-41d8-8037-34a0721c39c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:19.016299 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-b21a4f85-c77c-41d8-8037-34a0721c39c0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385621 Aug 29 10:26:19.016299 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:26:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:19.022384 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-6bb6e4ae-7aa7-48a4-9f94-d1e35001879f admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:19.036963 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-6bb6e4ae-7aa7-48a4-9f94-d1e35001879f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018240 Aug 29 10:26:19.037489 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:19.046833 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-6aefef1e-c05e-4e80-baaa-05569c77d265 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:19.062259 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-6aefef1e-c05e-4e80-baaa-05569c77d265 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018837 Aug 29 10:26:19.062791 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:19.071762 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-7a6631bc-75a6-4fa0-a003-d06f31ae272c admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:19.077651 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.wsgi [None req-7a6631bc-75a6-4fa0-a003-d06f31ae272c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-7a6631bc-75a6-4fa0-a003-d06f31ae272c admin admin] Request method failure captured: Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Accept: application/json Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Accept-Encoding: gzip, deflate Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Connection: keep-alive Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Content-Length: 0 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Host: 10.222.0.47 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: Openstack-System-Scope: None Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: User-Agent: python-novaclient Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Auth-Token: gAAAAABjDJRKN05m49ggIGnA5eedAR7JXY3_KYyQiSZchhu7FETNCpd_mMeCAM9hAfy1t6QZeatuIHIGoiyraNlD6CzSiLfQStm5yvfSZtojyFihsXec7qdDAAuZuDRw6h7o0GSnuTKGHYFaONj0nLFJUnYzKt2o2gkXkxBCDpeLv8ZLNU0AswU Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Id: None Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Name: None Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Identity-Status: Confirmed Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Is-Admin-Project: True Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Id: default Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Name: Default Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Name: admin Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Role: member,reader,admin Aug 29 10:26:19.079187 n-d-854121-10 devstack@n-api.service[106204]: X-Roles: member,reader,admin Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant: admin Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Name: admin Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-User: admin Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Id: default Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Name: Default Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: X-User-Name: admin Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: method: > Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: exception: Flavor 84 could not be found. Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: action_args: {'id': '84'} Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:19.080479 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:19.081256 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:19.082517 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-7a6631bc-75a6-4fa0-a003-d06f31ae272c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:19.083739 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-7a6631bc-75a6-4fa0-a003-d06f31ae272c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012263 Aug 29 10:26:19.083739 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:26:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:20.058662 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-6aefef1e-c05e-4e80-baaa-05569c77d265 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:20.059681 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-6aefef1e-c05e-4e80-baaa-05569c77d265 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 10:26:20.060072 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:20.589286 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-46c7c66f-775f-4053-8d85-2ca8b6cae00e admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:20.595366 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.wsgi [None req-46c7c66f-775f-4053-8d85-2ca8b6cae00e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-46c7c66f-775f-4053-8d85-2ca8b6cae00e admin admin] Request method failure captured: Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Accept: application/json Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Accept-Encoding: gzip, deflate Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Connection: keep-alive Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Content-Length: 0 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Host: 10.222.0.47 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: Openstack-System-Scope: None Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: User-Agent: python-novaclient Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Auth-Token: gAAAAABjDJRLDge1VGuvg1DYbdweYZsw4HpfpXuTL27D73HIxISfenf-uY9XJP_NlTBGdy55jYupaf49jpm3Of4QT8KSFjw6AMIOqRwhVBf_-a-KTYk3j7CdjWas0tLI85gudU-SisSnqmAJQQjyRv4AqCVVRdaTaDQ85DNKsf-6u1l8lMJ4IdY Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Id: None Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Domain-Name: None Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Identity-Status: Confirmed Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Is-Admin-Project: True Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Id: default Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Domain-Name: Default Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Project-Name: admin Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Role: member,reader,admin Aug 29 10:26:20.596869 n-d-854121-10 devstack@n-api.service[106204]: X-Roles: member,reader,admin Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant: admin Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-Tenant-Name: admin Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-User: admin Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Id: default Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-User-Domain-Name: Default Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: X-User-Name: admin Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: method: > Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: exception: Flavor 451 could not be found. Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: action_args: {'id': '451'} Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:20.598545 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:20.599404 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.600462 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-46c7c66f-775f-4053-8d85-2ca8b6cae00e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:20.601495 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-46c7c66f-775f-4053-8d85-2ca8b6cae00e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.402318 Aug 29 10:26:20.601495 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:26:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:20.607787 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-9bb14be7-1175-463f-a583-7cb4165fcee5 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:20.622420 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-9bb14be7-1175-463f-a583-7cb4165fcee5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018163 Aug 29 10:26:20.622945 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:20.632712 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:20.648316 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019156 Aug 29 10:26:20.648840 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 29 10:26:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:26:20.658178 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-627a5d96-63cf-4f4c-a436-4159790d1fa3 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:20.663522 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.wsgi [None req-627a5d96-63cf-4f4c-a436-4159790d1fa3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-627a5d96-63cf-4f4c-a436-4159790d1fa3 admin admin] Request method failure captured: Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Accept: application/json Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Accept-Encoding: gzip, deflate Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Connection: keep-alive Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Content-Length: 0 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Host: 10.222.0.47 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Openstack-Api-Version: compute 2.90 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: Openstack-System-Scope: None Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: User-Agent: python-novaclient Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Auth-Token: gAAAAABjDJRLDge1VGuvg1DYbdweYZsw4HpfpXuTL27D73HIxISfenf-uY9XJP_NlTBGdy55jYupaf49jpm3Of4QT8KSFjw6AMIOqRwhVBf_-a-KTYk3j7CdjWas0tLI85gudU-SisSnqmAJQQjyRv4AqCVVRdaTaDQ85DNKsf-6u1l8lMJ4IdY Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Id: None Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Domain-Name: None Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Identity-Status: Confirmed Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Is-Admin-Project: True Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Id: default Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Domain-Name: Default Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Project-Name: admin Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Role: member,reader,admin Aug 29 10:26:20.665018 n-d-854121-10 devstack@n-api.service[106203]: X-Roles: member,reader,admin Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_def216f1271d40339ffccf141278c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/def216f1271d40339ffccf141278c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/def216f1271d40339ffccf141278c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant: admin Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Id: def216f1271d40339ffccf141278c553 Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-Tenant-Name: admin Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-User: admin Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Id: default Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-User-Domain-Name: Default Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-User-Id: 6d5d65097db64ea1824174e78b951a7e Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: X-User-Name: admin Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: method: > Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: exception: Flavor 451 could not be found. Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: action_args: {'id': '451'} Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:26:20.666411 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:20.667242 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: ERROR nova.api.openstack.wsgi Aug 29 10:26:20.668311 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-627a5d96-63cf-4f4c-a436-4159790d1fa3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:26:20.669299 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-627a5d96-63cf-4f4c-a436-4159790d1fa3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011971 Aug 29 10:26:20.669299 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:26:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:26:21.648439 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:21.649454 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 29 10:26:21.649893 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:22.176652 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-cbb80bde-48ad-4098-ab3d-208328c19a51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:26:22.195043 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-cbb80bde-48ad-4098-ab3d-208328c19a51 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405438 Aug 29 10:26:22.195582 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 29 10:26:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:26:23.162613 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:23.163612 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 29 10:26:23.164006 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:23.694394 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-5143014c-3f72-4252-a567-48b0f50cb6b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:26:23.712266 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-5143014c-3f72-4252-a567-48b0f50cb6b4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410537 Aug 29 10:26:23.712800 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 29 10:26:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:26:24.683266 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:24.684275 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 29 10:26:24.684669 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:25.205835 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-e518b171-8e9d-417d-ba0b-2813ba90aa06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:26:25.224931 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-e518b171-8e9d-417d-ba0b-2813ba90aa06 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401746 Aug 29 10:26:25.225474 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 29 10:26:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:26:26.216789 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:26.218515 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 29 10:26:26.218910 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:26.745933 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-2165c6b2-a644-4fb6-833b-9265cd551e95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:26:26.766952 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-2165c6b2-a644-4fb6-833b-9265cd551e95 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406540 Aug 29 10:26:26.767510 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 29 10:26:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:26:27.769051 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:27.770105 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 29 10:26:27.770500 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:26:28.292568 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-acf95e4e-b16e-454f-b38c-f197169c4bb7 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:26:28.313533 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-acf95e4e-b16e-454f-b38c-f197169c4bb7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405509 Aug 29 10:26:28.314089 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Mon Aug 29 10:26:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:27:21.978435 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:21.979437 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-968e9ee1-9d41-4501-9dd7-47a0df48ef49 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 29 10:27:21.979832 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 931 bytes} [Mon Aug 29 10:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:27:21.991346 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:27:22.368933 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-3ada633c-9b07-4021-a2be-946cc739fd95 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:22.389654 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-3ada633c-9b07-4021-a2be-946cc739fd95 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403383 Aug 29 10:27:22.390288 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:27:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:27:22.411840 n-d-854121-10 devstack@n-api.service[106204]: DEBUG dbcounter [-] [106204] Writing DB stats nova_api:SELECT=14 {{(pid=106204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:27:22.415539 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-011c3c54-7901-498d-a0d7-c54632cd6f80 admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:22.423465 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-011c3c54-7901-498d-a0d7-c54632cd6f80 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013003 Aug 29 10:27:22.424189 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1283 bytes} [Mon Aug 29 10:27:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:27:22.435593 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-3733f98e-d1fa-4cf6-a934-cf18a571e970 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:22.444184 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-3733f98e-d1fa-4cf6-a934-cf18a571e970 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012127 Aug 29 10:27:22.444710 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1286 bytes} [Mon Aug 29 10:27:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:27:22.456572 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:22.464180 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011762 Aug 29 10:27:22.464687 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1286 bytes} [Mon Aug 29 10:27:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:27:22.476260 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-e1514f4c-8ca2-4a21-9a44-93c951035d19 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:27:22.483741 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-e1514f4c-8ca2-4a21-9a44-93c951035d19 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011057 Aug 29 10:27:22.484247 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1283 bytes} [Mon Aug 29 10:27:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:32:32.637745 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:32:32.638781 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 10:32:32.639170 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:32:32.781769 n-d-854121-10 devstack@n-api.service[106203]: DEBUG dbcounter [-] [106203] Writing DB stats nova_api:SELECT=6 {{(pid=106203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:32:32.926553 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:32:32.930672 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:32:32.931141 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:32:32.931591 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:32:32.932292 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:32:32.932729 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:32:32.933140 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:32:32.973630 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-d825f81f-92fd-4d33-8fbb-22087724bf5c admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.193323 Aug 29 10:32:32.974231 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:32:32 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:32:33.808635 n-d-854121-10 devstack@n-api.service[106204]: DEBUG nova.api.openstack.wsgi [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] Calling method '>' {{(pid=106204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:32:33.809637 n-d-854121-10 devstack@n-api.service[106204]: INFO nova.api.openstack.requestlog [None req-0d30cea3-5370-4496-a20b-883fd99e6f8a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 29 10:32:33.810083 n-d-854121-10 devstack@n-api.service[106204]: [pid: 106204|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 29 10:32:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:32:34.004983 n-d-854121-10 devstack@n-api.service[106203]: DEBUG nova.api.openstack.wsgi [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Calling method '>' {{(pid=106203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:32:34.008729 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:32:34.009195 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:32:34.009673 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:32:34.010398 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:32:34.010838 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:32:34.011252 n-d-854121-10 devstack@n-api.service[106203]: DEBUG oslo_concurrency.lockutils [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:32:34.033423 n-d-854121-10 devstack@n-api.service[106203]: INFO nova.api.openstack.requestlog [None req-605a3b0e-562c-4ede-93bf-7365ef179424 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.082181 Aug 29 10:32:34.033942 n-d-854121-10 devstack@n-api.service[106203]: [pid: 106203|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:32:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:33:20.765016 n-d-854121-10 devstack@n-api.service[106202]: Mon Aug 29 10:33:20 2022 - graceful shutdown triggered... Aug 29 10:33:20.765294 n-d-854121-10 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 10:33:20.766142 n-d-854121-10 devstack@n-api.service[106203]: Gracefully killing worker 1 (pid: 106203)... Aug 29 10:33:20.766841 n-d-854121-10 devstack@n-api.service[106204]: Gracefully killing worker 2 (pid: 106204)... Aug 29 10:33:21.765820 n-d-854121-10 devstack@n-api.service[106202]: worker 1 buried after 1 seconds Aug 29 10:33:21.765820 n-d-854121-10 devstack@n-api.service[106202]: worker 2 buried after 1 seconds Aug 29 10:33:21.765820 n-d-854121-10 devstack@n-api.service[106202]: goodbye to uWSGI. Aug 29 10:33:21.767407 n-d-854121-10 systemd[1]: devstack@n-api.service: Succeeded. Aug 29 10:33:21.767965 n-d-854121-10 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 10:33:21.770877 n-d-854121-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 10:33:21.793471 n-d-854121-10 devstack@n-api.service[128669]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 10:33:21 2022] *** Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: nodename: n-d-854121-10 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: machine: x86_64 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: clock source: unix Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: pcre jit disabled Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: detected number of CPU cores: 4 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: current working directory: / Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: detected binary path: /usr/bin/uwsgi-core Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: your processes number limit is 47680 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: your memory page size is 4096 bytes Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: detected max file descriptor number: 2048 Aug 29 10:33:21.817127 n-d-854121-10 devstack@n-api.service[128669]: lock engine: pthread robust mutexes Aug 29 10:33:21.818231 n-d-854121-10 devstack@n-api.service[128669]: thunder lock: enabled Aug 29 10:33:21.818231 n-d-854121-10 devstack@n-api.service[128669]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 10:33:21.818231 n-d-854121-10 devstack@n-api.service[128669]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 10:33:21.858923 n-d-854121-10 devstack@n-api.service[128669]: Python main interpreter initialized at 0x555df3fcf9c0 Aug 29 10:33:21.858923 n-d-854121-10 devstack@n-api.service[128669]: python threads support enabled Aug 29 10:33:21.858923 n-d-854121-10 devstack@n-api.service[128669]: your server socket listen backlog is limited to 100 connections Aug 29 10:33:21.858923 n-d-854121-10 devstack@n-api.service[128669]: your mercy for graceful operations on workers is 90 seconds Aug 29 10:33:21.859387 n-d-854121-10 devstack@n-api.service[128669]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 10:33:21.859387 n-d-854121-10 devstack@n-api.service[128669]: *** Operational MODE: preforking *** Aug 29 10:33:21.859615 n-d-854121-10 devstack@n-api.service[128669]: *** uWSGI is running in multiple interpreter mode *** Aug 29 10:33:21.859615 n-d-854121-10 devstack@n-api.service[128669]: spawned uWSGI master process (pid: 128669) Aug 29 10:33:21.859822 n-d-854121-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 10:33:21.861598 n-d-854121-10 devstack@n-api.service[128669]: spawned uWSGI worker 1 (pid: 128681, cores: 1) Aug 29 10:33:21.861598 n-d-854121-10 devstack@n-api.service[128669]: spawned uWSGI worker 2 (pid: 128682, cores: 1) Aug 29 10:33:21.861598 n-d-854121-10 devstack@n-api.service[128669]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 10:33:22.527701 n-d-854121-10 devstack@n-api.service[128681]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 10:33:22.528333 n-d-854121-10 devstack@n-api.service[128682]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 10:33:23.711925 n-d-854121-10 devstack@n-api.service[128681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:33:23.711925 n-d-854121-10 devstack@n-api.service[128681]: from cryptography.utils import int_from_bytes Aug 29 10:33:23.712568 n-d-854121-10 devstack@n-api.service[128681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:33:23.712568 n-d-854121-10 devstack@n-api.service[128681]: from cryptography.utils import int_from_bytes Aug 29 10:33:23.728665 n-d-854121-10 devstack@n-api.service[128682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:33:23.728665 n-d-854121-10 devstack@n-api.service[128682]: from cryptography.utils import int_from_bytes Aug 29 10:33:23.729331 n-d-854121-10 devstack@n-api.service[128682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 10:33:23.729331 n-d-854121-10 devstack@n-api.service[128682]: from cryptography.utils import int_from_bytes Aug 29 10:33:26.161195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 10:33:26.161891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 10:33:26.162030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 10:33:26.162399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 10:33:26.162693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 10:33:26.163419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.163554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.163881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.164203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.164533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.164848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.165177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.165495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.165845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.166113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.166432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.166758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.167080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.167390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.167705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.168024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.168331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.168653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.168960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.169458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.169641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 10:33:26.170092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.170186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 10:33:26.170260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.170485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 10:33:26.170593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.170853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 10:33:26.170979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.171115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 10:33:26.171238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.171474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.171587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.171840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.171957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.172965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.173946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.174888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.175851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.176976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.177134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.177286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.177456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.177786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.177904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.178097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.178200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.178965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.179932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.180813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.181928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.182901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.183887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.184816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.185799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.186958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.187937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.188256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.188572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.188809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.188925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.189837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.190808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.191962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.192175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.192289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.193396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.193516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.193596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.193677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.194087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.194255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.194716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.194843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.194948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.195948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.196112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.196283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.196433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.196620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.196762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.197487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.197719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.197845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.198045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.198368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.198541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.198716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.198880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.199852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.200962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.201969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.202901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.203862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.204993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.205953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.206982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.207923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.208915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.209071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.209210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.209385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.209535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.209811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.209976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.210115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.210250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.210443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.210601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.210752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.210902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.211048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.211225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.211382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.211524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.211663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.211754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.211958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.212053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.212281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.212388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.212588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.212701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.212896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.212997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.213217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.213356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.213530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.213676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.213878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.213980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.214189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.214295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.214498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.214805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.215116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.215608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.216018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.216558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.216936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.217134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.217263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.217497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.217616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.218062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.218455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.218855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 10:33:26.219277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.219689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.220024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.220167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.220539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.220952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.221365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.221804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.222117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.222261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.222527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.222669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.222884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.223073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.223225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.223523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.223631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.223918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.224915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.225990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.226104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.226323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.226406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.226664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.226767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.227909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.228933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.229117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.229255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.229451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.229574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.230031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.230150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.230353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.230627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.230755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.231814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.232982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.233953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.234095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.234577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.234674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.234774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.234921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.235907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.236872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.237870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.238794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.239960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.240059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.240270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.240371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.240610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.240701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.241472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.241648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.241820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.242947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.243930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.244902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.245898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.246931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.247865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.248994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.249955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.250898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.251854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.252959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.253951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.254832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.255759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.256020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.256120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.256361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.257901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.258971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.259917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.260926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.261222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.261616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.261920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.262049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.262249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.262384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.263909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.264953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.265156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.265297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.265547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.265667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.265922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.266873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.267938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.268962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.269238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.269371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.269622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.269815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.269963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.270924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.271981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.272306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.272420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.272679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.272856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.272975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.273177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.273284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.273549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.273658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.274947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.275958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.276071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.276353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.276667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.276767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.277042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.277156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.277417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.277561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.277953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.278150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.278323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.278533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.278679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.278925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.279145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.279303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.279532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.279882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.280994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.281197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.281302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.281548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.281663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.281891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.282935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.283145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.283249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.283477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.283582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.283799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.284807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.285826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.286971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.287068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.287282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.287378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.287588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.287740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.288916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.289964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.290847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.291838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.292915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.293860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.294800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.295951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.296901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.297937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.298856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.299772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.300064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.300170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.300417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.300551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.301983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.302898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.303023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.303215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.303914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.304780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.305011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.305138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.305456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.305785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.306912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.307920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.308059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.308343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.308550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.308692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.308913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.309932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.310999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.311874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.312969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.313906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.314905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.315958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.316891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.317837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.318869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.319585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.319721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.319859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.320970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.321944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.322875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.323842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.324952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.325979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.326917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.327853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.328981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.329966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.330202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.330439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.330558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.330851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.331155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.331527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.331693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.331860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.332867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.333872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.334083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.334397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.334806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.335170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.335441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.335747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.336053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.336379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.336685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.337006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.337437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.337775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.338039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.338173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.338492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.338742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.338883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.339109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.339312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.339445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.339740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.339877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.340065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.340276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.340406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.340674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.340803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.341033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.341575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.341722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.341928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.342247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.342381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.342564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.342753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.342885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.343183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.343324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.343508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.343701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.343841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.344136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.344267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.344552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.344734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.344874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.345175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.345313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.345500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.345851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.346009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.346147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.346464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.346615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.346761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.347975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.348164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.348306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.348584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.348738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.348936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.349184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.349349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.349490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.349818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.349968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.350643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.350832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.351160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.351496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.351633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.351777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.351907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.352955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.353258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.353395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.353564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.353801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.353947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.354225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.354363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.354533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.354857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.355072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.355204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.355486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.355618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.355867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.356138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.356284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.356468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.356790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.356932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.357103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.357292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.357426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.357757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.357903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.358978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.359273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.359547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.359696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.359877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.360972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.361112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.361391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.361543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.361784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.362038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.362178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.362419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.362750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.362882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.363020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.363155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.363854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.364946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.365087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.365346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.365494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.365631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.366832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.366832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.367119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.367260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.367398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.367533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.367878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.368281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.368689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.369150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.369596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.370932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.371094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.371401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.371678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.371916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.372983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.373295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.373435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.373625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.373821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.374072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.374320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.374462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.374733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.374946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.375078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.375382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.375521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.375716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.375926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.376060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.376366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.376600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.376742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.377023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.377157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.377294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.377610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.377775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.378961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.379092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.379312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.379596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.379740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.379913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.380090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.380230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.380530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.380662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.380845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.381087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.381227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.381495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.381663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.381842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.382181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.382547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.382688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.382943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.383101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.383271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.383565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.383698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.383891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.384072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.384211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.384549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.384952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.385094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.385275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.385575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.385740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.385967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.386103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.386297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.386619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.386831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.386976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.387257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.387388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.387556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.387697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.387863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.388978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.389128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.389423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.389656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.389862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.390031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.390165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.390358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.390531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.390893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.391960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.392209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.392360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.392526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.392837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.393947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.394121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.394317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.394451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.394723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.394867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.395029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.395221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.395355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.395636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.395883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.396030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.396268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.396408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.396547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.396870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.397053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.397319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.397457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.397588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.397925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.398985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.399239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.399379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.399591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.399860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.400903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.401085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.401301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.401443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.401760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.401908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.402993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.403272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.403405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.403610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.403937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.404069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.404251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.404521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.404652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.405001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.405161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.405293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.405456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.405847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.406967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.407175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.407460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.407602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.407731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.407858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.408961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.409267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.409408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.409576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.409827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.410960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.411132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.411397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.411538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.411745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.411878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.412053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.412271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.412422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.413170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.413388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.413895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.414047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.414266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.414457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.414598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.414895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.415997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.416179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.416422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.416562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.416734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.416944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.417086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.417445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.417591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.417750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.417898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.418031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.418316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.418449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.418715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.418847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.419037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.419250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.419383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.419658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.419804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.420941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.421223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.421354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.421550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.421817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.421963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.422226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.422368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.422553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.422811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.423123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.423264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.451782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.452220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.452220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.453370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.454466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.454818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.454993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.455158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.455323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.455485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.455660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.456867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.457034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.457303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.457553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.457553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.457984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.458816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.459877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.460802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.460951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.461974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.462323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.462527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.462680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.462809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.462932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.463969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.464969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.465997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.466392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.466530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.466652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.466984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.467950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.468886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.469947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.470122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.470335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.470580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.471058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.471267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.472578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.472812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.472979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.473131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.473284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.473678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.474069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.474385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.474831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.475885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.475885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.476508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.476696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.476830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.477970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.478972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.479116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.479557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.479698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.479833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.479959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.480853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.481980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.483820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.485538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.486960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.487770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.488946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.489326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.489650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.490067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.490421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.490780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.491757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.492186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.492594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.493019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.493307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.493650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.494016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.494340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.494689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.495016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.495342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.495670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.495998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.496323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.496772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.497136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.497539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.497831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.498132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.498466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.498831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.499123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.499458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.499896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.500157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.500501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.500858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.501269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.501572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.501918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.503919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.504187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.504519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.504880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.505261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.505587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.506006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.506359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.507029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.507655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.507807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 10:33:26.508017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 10:33:26.519081 n-d-854121-10 devstack@n-api.service[128682]: INFO dbcounter [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Registered counter for database nova_api Aug 29 10:33:26.540286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_db.sqlalchemy.engines [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.547466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writer thread running {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.573652 n-d-854121-10 devstack@n-api.service[128681]: INFO dbcounter [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Registered counter for database nova_api Aug 29 10:33:26.594063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_db.sqlalchemy.engines [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.601673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writer thread running {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.606739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.context [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128682) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 10:33:26.610776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:33:26.611250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:33:26.612846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:33:26.613577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:33:26.614056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:33:26.616621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:33:26.618756 n-d-854121-10 devstack@n-api.service[128682]: INFO dbcounter [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Registered counter for database nova_cell0 Aug 29 10:33:26.622828 n-d-854121-10 devstack@n-api.service[128682]: INFO dbcounter [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Registered counter for database nova_cell1 Aug 29 10:33:26.630477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_db.sqlalchemy.engines [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.632216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_db.sqlalchemy.engines [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.638249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writer thread running {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.640377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writer thread running {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.660388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.context [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128681) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 10:33:26.665405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:33:26.665956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:33:26.667698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:33:26.668479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:33:26.668932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:33:26.670994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:33:26.673011 n-d-854121-10 devstack@n-api.service[128681]: INFO dbcounter [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Registered counter for database nova_cell0 Aug 29 10:33:26.677069 n-d-854121-10 devstack@n-api.service[128681]: INFO dbcounter [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Registered counter for database nova_cell1 Aug 29 10:33:26.684704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_db.sqlalchemy.engines [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.687422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_db.sqlalchemy.engines [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.694628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writer thread running {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.696131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writer thread running {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.793764 n-d-854121-10 devstack@n-api.service[128682]: INFO dbcounter [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Registered counter for database nova_cell0 Aug 29 10:33:26.800906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_db.sqlalchemy.engines [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.806867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writer thread running {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:26.846891 n-d-854121-10 devstack@n-api.service[128681]: INFO dbcounter [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Registered counter for database nova_cell0 Aug 29 10:33:26.857146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_db.sqlalchemy.engines [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 10:33:26.861743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writer thread running {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 10:33:27.146970 n-d-854121-10 devstack@n-api.service[128682]: WARNING keystonemiddleware.auth_token [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:33:27.154973 n-d-854121-10 devstack@n-api.service[128682]: WARNING keystonemiddleware.auth_token [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:33:27.187221 n-d-854121-10 devstack@n-api.service[128681]: WARNING keystonemiddleware.auth_token [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:33:27.195377 n-d-854121-10 devstack@n-api.service[128681]: WARNING keystonemiddleware.auth_token [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:33:27.500923 n-d-854121-10 devstack@n-api.service[128682]: WARNING keystonemiddleware.auth_token [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:33:27.507604 n-d-854121-10 devstack@n-api.service[128682]: WARNING keystonemiddleware.auth_token [None req-f428cf4f-83fa-4f58-8767-79a607feedae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:33:27.512887 n-d-854121-10 devstack@n-api.service[128682]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555df3fcf9c0 pid: 128682 (default app) Aug 29 10:33:27.542709 n-d-854121-10 devstack@n-api.service[128681]: WARNING keystonemiddleware.auth_token [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 10:33:27.548777 n-d-854121-10 devstack@n-api.service[128681]: WARNING keystonemiddleware.auth_token [None req-d7116cf7-49e6-407f-87a2-e300b40b8c50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 10:33:27.554938 n-d-854121-10 devstack@n-api.service[128681]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555df3fcf9c0 pid: 128681 (default app) Aug 29 10:34:07.669284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:07.670309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:07.671116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:07.672191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:08.254456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:08.256664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:08.257784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:08.258723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:08.911906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adf78b2c-0e1f-4de9-9809-6085ae4bcdd4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Calling method '.version_select at 0x7f66c88e9a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:08.913973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-adf78b2c-0e1f-4de9-9809-6085ae4bcdd4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ecc0f01b724e4bd7959828d79e11e3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2affd48dda64d46b3635d237922a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adf78b2c-0e1f-4de9-9809-6085ae4bcdd4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Request method failure captured: Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYdaKYRc9pQEk__-DYLyVgU6uW8XxeGK--ubTyVXG3JSTjeKUl17UJpZ8rQ6E-yo6zDUuETBE-Wva0Ea9e6uSoac3etNOFm9shQjwGXM8z-SZEeWZzgCMY-1rP814bJ0rBMZG2egE-JzkLnEUp6Yg4izpFu1ZAFNZnJTIvfbKLfzFI Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:08.917334 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: ecc0f01b724e4bd7959828d79e11e3fa Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: action_args: {} Aug 29 10:34:08.918662 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:08.919592 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 10:34:08.921264 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:08.922565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adf78b2c-0e1f-4de9-9809-6085ae4bcdd4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:08.922565 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-adf78b2c-0e1f-4de9-9809-6085ae4bcdd4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.259836 Aug 29 10:34:08.922565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1/1] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:34:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:09.198139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '.version_select at 0x7f66c87ba1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.206749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128682) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 10:34:09.207478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.207946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.208616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.235604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.236087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.236518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.249645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.250164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.250745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.257018 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a748086-497c-4b7d-a14f-12a67663ee5f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.336114 Aug 29 10:34:09.257570 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2/2] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:34:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:09.262166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76f0d231-9d02-49b3-bb04-30676245ced4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Calling method '.version_select at 0x7f66c8772310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.264113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76f0d231-9d02-49b3-bb04-30676245ced4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ecc0f01b724e4bd7959828d79e11e3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2affd48dda64d46b3635d237922a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76f0d231-9d02-49b3-bb04-30676245ced4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Request method failure captured: Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYdaKYRc9pQEk__-DYLyVgU6uW8XxeGK--ubTyVXG3JSTjeKUl17UJpZ8rQ6E-yo6zDUuETBE-Wva0Ea9e6uSoac3etNOFm9shQjwGXM8z-SZEeWZzgCMY-1rP814bJ0rBMZG2egE-JzkLnEUp6Yg4izpFu1ZAFNZnJTIvfbKLfzFI Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:09.265681 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: ecc0f01b724e4bd7959828d79e11e3fa Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: action_args: {} Aug 29 10:34:09.266759 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:09.267388 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 10:34:09.268276 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.269214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76f0d231-9d02-49b3-bb04-30676245ced4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:09.269214 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76f0d231-9d02-49b3-bb04-30676245ced4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008372 Aug 29 10:34:09.272130 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3/3] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:09.351708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ae47b2e-5906-4c2a-9194-641b8e4d74d1 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1837974974", "id": 1401778196, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:09.407212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ae47b2e-5906-4c2a-9194-641b8e4d74d1 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.133851 Aug 29 10:34:09.408410 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 4/4] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:09.542624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f30ed26-ab53-47ed-ab61-fb1a112c145a tempest-AZAdminNegativeTestJSON-625671077 tempest-AZAdminNegativeTestJSON-625671077-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.544299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f30ed26-ab53-47ed-ab61-fb1a112c145a tempest-AZAdminNegativeTestJSON-625671077 tempest-AZAdminNegativeTestJSON-625671077-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '4aedd2c0963b4bbcb10cfb4f454f5c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85d10fc618c404fac21ca9f824b7211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f30ed26-ab53-47ed-ab61-fb1a112c145a tempest-AZAdminNegativeTestJSON-625671077 tempest-AZAdminNegativeTestJSON-625671077-project] Request method failure captured: Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYdFQq-0DNdTq06C277EPLrR3uwfJ4Kui2-MLa0z843PA3-M3enqICDbvTSNtFcFjUjGYmJ7Lx4RXfCHQnEGiXBMAj4N7MWta5igxtan56zgZVbe9hVAtQGCxSLQXnLvzG8zG9oA_DsciyLNec5jEMsDFd_0JddFgxmbWlCFY-A7eI Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a85d10fc618c404fac21ca9f824b7211 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AZAdminNegativeTestJSON-625671077 Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:09.547589 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a85d10fc618c404fac21ca9f824b7211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a85d10fc618c404fac21ca9f824b7211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a85d10fc618c404fac21ca9f824b7211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a85d10fc618c404fac21ca9f824b7211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AZAdminNegativeTestJSON-625671077 Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a85d10fc618c404fac21ca9f824b7211 Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-625671077 Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AZAdminNegativeTestJSON-625671077-project Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4aedd2c0963b4bbcb10cfb4f454f5c15 Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AZAdminNegativeTestJSON-625671077-project Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 10:34:09.548673 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:09.549270 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.550858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f30ed26-ab53-47ed-ab61-fb1a112c145a tempest-AZAdminNegativeTestJSON-625671077 tempest-AZAdminNegativeTestJSON-625671077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:09.551917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f30ed26-ab53-47ed-ab61-fb1a112c145a tempest-AZAdminNegativeTestJSON-625671077 tempest-AZAdminNegativeTestJSON-625671077-project] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.300209 Aug 29 10:34:09.551917 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1/5] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:34:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:34:09.613454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Calling method '.version_select at 0x7f66c8772ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.616522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.617113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.617685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.635553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.636197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.636719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.647816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.648299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.648728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.654604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c163da01-3342-4f6b-911d-c3abb86aea7f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.241495 Aug 29 10:34:09.655158 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 5/6] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:09.660189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d0cce62-7901-4185-a4a7-25583a276a8b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-827359377", "name": "tempest-test_aggregate-212882252"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:09.680530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-5d0cce62-7901-4185-a4a7-25583a276a8b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 2e6258ef-a61c-4101-824f-583c0de36d36 for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:09.731117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Calling method '.version_select at 0x7f66c879caf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.745694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128681) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 10:34:09.747633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.749132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.749644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.757163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d0cce62-7901-4185-a4a7-25583a276a8b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.100682 Aug 29 10:34:09.757807 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 6/7] 10.222.0.47 () {60 vars in 1165 bytes} [Mon Aug 29 10:34:09 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:09.767070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a5d94af-ee49-42ff-af47-38f48b5f48fb tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Calling method '.version_select at 0x7f66c86b83a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.771413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a5d94af-ee49-42ff-af47-38f48b5f48fb tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ecc0f01b724e4bd7959828d79e11e3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2affd48dda64d46b3635d237922a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a5d94af-ee49-42ff-af47-38f48b5f48fb tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Request method failure captured: Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYdaKYRc9pQEk__-DYLyVgU6uW8XxeGK--ubTyVXG3JSTjeKUl17UJpZ8rQ6E-yo6zDUuETBE-Wva0Ea9e6uSoac3etNOFm9shQjwGXM8z-SZEeWZzgCMY-1rP814bJ0rBMZG2egE-JzkLnEUp6Yg4izpFu1ZAFNZnJTIvfbKLfzFI Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:09.772978 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: ecc0f01b724e4bd7959828d79e11e3fa Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: action_args: {} Aug 29 10:34:09.774611 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:09.775367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 10:34:09.776479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:09.778244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a5d94af-ee49-42ff-af47-38f48b5f48fb tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:09.779401 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a5d94af-ee49-42ff-af47-38f48b5f48fb tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020547 Aug 29 10:34:09.783911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 7/8] 10.222.0.47 () {58 vars in 1179 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:09.792227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.792726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.793171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.808034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.808519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.808960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.815522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c0169cd-feab-42cd-bb63-07557178c50d tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.264864 Aug 29 10:34:09.816087 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2/9] 10.222.0.47 () {60 vars in 1208 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:34:09.820842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c2b2900f-ca2e-4ae2-bbc1-33f6bd85ac37 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.855182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c2b2900f-ca2e-4ae2-bbc1-33f6bd85ac37 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1401778196" status: 202 len: 0 microversion: 2.1 time: 0.037825 Aug 29 10:34:09.857505 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3/10] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:09 2022] DELETE /compute/v2.1/flavors/1401778196 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:09.864196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Calling method '.version_select at 0x7f66c879c820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.866358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.866870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.867274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.894432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:09.894917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:09.895356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:09.902666 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c163449d-c1f7-4f19-bf88-1da8f062722f tempest-HypervisorAdminV228Test-886431382 tempest-HypervisorAdminV228Test-886431382-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.043684 Aug 29 10:34:09.903250 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 4/11] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:09.907838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f61f8f29-5faa-489b-aa28-4f04c804eebe tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:09.925277 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f61f8f29-5faa-489b-aa28-4f04c804eebe tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.020812 Aug 29 10:34:09.926168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 5/12] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:10.088418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-374443274", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:10.290351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Calling method '.version_select at 0x7f66c87319d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:10.292089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:10.292791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:10.293223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:10.309554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:10.310230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:10.310903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:10.329644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:10.330328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:10.330913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:10.338460 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd9148ec-0d54-4205-9248-8eabed1149c6 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.411121 Aug 29 10:34:10.339730 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:10.344493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd13c098-ebdc-41cb-8e9a-17ae22942161 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:10.386165 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd13c098-ebdc-41cb-8e9a-17ae22942161 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044838 Aug 29 10:34:10.387340 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:10.393064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9bb117c5-a77b-428a-aa75-fc9778cbf9d9 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:10.438311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bb117c5-a77b-428a-aa75-fc9778cbf9d9 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:10.439014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bb117c5-a77b-428a-aa75-fc9778cbf9d9 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:10.439773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bb117c5-a77b-428a-aa75-fc9778cbf9d9 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:10.966900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:34:11.375236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:34:11.375991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:34:11.376661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:34:11.377115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:34:11.377684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:34:11.415215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:11.415671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:11.417835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:11.418712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:11.420718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9bb117c5-a77b-428a-aa75-fc9778cbf9d9 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.031729 Aug 29 10:34:11.421172 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 8/15] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:11.422700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:11.423286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:11.432916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12905b81-1626-4adf-99ea-2d69e14476ce tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Calling method '.version_select at 0x7f66c7e48430>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.442309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12905b81-1626-4adf-99ea-2d69e14476ce tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ecc0f01b724e4bd7959828d79e11e3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2affd48dda64d46b3635d237922a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:11.463127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Getting quotas for project 27860db656e848829f1e4e46936c28d7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12905b81-1626-4adf-99ea-2d69e14476ce tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Request method failure captured: Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYdaKYRc9pQEk__-DYLyVgU6uW8XxeGK--ubTyVXG3JSTjeKUl17UJpZ8rQ6E-yo6zDUuETBE-Wva0Ea9e6uSoac3etNOFm9shQjwGXM8z-SZEeWZzgCMY-1rP814bJ0rBMZG2egE-JzkLnEUp6Yg4izpFu1ZAFNZnJTIvfbKLfzFI Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:11.463332 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: ecc0f01b724e4bd7959828d79e11e3fa Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1'} Aug 29 10:34:11.464714 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:11.465878 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 10:34:11.467006 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.467998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12905b81-1626-4adf-99ea-2d69e14476ce tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:11.467998 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12905b81-1626-4adf-99ea-2d69e14476ce tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.045522 Aug 29 10:34:11.474494 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:34:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:11.476761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Getting quotas for user 4b022ffddbc349a196a26b77bfd62dfd and project 27860db656e848829f1e4e46936c28d7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:11.480523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49cfc74a-ad3f-4fc7-997e-0b6ae7bfd1cc tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-185206771", "id": 507864767, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:11.489205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:34:11.492747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:34:11.565858 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49cfc74a-ad3f-4fc7-997e-0b6ae7bfd1cc tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.088665 Aug 29 10:34:11.567065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 10/17] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:11.569919 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6551fe3a-9d0c-4acd-96a9-aed6b782ebbc tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.788153 Aug 29 10:34:11.576646 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 8/18] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:34:11.581057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c6e1638-5522-42cf-82ae-6a5b764e2e46 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Calling method '.version_select at 0x7f66c7ddb0d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.586116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0c6e1638-5522-42cf-82ae-6a5b764e2e46 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] HTTP exception thrown: Hypervisor with ID 'd70a1a96-d401-492c-9071-e078baf038f9' could not be found. Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c6e1638-5522-42cf-82ae-6a5b764e2e46 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Request method failure captured: Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hypervisors/d70a1a96-d401-492c-9071-e078baf038f9/uptime HTTP/1.1 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYfW6TQVDtZsKcND7fMBDyAz1WOVoBjIZ_-OFXIsyomEOXJghUmLPIUn_spwn4VrF1J8awXa7Vm70vspmhY7L-7AfzMCo9qBQq1y7pjMs_3gC7upxgkU__NKFaZm-ROgxicORaMasHz0XkA7_yevkiQ_eU9Asf2FdtY4ecZBfUBVxI Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4a4b87404d204a3793b7a538322da2b1 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:11.591088 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4a4b87404d204a3793b7a538322da2b1 Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 1b1b0775a34243658bfcb82c4c851507 Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: exception: Hypervisor with ID 'd70a1a96-d401-492c-9071-e078baf038f9' could not be found. Aug 29 10:34:11.592271 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd70a1a96-d401-492c-9071-e078baf038f9'} Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd70a1a96-d401-492c-9071-e078baf038f9' Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 10:34:11.592889 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd70a1a96-d401-492c-9071-e078baf038f9' could not be found. Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:11.594017 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd70a1a96-d401-492c-9071-e078baf038f9' could not be found. Aug 29 10:34:11.595035 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:11.595395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ac5fb04-c843-42c2-87cd-b81d883233e4 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.598462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c6e1638-5522-42cf-82ae-6a5b764e2e46 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Returning 404 to user: Hypervisor with ID 'd70a1a96-d401-492c-9071-e078baf038f9' could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:11.601131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c6e1638-5522-42cf-82ae-6a5b764e2e46 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/d70a1a96-d401-492c-9071-e078baf038f9/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031912 Aug 29 10:34:11.602211 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 11/19] 10.222.0.47 () {58 vars in 1278 bytes} [Mon Aug 29 10:34:11 2022] GET /compute/v2.1/os-hypervisors/d70a1a96-d401-492c-9071-e078baf038f9/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:11.610531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b184c74d-a15c-48c6-94a8-b49e6ccea442 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.612012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b184c74d-a15c-48c6-94a8-b49e6ccea442 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:11.646769 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ac5fb04-c843-42c2-87cd-b81d883233e4 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.066438 Aug 29 10:34:11.647717 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 9/20] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:11 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:11.653185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Calling method '.version_select at 0x7f66c7e2ff70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.655516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:11.656011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:11.656447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:11.685726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:11.686242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:11.686684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:11.699248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:11.700214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:11.700791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:11.710564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30756b84-7161-4db5-91bf-e4df90279cab tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.061705 Aug 29 10:34:11.711851 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:11.718373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8558094b-fd5e-4b70-a1d0-bbcd71f073e7 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:11.756426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8558094b-fd5e-4b70-a1d0-bbcd71f073e7 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/507864767" status: 202 len: 0 microversion: 2.1 time: 0.043191 Aug 29 10:34:11.758637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 11/22] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:11 2022] DELETE /compute/v2.1/flavors/507864767 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:12.143218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2064082345", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "availability_zone": "tempest-test_az-827359377"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:12.157810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:12.158500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:12.159141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:12.160034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:12.160692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:12.161114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:12.256630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:34:12.531755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:34:12.532850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:34:12.533492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:34:12.534093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:34:12.534673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:34:12.545302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:12.545823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:12.546261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:12.546976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:12.547634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:12.548140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:12.564988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b184c74d-a15c-48c6-94a8-b49e6ccea442 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:12.574251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Getting quotas for project bf8ab73107804b3198e73b0b99e97f17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:12.578828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Getting quotas for user 8b267f9b2c424539a7543043afdfcba7 and project bf8ab73107804b3198e73b0b99e97f17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:12.585078 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b184c74d-a15c-48c6-94a8-b49e6ccea442 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1219 microversion: 2.1 time: 0.981547 Aug 29 10:34:12.586136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:11 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1219 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:12.592822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0ef046c-4640-42a8-ac1e-0db81c1b19c4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Calling method '.version_select at 0x7f66c7d9eee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.594777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c0ef046c-4640-42a8-ac1e-0db81c1b19c4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ecc0f01b724e4bd7959828d79e11e3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2affd48dda64d46b3635d237922a0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0ef046c-4640-42a8-ac1e-0db81c1b19c4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Request method failure captured: Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYdaKYRc9pQEk__-DYLyVgU6uW8XxeGK--ubTyVXG3JSTjeKUl17UJpZ8rQ6E-yo6zDUuETBE-Wva0Ea9e6uSoac3etNOFm9shQjwGXM8z-SZEeWZzgCMY-1rP814bJ0rBMZG2egE-JzkLnEUp6Yg4izpFu1ZAFNZnJTIvfbKLfzFI Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:12.596516 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2affd48dda64d46b3635d237922a0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a2affd48dda64d46b3635d237922a0cb Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497 Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: ecc0f01b724e4bd7959828d79e11e3fa Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1160477497-project Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1'} Aug 29 10:34:12.597825 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:12.598604 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 10:34:12.599728 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.601112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0ef046c-4640-42a8-ac1e-0db81c1b19c4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:12.601112 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0ef046c-4640-42a8-ac1e-0db81c1b19c4 tempest-HypervisorAdminNegativeTestJSON-1160477497 tempest-HypervisorAdminNegativeTestJSON-1160477497-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.011460 Aug 29 10:34:12.601112 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 13/24] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:12.606986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd085d3f-6cd8-4ff6-b18a-91284e235a81 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.607783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:34:12.610670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:34:12.645432 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd085d3f-6cd8-4ff6-b18a-91284e235a81 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042032 Aug 29 10:34:12.646674 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:12.682351 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9bfdddf-eb29-41f5-9492-24369fb3849a tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921568 Aug 29 10:34:12.684855 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 12/26] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:34:12.689995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adc27150-1eec-40ca-9b42-b173d6e6d211 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Calling method '.version_select at 0x7f66c7dab430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.702968 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-adc27150-1eec-40ca-9b42-b173d6e6d211 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] HTTP exception thrown: Hypervisor with ID 'b7031096-ac71-480c-ad84-be0f1932d991' could not be found. Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adc27150-1eec-40ca-9b42-b173d6e6d211 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Request method failure captured: Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/b7031096-ac71-480c-ad84-be0f1932d991 HTTP/1.1 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYfW6TQVDtZsKcND7fMBDyAz1WOVoBjIZ_-OFXIsyomEOXJghUmLPIUn_spwn4VrF1J8awXa7Vm70vspmhY7L-7AfzMCo9qBQq1y7pjMs_3gC7upxgkU__NKFaZm-ROgxicORaMasHz0XkA7_yevkiQ_eU9Asf2FdtY4ecZBfUBVxI Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4a4b87404d204a3793b7a538322da2b1 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:12.709487 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a4b87404d204a3793b7a538322da2b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4a4b87404d204a3793b7a538322da2b1 Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255 Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 1b1b0775a34243658bfcb82c4c851507 Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: exception: Hypervisor with ID 'b7031096-ac71-480c-ad84-be0f1932d991' could not be found. Aug 29 10:34:12.710876 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b7031096-ac71-480c-ad84-be0f1932d991'} Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b7031096-ac71-480c-ad84-be0f1932d991' Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 10:34:12.711724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:12.713048 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b7031096-ac71-480c-ad84-be0f1932d991' could not be found. Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b7031096-ac71-480c-ad84-be0f1932d991' could not be found. Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adc27150-1eec-40ca-9b42-b173d6e6d211 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] Returning 404 to user: Hypervisor with ID 'b7031096-ac71-480c-ad84-be0f1932d991' could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-adc27150-1eec-40ca-9b42-b173d6e6d211 tempest-HypervisorAdminNegativeTestJSON-1920087255 tempest-HypervisorAdminNegativeTestJSON-1920087255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/b7031096-ac71-480c-ad84-be0f1932d991" status: 404 len: 123 microversion: 2.1 time: 0.025813 Aug 29 10:34:12.714090 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/os-hypervisors/b7031096-ac71-480c-ad84-be0f1932d991 => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:12.721459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12593616-b7d9-44a4-a952-ff442554dfe6 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-214622396", "id": 1298726052, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:12.755642 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12593616-b7d9-44a4-a952-ff442554dfe6 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.038317 Aug 29 10:34:12.758008 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 14/28] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:12 2022] POST /compute/v2.1/flavors => generated 428 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:12.768573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0317798e-7c78-4199-b0ef-15de7252ff8f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.769484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0317798e-7c78-4199-b0ef-15de7252ff8f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:12.863235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0317798e-7c78-4199-b0ef-15de7252ff8f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:12.880517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0317798e-7c78-4199-b0ef-15de7252ff8f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1242 microversion: 2.1 time: 0.120766 Aug 29 10:34:12.881844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 15/29] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1242 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:12.899275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70f47929-9214-4765-a998-9c0851e296fa tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.929891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70f47929-9214-4765-a998-9c0851e296fa tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1298726052" status: 202 len: 0 microversion: 2.1 time: 0.046587 Aug 29 10:34:12.931335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 16/30] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:12 2022] DELETE /compute/v2.1/flavors/1298726052 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:12.948820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2caeb631-3757-42f5-b9fe-557a233d39aa tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:12.990733 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2caeb631-3757-42f5-b9fe-557a233d39aa tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052495 Aug 29 10:34:12.991310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 17/31] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:13.016487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e6c3e13c-9533-4f69-9e9e-6d0f01a83fef tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1238125682", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:13.026602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.028177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.028661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.029193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.030013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.030574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.031039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.044540 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e6c3e13c-9533-4f69-9e9e-6d0f01a83fef tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035546 Aug 29 10:34:13.045270 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 18/32] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:13 2022] POST /compute/v2.1/flavors => generated 507 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:13.058946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62ea16e3-3636-4c9a-871a-e7399c8908a5 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.082749 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62ea16e3-3636-4c9a-871a-e7399c8908a5 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/0a29b07b-62f7-4923-8097-32d598e8746e" status: 202 len: 0 microversion: 2.1 time: 0.028488 Aug 29 10:34:13.083666 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 19/33] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:34:13 2022] DELETE /compute/v2.1/flavors/0a29b07b-62f7-4923-8097-32d598e8746e => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:13.097913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80954c58-e5a5-4a9e-ac69-889449236eca tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.119669 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2caef4e6-955b-418c-84cf-dc98df0dbf0f tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.472269 Aug 29 10:34:13.125851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 15/34] 10.222.0.47 () {58 vars in 1164 bytes} [Mon Aug 29 10:34:12 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:13.128732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11,nova_api:DELETE=9 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:13.140328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.143695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.144733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.145322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.146740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.147370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.147952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.152217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80954c58-e5a5-4a9e-ac69-889449236eca tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063821 Aug 29 10:34:13.153571 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 20/35] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:13.173992 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98d653b7-44f3-49f0-b62b-63d912fbafd2 tempest-AZAdminV2TestJSON-1325069027 tempest-AZAdminV2TestJSON-1325069027-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 703 microversion: 2.1 time: 0.042698 Aug 29 10:34:13.175037 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 16/36] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 703 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:13.185827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22adda6e-5979-4041-9f49-35df13c3fa3b tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-144355444", "id": "57d866b4-3367-47d9-a2a3-8ea3674dac6f", "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:13.216941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22adda6e-5979-4041-9f49-35df13c3fa3b tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.045546 Aug 29 10:34:13.219100 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 21/37] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:13 2022] POST /compute/v2.1/flavors => generated 506 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:13.230888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90a5abc4-18ff-4692-a208-f08b0dd1f1d9 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.255698 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90a5abc4-18ff-4692-a208-f08b0dd1f1d9 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/57d866b4-3367-47d9-a2a3-8ea3674dac6f" status: 202 len: 0 microversion: 2.1 time: 0.027629 Aug 29 10:34:13.256337 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 17/38] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:34:13 2022] DELETE /compute/v2.1/flavors/57d866b4-3367-47d9-a2a3-8ea3674dac6f => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:13.267479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01621ab2-0422-411f-a11f-a7a6a8798a8b tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.301151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01621ab2-0422-411f-a11f-a7a6a8798a8b tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038265 Aug 29 10:34:13.303024 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 22/39] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:13.326033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1c426c1-3a11-4797-996a-8cc7f6da8990 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2108692778", "id": 964235894, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:13.351624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1c426c1-3a11-4797-996a-8cc7f6da8990 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.029556 Aug 29 10:34:13.353290 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 18/40] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:13.364945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80158324-40d4-4287-9506-7c0e62a87f5c tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.381142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80158324-40d4-4287-9506-7c0e62a87f5c tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/964235894" status: 200 len: 411 microversion: 2.1 time: 0.018879 Aug 29 10:34:13.389855 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 23/41] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/flavors/964235894 => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:13.606575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.607924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:13.617033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.617719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.618332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.619284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.620129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.621206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.792052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:13.829589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a4922b8-e34f-4482-bc36-ffda8e6c51f3 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1271 microversion: 2.1 time: 0.227031 Aug 29 10:34:13.830946 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 24/42] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:13.901019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.902111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:13.908927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9398c5e2-4d4c-4ec9-abc0-16e50f7d2556 tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:13.917238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.925589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.926388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.927988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:13.930219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:13.930838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:13.975001 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9398c5e2-4d4c-4ec9-abc0-16e50f7d2556 tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.584205 Aug 29 10:34:13.995642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 19/43] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:14.002713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0211179-c5bd-44f4-8132-fbe0a9f1fdf3 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.041184 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0211179-c5bd-44f4-8132-fbe0a9f1fdf3 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/964235894" status: 202 len: 0 microversion: 2.1 time: 0.042796 Aug 29 10:34:14.048721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 20/44] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:13 2022] DELETE /compute/v2.1/flavors/964235894 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:14.061551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3eb7f3e0-adb5-49fa-a77b-ad01155861cf tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.098062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3eb7f3e0-adb5-49fa-a77b-ad01155861cf tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047959 Aug 29 10:34:14.117191 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 21/45] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.126772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:14.138364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f6c5357-57f9-4346-a815-69e90a050eba tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1914856917", "id": 538168857, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:14.140574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2e5cc075-20cd-4bfc-87e6-70e5d43974f1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1234 microversion: 2.1 time: 0.243597 Aug 29 10:34:14.151363 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 25/46] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:13 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1234 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.186111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f6c5357-57f9-4346-a815-69e90a050eba tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.065860 Aug 29 10:34:14.189433 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 22/47] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:14 2022] POST /compute/v2.1/flavors => generated 427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:14.205913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6e27258-0c76-4bad-ba1b-6f2a1c0e319d tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "538168857"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:14.228348 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d6e27258-0c76-4bad-ba1b-6f2a1c0e319d tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] HTTP exception thrown: Flavor 538168857 could not be found. Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6e27258-0c76-4bad-ba1b-6f2a1c0e319d tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Request method failure captured: Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 106 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYe6_jxVpZWYtQIiOikyaIGJtf5BZjTtAz6j4lXJuAZWHFyu2Lo6GADAVqymjGkJ5ZQbAuJZBkz7iTDGhT_Zc5R-wfXBBzH4tbbrpxkU7n7O31pxxtf4HvKf-bVZQMlTJhQpnsn2H27aJG0WYIDpr6Vhmeqib5-R1VNy_CSovHJWDU Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 95661c0bfd0a478cbe8946b575b5f541 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsAdminTestJSON-1707028170 Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:14.232636 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/95661c0bfd0a478cbe8946b575b5f541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_95661c0bfd0a478cbe8946b575b5f541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/95661c0bfd0a478cbe8946b575b5f541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/95661c0bfd0a478cbe8946b575b5f541"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsAdminTestJSON-1707028170 Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 95661c0bfd0a478cbe8946b575b5f541 Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1707028170 Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsAdminTestJSON-1707028170-project Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 0955f6d4fba54991bdf10a50e54b3668 Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsAdminTestJSON-1707028170-project Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "test", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "538168857"}} Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:14.233782 n-d-854121-10 devstack@n-api.service[128682]: exception: Flavor 538168857 could not be found. Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '538168857'}}} Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 538168857 could not be found. Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:14.234456 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 538168857 could not be found. Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:14.235461 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:14.237572 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:14.237572 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:14.237572 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:14.237572 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 538168857 could not be found. Aug 29 10:34:14.237572 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:14.239081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6e27258-0c76-4bad-ba1b-6f2a1c0e319d tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Returning 400 to user: Flavor 538168857 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:14.241137 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d6e27258-0c76-4bad-ba1b-6f2a1c0e319d tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.039547 Aug 29 10:34:14.242285 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 26/48] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:14 2022] POST /compute/v2.1/servers => generated 80 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:34:14.250705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3308b50a-ae0f-4498-91e2-6581acee8e86 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.273036 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3308b50a-ae0f-4498-91e2-6581acee8e86 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/538168857" status: 202 len: 0 microversion: 2.1 time: 0.026485 Aug 29 10:34:14.274297 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 23/49] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:14 2022] DELETE /compute/v2.1/flavors/538168857 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:14.283115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4fa092c8-1455-4227-976f-e36cdd20be7f tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.312741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4fa092c8-1455-4227-976f-e36cdd20be7f tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034254 Aug 29 10:34:14.313843 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 27/50] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:14.339361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5c5d953d-012d-4d76-bba1-14df3941f21d tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1532501241", "id": 67534211, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:14.379012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5c5d953d-012d-4d76-bba1-14df3941f21d tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.047049 Aug 29 10:34:14.379611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 24/51] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:14.394359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab4aef0a-954f-44ce-903b-b366cae3fa2a tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-989197178", "id": 1226015422, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:14.443969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab4aef0a-954f-44ce-903b-b366cae3fa2a tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.055724 Aug 29 10:34:14.455821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5b1e06a-c468-45c8-81c3-cb2f74ddfacf tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.461620 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 28/52] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:14.483260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5b1e06a-c468-45c8-81c3-cb2f74ddfacf tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 412 microversion: 2.1 time: 0.030986 Aug 29 10:34:14.497594 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 25/53] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 412 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:14.503613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b3a3dac-955c-4a48-b17f-d17aec513719 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.522740 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b3a3dac-955c-4a48-b17f-d17aec513719 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 412 microversion: 2.1 time: 0.022805 Aug 29 10:34:14.530964 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 29/54] 10.222.0.47 () {58 vars in 1177 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 412 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:14.537113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84ef20e9-d587-4a55-a16e-d304824606df tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.559252 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84ef20e9-d587-4a55-a16e-d304824606df tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 412 microversion: 2.1 time: 0.027184 Aug 29 10:34:14.559828 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 26/55] 10.222.0.47 () {58 vars in 1171 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 412 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:14.572528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5545f53c-2475-47e5-b75e-c57971d79a45 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.585316 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5545f53c-2475-47e5-b75e-c57971d79a45 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 412 microversion: 2.1 time: 0.016795 Aug 29 10:34:14.585927 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 30/56] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 412 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:14.599113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f9edf5b-efa1-4e03-b59f-95d4d4d030f2 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.655004 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7f9edf5b-efa1-4e03-b59f-95d4d4d030f2 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.060126 Aug 29 10:34:14.655523 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 27/57] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.675409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-163c2bac-6d8f-4f05-84c9-11198f3fd008 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.720393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-163c2bac-6d8f-4f05-84c9-11198f3fd008 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.049133 Aug 29 10:34:14.725423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 31/58] 10.222.0.47 () {58 vars in 1175 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.744747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d36ebc99-c8c5-4fd7-91cc-5afbe8470cbd tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.772543 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d36ebc99-c8c5-4fd7-91cc-5afbe8470cbd tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.031333 Aug 29 10:34:14.787589 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 28/59] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.807980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f7c95f2-24f4-40c2-959e-080e47b441f6 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.836406 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f7c95f2-24f4-40c2-959e-080e47b441f6 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.044530 Aug 29 10:34:14.856704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.857769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:14.867288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 32/60] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:14.869974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:14.870861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:14.875684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:14.876700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:14.877520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:14.878177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:14.883523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b57df20-5320-459f-95e6-3d970afc6a23 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:14.929029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b57df20-5320-459f-95e6-3d970afc6a23 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1226015422" status: 202 len: 0 microversion: 2.1 time: 0.058650 Aug 29 10:34:14.932675 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 33/61] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:14 2022] DELETE /compute/v2.1/flavors/1226015422 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:14.944997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-94626b68-75a9-4295-8385-79dda7682e51 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.002063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-94626b68-75a9-4295-8385-79dda7682e51 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066080 Aug 29 10:34:15.008017 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 34/62] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.028569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a69103ab-5c6b-40e2-8204-9edb3561f1a7 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.065352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a69103ab-5c6b-40e2-8204-9edb3561f1a7 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/67534211" status: 202 len: 0 microversion: 2.1 time: 0.041487 Aug 29 10:34:15.067165 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 35/63] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:34:15 2022] DELETE /compute/v2.1/flavors/67534211 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:15.078751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3776e4aa-a307-4cc8-bada-7c15a12cd9c1 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.116719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3776e4aa-a307-4cc8-bada-7c15a12cd9c1 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043653 Aug 29 10:34:15.119451 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 36/64] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:15.141529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a6595c4-af70-46dc-8fb2-fdc5fbcf56da tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1668165542", "id": 710314423, "os-flavor-access:is_public": "False"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:15.162410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:15.175341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a6595c4-af70-46dc-8fb2-fdc5fbcf56da tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.039807 Aug 29 10:34:15.180253 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 37/65] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:15 2022] POST /compute/v2.1/flavors => generated 412 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:15.185941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-811cc9b1-8243-4a23-96f9-e0523e8499f2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1277 microversion: 2.1 time: 0.332401 Aug 29 10:34:15.185941 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 29/66] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:14 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1277 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.200208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.202224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:15.203350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4c9f48f-5f61-4fc2-a95c-fe99397ee71a tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.210780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:15.211550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:15.212136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:15.213134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:15.213921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:15.214707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:15.216000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:15.253894 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4c9f48f-5f61-4fc2-a95c-fe99397ee71a tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051149 Aug 29 10:34:15.255629 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 30/67] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:15.274993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0239adad-e139-46d2-90da-7b8742ad093a tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.323401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0239adad-e139-46d2-90da-7b8742ad093a tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052974 Aug 29 10:34:15.324467 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 31/68] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.342388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-608bebfc-e1e0-45ff-af8a-428445cbc84d tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.364169 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-608bebfc-e1e0-45ff-af8a-428445cbc84d tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/710314423" status: 202 len: 0 microversion: 2.1 time: 0.026082 Aug 29 10:34:15.365646 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 32/69] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:15 2022] DELETE /compute/v2.1/flavors/710314423 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:34:15.376399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e80176f-293f-4975-95b0-e0178ed4ad3c tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.431883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e80176f-293f-4975-95b0-e0178ed4ad3c tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059687 Aug 29 10:34:15.441744 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 33/70] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.451956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:15.455116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94e87d77-1948-4f7d-b3ff-d346214a6d05 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-659975117", "id": 1563798209, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:15.462152 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ef0d6b5-b824-4c16-9b1d-efc9137609b2 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1296 microversion: 2.1 time: 0.280798 Aug 29 10:34:15.463353 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 38/71] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1296 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.499774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94e87d77-1948-4f7d-b3ff-d346214a6d05 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049667 Aug 29 10:34:15.502221 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 34/72] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:15 2022] POST /compute/v2.1/flavors => generated 413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:15.515583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5dba7deb-a557-4d7f-aea2-1244e38352cd tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.551253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5dba7deb-a557-4d7f-aea2-1244e38352cd tempest-FlavorsAdminTestJSON-1707028170 tempest-FlavorsAdminTestJSON-1707028170-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.039728 Aug 29 10:34:15.565929 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 39/73] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:15.577040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0b0cc59-b43b-4f39-aa0d-c029364b8d84 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.597966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0b0cc59-b43b-4f39-aa0d-c029364b8d84 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1563798209" status: 202 len: 0 microversion: 2.1 time: 0.028958 Aug 29 10:34:15.602991 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 35/74] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:15 2022] DELETE /compute/v2.1/flavors/1563798209 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:34:15.609292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c816ed1-47ae-4e05-b99f-777107373ab8 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:15.651177 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c816ed1-47ae-4e05-b99f-777107373ab8 tempest-FlavorsAdminTestJSON-1914076719 tempest-FlavorsAdminTestJSON-1914076719-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047085 Aug 29 10:34:15.653553 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 40/75] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:16.214504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:16.216035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:16.234782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:16.236394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:16.246182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:16.247303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:16.247992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:16.248641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:16.485267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:16.485864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:16.506278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:16.506814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:16.507276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:16.508026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:16.508530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:16.508961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:17.309256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:17.326039 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df2c04b5-bc78-4bd5-b892-db2450ce7981 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1296 microversion: 2.1 time: 0.836744 Aug 29 10:34:17.326899 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 41/76] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:16 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1296 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:17.486425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:17.498847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f006fae0-330d-45eb-a9eb-5d47998879b8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 1.293010 Aug 29 10:34:17.502024 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 36/77] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:16 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:18.299729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28520199-d8f5-4a4a-bc91-f582b9a5724e tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1647391701", "id": 1894338303, "os-flavor-access:is_public": "False"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:18.346247 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28520199-d8f5-4a4a-bc91-f582b9a5724e tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.920140 Aug 29 10:34:18.347046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 42/78] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:17 2022] POST /compute/v2.1/flavors => generated 431 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:18.370041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:18.372777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:18.400588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:18.401157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:18.404078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:18.404940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:18.405473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:18.405978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:18.489968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac6edd2b-dbe3-43ac-b02d-08b349e1820a tempest-InstanceUsageAuditLogTestJSON-1709497890 tempest-InstanceUsageAuditLogTestJSON-1709497890-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:18.551026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac6edd2b-dbe3-43ac-b02d-08b349e1820a tempest-InstanceUsageAuditLogTestJSON-1709497890 tempest-InstanceUsageAuditLogTestJSON-1709497890-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 10:34:17" status: 200 len: 318 microversion: 2.1 time: 0.951402 Aug 29 10:34:18.553508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 37/79] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:34:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2010%3A34%3A17 => generated 318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:18.570294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ad1f062-1992-4166-b3e6-8efd810d16a5 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9c47f3395f144c9fb23c3b5b785d08fe"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:18.659614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:18.672253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1cb9dac0-9b20-486f-b243-e5d299792320 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.312545 Aug 29 10:34:18.675108 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 43/80] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:18 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:18.680723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:18.681521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:18.689004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:18.690018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:18.690688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:18.691549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:18.692157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:18.693550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:19.085161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:19.100022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a781508-ca93-4ab6-9b82-655d8376a8ad tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.419739 Aug 29 10:34:19.116315 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 44/81] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:18 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:19.121410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80923fa9-b39c-4336-ac4d-3afd1b531642 tempest-InstanceUsageAuditLogTestJSON-1709497890 tempest-InstanceUsageAuditLogTestJSON-1709497890-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:19.177373 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80923fa9-b39c-4336-ac4d-3afd1b531642 tempest-InstanceUsageAuditLogTestJSON-1709497890 tempest-InstanceUsageAuditLogTestJSON-1709497890-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.057588 Aug 29 10:34:19.188303 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 45/82] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:34:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:19.345891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ad1f062-1992-4166-b3e6-8efd810d16a5 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1894338303/action" status: 200 len: 97 microversion: 2.1 time: 0.786436 Aug 29 10:34:19.349554 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 38/83] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:18 2022] POST /compute/v2.1/flavors/1894338303/action => generated 97 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:19.702930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:19.705050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:19.716516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:19.717268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:19.718577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:19.721974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:19.722573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:19.723231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:20.075079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0c8e691-3b86-4bb5-88af-df62f795c611 tempest-FlavorsAccessTestJSON-1696385620 tempest-FlavorsAccessTestJSON-1696385620-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:20.125274 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0c8e691-3b86-4bb5-88af-df62f795c611 tempest-FlavorsAccessTestJSON-1696385620 tempest-FlavorsAccessTestJSON-1696385620-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.767400 Aug 29 10:34:20.126600 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 46/84] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:19 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:20.136798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:20.138388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:20.154747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:20.157336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:20.158802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:20.161423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:20.162937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:20.165159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:20.530341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:20.539323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c94f9ea7-88cc-4fcb-b89e-cbb1f9a909ab tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.843454 Aug 29 10:34:20.559316 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 39/85] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:19 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:20.564545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd9c6fd5-17a3-4bb9-bdf7-a4354c08ba41 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9c47f3395f144c9fb23c3b5b785d08fe"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:20.702018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:20.717644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12f80ea9-eb07-4e52-b63d-e3e3189a3d0f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.584372 Aug 29 10:34:20.719748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 47/86] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:20 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:21.414810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9dcbe4-377d-4bcd-b0be-4545017af0ca", "tag": "d02e916b-0a31-4bcb-b132-5ee62cabe851"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:21.447159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.449333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.451051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.503522 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Creating event network-changed:d02e916b-0a31-4bcb-b132-5ee62cabe851 for instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca on n-h1-854121-10 Aug 29 10:34:21.505526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:34:21.506562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-881bda97-648a-4fe8-8360-2b1c58a6db1c req-92b29dd2-95e7-464c-b661-951f29c82f37 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:34:21.511463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.511956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.512398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.514775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.515270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.516353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.527720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.rpcapi [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 10:34:21.528630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] Releasing lock "compute-rpcapi-router" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:34:21.554190 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb3ed872-11f0-487f-8e17-b65d1a094abb None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.748968 Aug 29 10:34:21.556192 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 48/87] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:21.577492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:21.579293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:21.603232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.603745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.604196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.604927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.605387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.609280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.784899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd9c6fd5-17a3-4bb9-bdf7-a4354c08ba41 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1894338303/action" status: 200 len: 21 microversion: 2.1 time: 1.220873 Aug 29 10:34:21.789983 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 40/88] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:20 2022] POST /compute/v2.1/flavors/1894338303/action => generated 21 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:21.809987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:21.814177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:21.841582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.847888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.851562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:21.855024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:21.858357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:21.858997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:22.743891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:22.759040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-04d70fb5-639d-4ad1-b385-5e10a2737694 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 1.195592 Aug 29 10:34:22.763534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 49/89] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:21 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:22.780785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c92fccf-e66c-45d2-9373-e8888b1f5b2c tempest-FlavorsAccessTestJSON-1696385620 tempest-FlavorsAccessTestJSON-1696385620-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:22.836999 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c92fccf-e66c-45d2-9373-e8888b1f5b2c tempest-FlavorsAccessTestJSON-1696385620 tempest-FlavorsAccessTestJSON-1696385620-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070423 Aug 29 10:34:22.856901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 50/90] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:22.878689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:22.891192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf64702a-344f-4466-99b3-703535792583 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 1.099857 Aug 29 10:34:22.902496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 41/91] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:21 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:22.920433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c79486fe-b613-4745-a684-5aecf7b39dc5 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:22.969222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c79486fe-b613-4745-a684-5aecf7b39dc5 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1894338303" status: 202 len: 0 microversion: 2.1 time: 0.061479 Aug 29 10:34:22.973999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 42/92] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:22 2022] DELETE /compute/v2.1/flavors/1894338303 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:22.980567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-88ddd49f-2aeb-4960-97bd-f8f276805a68 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.040532 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-88ddd49f-2aeb-4960-97bd-f8f276805a68 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060463 Aug 29 10:34:23.056566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 43/93] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:23.069435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a80444d1-a202-4c12-9344-26f6a1eefb2f tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2144638833", "id": 1822006844, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:23.134563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a80444d1-a202-4c12-9344-26f6a1eefb2f tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.076706 Aug 29 10:34:23.144457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 44/94] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:23 2022] POST /compute/v2.1/flavors => generated 431 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:23.159079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a47f2b4b-aeb8-4561-a0db-50ff171702cf tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.171579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:23.198564 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a47f2b4b-aeb8-4561-a0db-50ff171702cf tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/1822006844/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.046064 Aug 29 10:34:23.199547 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 45/95] 10.222.0.47 () {58 vars in 1209 bytes} [Mon Aug 29 10:34:23 2022] GET /compute/v2.1/flavors/1822006844/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:23.215836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f49f384e-d5fb-46d9-9b8f-b3e5acb525ac tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.259240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f49f384e-d5fb-46d9-9b8f-b3e5acb525ac tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1822006844" status: 202 len: 0 microversion: 2.1 time: 0.053204 Aug 29 10:34:23.259878 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 46/96] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:23 2022] DELETE /compute/v2.1/flavors/1822006844 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:23.270023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d80157e-c4dc-467e-9381-282ad9142606 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.338910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d80157e-c4dc-467e-9381-282ad9142606 tempest-FlavorsAccessTestJSON-458167739 tempest-FlavorsAccessTestJSON-458167739-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071748 Aug 29 10:34:23.353668 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 47/97] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:23.488518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7886462-e99c-44ec-83ad-b20fb636c20f", "tag": "4acef93e-5143-4bb1-af85-79f2d603955c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:23.555282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:23.555797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:23.556474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:23.595477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] Creating event network-changed:4acef93e-5143-4bb1-af85-79f2d603955c for instance c7886462-e99c-44ec-83ad-b20fb636c20f on n-h2-854121-10 Aug 29 10:34:23.607052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8a1b6bd3-feec-4fed-accc-4e93814f1a94 req-3364199a-6c17-4c52-b8f0-f962bfbb25d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.748171 Aug 29 10:34:23.609735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 51/98] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:23.787738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.789938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:23.811122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:23.813116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:23.819924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:23.822677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:23.823284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:23.823880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:23.931429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:23.938942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:23.961130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:23.972577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:23.992568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:23.994947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:23.995898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:23.997592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:24.139849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:24.155962 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-81fd5d61-7bdc-4c89-9afb-f55b9a2953c9 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.370816 Aug 29 10:34:24.157324 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:23 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:24.744583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:24.765334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c3ea21aa-3099-4c53-b5dc-1b41f3dd9ea8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.840252 Aug 29 10:34:24.778371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 52/100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:23 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:25.178164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:25.180897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:25.196068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:25.199139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:25.199879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:25.203080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:25.204455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:25.208885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:25.733335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:25.737756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a658c2b-bfa1-443b-bd8d-f1941a59e602 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1977381143", "id": 1279467048, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:25.746542 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eaf3cc42-017b-47c7-8bc9-86ed5a1f7c17 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.573588 Aug 29 10:34:25.749606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 53/101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:25 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:25.777586 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a658c2b-bfa1-443b-bd8d-f1941a59e602 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.822586 Aug 29 10:34:25.778622 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 49/102] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:34:24 2022] POST /compute/v2.1/flavors => generated 471 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:25.796667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdd26c48-5da7-4fb6-b675-f07c30efb6d3 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:25.801070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:25.802896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:25.810690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:25.811452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:25.812255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:25.814368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:25.823422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:25.824165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:26.134990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:26.149124 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-754d1657-0be3-4765-bdac-24fbf273653b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.356534 Aug 29 10:34:26.150442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 50/103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:25 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:26.313855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdd26c48-5da7-4fb6-b675-f07c30efb6d3 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1279467048/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.524332 Aug 29 10:34:26.320448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 54/104] 10.222.0.47 () {62 vars in 1265 bytes} [Mon Aug 29 10:34:25 2022] POST /compute/v2.1/flavors/1279467048/os-extra_specs => generated 62 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:26.326046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16577689-6016-4e24-85da-c7f169f245b6 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:26.378962 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16577689-6016-4e24-85da-c7f169f245b6 tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1279467048" status: 202 len: 0 microversion: 2.86 time: 0.057127 Aug 29 10:34:26.381351 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 51/105] 10.222.0.47 () {60 vars in 1202 bytes} [Mon Aug 29 10:34:26 2022] DELETE /compute/v2.1/flavors/1279467048 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:34:26.390523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-398a16d6-0329-4289-86c0-7540d8e53a5e tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:26.424788 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-398a16d6-0329-4289-86c0-7540d8e53a5e tempest-FlavorMetadataValidation-1009982151 tempest-FlavorMetadataValidation-1009982151-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.038770 Aug 29 10:34:26.454118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 55/106] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:34:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:34:26.775708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:26.776329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:26.801485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:26.807159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:26.807699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:26.817548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:26.820979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:26.827106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:27.172221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:27.173266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:27.186764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:27.190734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:27.192185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:27.199156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:27.200829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:27.201374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:27.327801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:27.347760 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be75a267-ca78-4253-b6d9-8d072c19a338 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.580984 Aug 29 10:34:27.353181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:26 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:27.633557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:27.647624 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65310efc-9c43-4b94-8ca1-35b85c448200 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.478570 Aug 29 10:34:27.648932 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 56/108] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:27 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:28.377035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:28.380251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:28.399794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:28.401685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:28.402633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:28.404556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:28.406777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:28.408684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:28.541259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:28.672830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:28.674529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:28.678913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:28.727022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:28.731826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:28.740875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:28.747208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:28.748739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:28.753068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:28.882813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:29.017164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:29.045964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-da3bb382-8ae3-4109-b0cd-95e3838b251d tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.672606 Aug 29 10:34:29.049187 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:28 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:29.157302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=18 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:29.245527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:29.256157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-07bd042c-e672-45c4-9124-1a61e97ba65b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.589019 Aug 29 10:34:29.257811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 57/110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:28 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:29.808762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7ddbca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:29.810639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:29.811029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:29.811490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:29.847452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:29.849633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:29.850504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:29.868717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:29.869555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:29.870428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:29.881090 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4010ef7c-1906-4dca-af48-87f7cb0ca9ba tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.826225 Aug 29 10:34:29.882446 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 54/111] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:29.894959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7deaca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:29.897551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:29.898559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:29.899233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:29.989457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.000093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.000726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.030552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.031334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.031913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.049903 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb7916de-d985-4916-957e-f9f076d844de tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.160029 Aug 29 10:34:30.051663 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 58/112] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:34:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:30.072951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.073388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7ca85e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.074279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:30.075307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.075789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.076223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.084037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.089807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.090895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.091857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.092519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.093189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.118391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.121195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.121852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.157802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.162034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.162691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.173833 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aede4b51-e2cb-4180-8a67-29ce35c09bed tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108145 Aug 29 10:34:30.184889 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 55/113] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:30.196388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7ca8040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.203583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.206126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.207758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.240273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.244705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.246006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.260057 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83c950df-f52a-4009-a577-afd1fd3302c8 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.072230 Aug 29 10:34:30.264537 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 56/114] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:30.286601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-536f874f-7595-4149-8de8-873691b857f6 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7ca88b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.295544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-536f874f-7595-4149-8de8-873691b857f6 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.296747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-536f874f-7595-4149-8de8-873691b857f6 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.302452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-536f874f-7595-4149-8de8-873691b857f6 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.343550 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-536f874f-7595-4149-8de8-873691b857f6 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.066044 Aug 29 10:34:30.349434 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1179 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:30.356603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.361237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:30.378904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.382600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.383306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.384247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.385968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.386846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.749299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:30.766466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28497f7b-4ac1-4b49-a753-02dba4ba6d80 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.692494 Aug 29 10:34:30.767330 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 59/116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:30.775230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7bd98b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.790383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.792569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.796035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.830823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.831555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.832346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.846043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.846767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.847393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.856074 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7a54b99-9441-4df5-ae9e-297cb74af287 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084339 Aug 29 10:34:30.857110 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 60/117] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:30.868345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7b660d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.875238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.878554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.882667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.927197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.927862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.928254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.945928 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-700dcb04-a415-44de-b7cb-87ec3430f994 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.082087 Aug 29 10:34:30.958406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 61/118] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:30.963220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7b66040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:30.967259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:30.968024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:30.968881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:30.991933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:31.006738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-396d1c00-3a89-42bd-85a9-366969ce124e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.655843 Aug 29 10:34:31.009064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.011134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.011966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.022066 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 58/119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:31.036642 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e74c4dba-a682-4f88-99f6-da133e01cd9c tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.074008 Aug 29 10:34:31.047345 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:30 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:31.053001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Calling method '.version_select at 0x7f66c7c2e1f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:31.055002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.055603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.056115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.079909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=16,nova_api:INSERT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:31.094266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.097602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.098748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.111587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:31.130500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.131249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.132257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.140916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:34:31.141501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a19c5abd-bba5-4cc1-91ad-1551fee15e84 tempest-HypervisorAdminTestJSON-1323104012 tempest-HypervisorAdminTestJSON-1323104012-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:34:31.143005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.143621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.144284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.145241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.146159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.146788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.156432 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.rpcapi [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 10:34:31.157630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] Releasing lock "compute-rpcapi-router" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:34:31.215965 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b475eb2-a90b-4905-9efe-ff5e15a96034 None None] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.163665 Aug 29 10:34:31.219130 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 59/121] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:34:31 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:31.792585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:31.801806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:31.819678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:31.826582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.828302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.830556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:31.832954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:31.833613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:31.837345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:32.029454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:32.030904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:32.053104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:32.054624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:32.055902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:32.059912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:32.063902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:32.069194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:32.233533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:32.252290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4584190e-e134-4b70-a496-d5d7839c27e0 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.463480 Aug 29 10:34:32.260230 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 63/122] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:31 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:32.518067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:32.533475 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7e705b3-eefa-434f-8428-b0c50a3b4a76 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.509280 Aug 29 10:34:32.560842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 60/123] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:32 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:33.008266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5347b328-dd81-4421-97a7-4bd35086cbd8 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Action: 'create', calling method: .version_select at 0x7f66c7bd9940>, body: {"keypair": {"name": "tempest-keypair-2076830957", "type": "ssh", "user_id": "6915a013a1294e68ab90dda7239c0ed5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZ2dE8drAXDqdSy/sYPKk7BFk/aobbjQKSC9FGKB2mIavxT7Q2MhWwHKgu6wqJ9tDDX2pDQgkhVAQ2lPRVulCuCKIq4WvIh7uuaFsfVCQ1NNEgCDB2bSnq1u/j++/y2vQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:33.190467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5347b328-dd81-4421-97a7-4bd35086cbd8 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:33.213481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5347b328-dd81-4421-97a7-4bd35086cbd8 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for user c045259d57e2413db7ae60e2767508d6 and project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:33.279566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:33.282285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:33.300880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:33.301931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:33.302931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:33.306032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:33.308527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:33.309305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:33.334961 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5347b328-dd81-4421-97a7-4bd35086cbd8 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.624361 Aug 29 10:34:33.344202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 64/124] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:34:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 634 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:34:33.372778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb31661e-fff7-4203-9880-ef1de70bd293 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Action: 'create', calling method: .version_select at 0x7f66c7bd9a60>, body: {"keypair": {"name": "tempest-keypair-2120328015", "type": "ssh", "user_id": "6915a013a1294e68ab90dda7239c0ed5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSqs57MJ7omIizOTSPx6Zo6PrMjq/JIbOflY6QkUJ/kKmNidsxa5ouMfdMRA/ZYFPsOvxeRbRhjmW6azE4bPmFn8aRa3e1MJdTazYEKZ7sZOcUpvj3NPh4dYGI1yXE+XQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:33.453756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eb31661e-fff7-4203-9880-ef1de70bd293 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:33.477624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eb31661e-fff7-4203-9880-ef1de70bd293 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for user c045259d57e2413db7ae60e2767508d6 and project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:33.545732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb31661e-fff7-4203-9880-ef1de70bd293 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.194681 Aug 29 10:34:33.547084 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 65/125] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:34:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:34:33.568114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:33.569458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:33.592603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:33.593169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:33.593472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:33.594212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:33.594662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:33.618711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:33.792519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:33.812835 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b775fbf-553b-492d-99e9-d37d66338b18 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.542978 Aug 29 10:34:33.814062 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 61/126] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:33 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:33.832021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c55598f4-46f3-4546-9148-19a3f1b3b5b3 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Calling method '.version_select at 0x7f66c7ca84c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:33.867658 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c55598f4-46f3-4546-9148-19a3f1b3b5b3 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-2076830957?user_id=6915a013a1294e68ab90dda7239c0ed5" status: 200 len: 512 microversion: 2.10 time: 0.048805 Aug 29 10:34:33.877310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 62/127] 10.222.0.47 () {60 vars in 1340 bytes} [Mon Aug 29 10:34:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2076830957?user_id=6915a013a1294e68ab90dda7239c0ed5 => generated 512 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:33.895720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7be5cb36-9f98-4ea7-b2ed-52ce99b609b9 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Action: 'create', calling method: .version_select at 0x7f66c7ca8040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-856844951", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1ZM2SclwcdzdCdwT4wM0/IzeGT7anUb/EMYESC9/N6/TOo8E80kjuVhndAs3U7TkTwNKXSJf7pUx5XJZwrC+7saGGxHL2vN1qH9yzxLfclI2JnqCNxBr4Ppjqh/nSgSg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:33.969509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7be5cb36-9f98-4ea7-b2ed-52ce99b609b9 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:33.985733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7be5cb36-9f98-4ea7-b2ed-52ce99b609b9 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Getting quotas for user c045259d57e2413db7ae60e2767508d6 and project d8172b25ad42472f82873dc2d3e2cc28. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:34.077570 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7be5cb36-9f98-4ea7-b2ed-52ce99b609b9 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.194680 Aug 29 10:34:34.078487 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 63/128] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:34:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:34:34.089923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8b3a1472-5b8d-4895-9a5c-f2d9696d43a6 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Calling method '.version_select at 0x7f66c7c45700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:34.098661 n-d-854121-10 devstack@n-api.service[128681]: WARNING oslo_db.sqlalchemy.utils [None req-8b3a1472-5b8d-4895-9a5c-f2d9696d43a6 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:34:34.113021 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8b3a1472-5b8d-4895-9a5c-f2d9696d43a6 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "GET /compute/v2.1/os-keypairs?user_id=6915a013a1294e68ab90dda7239c0ed5" status: 200 len: 726 microversion: 2.10 time: 0.027613 Aug 29 10:34:34.117741 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 64/129] 10.222.0.47 () {60 vars in 1259 bytes} [Mon Aug 29 10:34:34 2022] GET /compute/v2.1/os-keypairs?user_id=6915a013a1294e68ab90dda7239c0ed5 => generated 726 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:34.126797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:34.134352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c45bfc0a-faca-4daf-b16b-3ddbcd782f59 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Calling method '.version_select at 0x7f66c7bb95e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:34.139696 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6ede612-e227-47ff-abfb-a45e6597e7ba tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.584353 Aug 29 10:34:34.145445 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 66/130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:33 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:34.167362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c45bfc0a-faca-4daf-b16b-3ddbcd782f59 tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-856844951" status: 204 len: 0 microversion: 2.10 time: 0.037767 Aug 29 10:34:34.168817 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 65/131] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Aug 29 10:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-856844951 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:34:34.181984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0873dbd-b278-435c-a162-911ab6ae0bdd tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Calling method '.version_select at 0x7f66c7d01ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:34.213595 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0873dbd-b278-435c-a162-911ab6ae0bdd tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120328015?user_id=6915a013a1294e68ab90dda7239c0ed5" status: 204 len: 0 microversion: 2.10 time: 0.037525 Aug 29 10:34:34.218659 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 67/132] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120328015?user_id=6915a013a1294e68ab90dda7239c0ed5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:34:34.229495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90db1dd8-1870-43a0-b514-09d9b0f4b98b tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] Calling method '.version_select at 0x7f66c7bb9a60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:34.266714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90db1dd8-1870-43a0-b514-09d9b0f4b98b tempest-KeyPairsV210TestJSON-110130460 tempest-KeyPairsV210TestJSON-110130460-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076830957?user_id=6915a013a1294e68ab90dda7239c0ed5" status: 204 len: 0 microversion: 2.10 time: 0.044314 Aug 29 10:34:34.272858 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 66/133] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076830957?user_id=6915a013a1294e68ab90dda7239c0ed5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:34:34.838970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:34.839837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:34.856865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:34.857448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:34.858080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:34.858943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:34.859397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:34.859819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:35.165576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:35.166291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:35.182818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:35.184023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:35.184786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:35.188656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:35.193186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:35.196892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:35.197341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:35.203896 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3bcd2bf-4475-4925-bf7a-1b735c855403 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.368734 Aug 29 10:34:35.221656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 68/134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:34 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:35.519386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:35.532380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-106d55fa-9380-48eb-85f9-7a497c1cd5e7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.371850 Aug 29 10:34:35.534416 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 67/135] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:35 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:36.230421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:36.232907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:36.250368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:36.251060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:36.251852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:36.252626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:36.253240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:36.253841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:36.427120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:36.440168 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-320657f3-0a2d-4178-9f13-4456362a3501 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.214166 Aug 29 10:34:36.442617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 69/136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:36 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:36.556306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:36.557686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:36.575129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:36.576837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:36.577187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:36.579386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:36.579852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:36.582687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:36.840677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:36.853157 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9f173968-7d6f-4a4a-886a-12457ab4c4b7 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.304515 Aug 29 10:34:36.853683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 68/137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:36 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:37.773178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01b3bbb7-f6e2-4f8c-95c2-224e90b7aed0 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-657292289", "id": 1228086068, "os-flavor-access:is_public": "False"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:37.804754 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01b3bbb7-f6e2-4f8c-95c2-224e90b7aed0 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.628855 Aug 29 10:34:37.808199 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 70/138] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:37 2022] POST /compute/v2.1/flavors => generated 438 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:37.824003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-101d14dd-bdb9-4296-a9a0-3bc01fe8b68d tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1247031376", "ram": 512, "vcpus": 1, "disk": 10, "id": 270652877, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:37.836430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:37.838580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:37.846526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:37.847423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:37.848058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:37.848935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:37.849558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:37.850339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:37.858866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-101d14dd-bdb9-4296-a9a0-3bc01fe8b68d tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.443959 Aug 29 10:34:37.862557 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 69/139] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:37.869855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc535d26-7f68-4641-8fd4-808904cab927 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.081811 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc535d26-7f68-4641-8fd4-808904cab927 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1228086068/action" status: 200 len: 97 microversion: 2.1 time: 0.216736 Aug 29 10:34:38.088172 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 70/140] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:37 2022] POST /compute/v2.1/flavors/1228086068/action => generated 97 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:38.096773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:38.100279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:38.116918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:38.119782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:38.122177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:38.123696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:38.124786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:38.126778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:38.166025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:38.178279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1bc4a3e-2fac-4a89-8e2c-ee86e9e3a4cb tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.367946 Aug 29 10:34:38.178862 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 71/141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:37 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:38.359833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:38.370397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20da6b3d-fdd1-45ad-bc93-63ce4801152b tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.284458 Aug 29 10:34:38.372006 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 71/142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:38 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:38.378608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cd0a9121-1e3f-47ef-856e-d19b6909809b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.583382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99625b05-8c56-4e81-9d7b-e47718d79549 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:38.607548 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-99625b05-8c56-4e81-9d7b-e47718d79549 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] HTTP exception thrown: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99625b05-8c56-4e81-9d7b-e47718d79549 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Request method failure captured: Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY7TmPT7Da5-JL4Hz9oCsnxx7uZ5x2cxQ4Eb3Rq20PnRHYJgDdmPGYLdV5GVNocIwMCG-oLJTIe_K_fjfCaR2y2Izg2Aay6Qi9OVQiAc5AwZk5kQkNn3U_SQUaM05_xLxHF06m5mzIKPYMhHbC21dP2jk-WMhkT7IX-kHwubTDVbmo Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:38.611148 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e978719b4343487b89798b19916e1b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e978719b4343487b89798b19916e1b17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a4611152b20c48f8a42fc209e286c684 Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.612491 n-d-854121-10 devstack@n-api.service[128682]: exception: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:cpu_thread_policy'} Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.613317 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.615354 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.616977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99625b05-8c56-4e81-9d7b-e47718d79549 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Returning 404 to user: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.618344 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99625b05-8c56-4e81-9d7b-e47718d79549 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] 10.222.0.47 "GET /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.426395 Aug 29 10:34:38.619439 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:34:38 2022] GET /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:38.646081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f418e701-077b-412d-8e39-a5339742e33d tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.655672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f418e701-077b-412d-8e39-a5339742e33d tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a4611152b20c48f8a42fc209e286c684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e978719b4343487b89798b19916e1b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f418e701-077b-412d-8e39-a5339742e33d tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Request method failure captured: Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/flavors/270652877/os-extra_specs HTTP/1.1 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 66 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY7TmPT7Da5-JL4Hz9oCsnxx7uZ5x2cxQ4Eb3Rq20PnRHYJgDdmPGYLdV5GVNocIwMCG-oLJTIe_K_fjfCaR2y2Izg2Aay6Qi9OVQiAc5AwZk5kQkNn3U_SQUaM05_xLxHF06m5mzIKPYMhHbC21dP2jk-WMhkT7IX-kHwubTDVbmo Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:38.662952 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e978719b4343487b89798b19916e1b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e978719b4343487b89798b19916e1b17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a4611152b20c48f8a42fc209e286c684 Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 29 10:34:38.664310 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:38.664969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 10:34:38.668030 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.670799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f418e701-077b-412d-8e39-a5339742e33d tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.670799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f418e701-077b-412d-8e39-a5339742e33d tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] 10.222.0.47 "POST /compute/v2.1/flavors/270652877/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.040931 Aug 29 10:34:38.670799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 73/144] 10.222.0.47 () {60 vars in 1221 bytes} [Mon Aug 29 10:34:38 2022] POST /compute/v2.1/flavors/270652877/os-extra_specs => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:38.684839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-276d326b-a7b3-46d6-a717-848e4978403c tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.736881 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-276d326b-a7b3-46d6-a717-848e4978403c tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/270652877/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060896 Aug 29 10:34:38.737245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 74/145] 10.222.0.47 () {60 vars in 1221 bytes} [Mon Aug 29 10:34:38 2022] POST /compute/v2.1/flavors/270652877/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:34:38.747448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38b37ddf-b14b-4ad0-8108-07bce115d569 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:38.757228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38b37ddf-b14b-4ad0-8108-07bce115d569 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a4611152b20c48f8a42fc209e286c684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e978719b4343487b89798b19916e1b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38b37ddf-b14b-4ad0-8108-07bce115d569 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Request method failure captured: Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY7TmPT7Da5-JL4Hz9oCsnxx7uZ5x2cxQ4Eb3Rq20PnRHYJgDdmPGYLdV5GVNocIwMCG-oLJTIe_K_fjfCaR2y2Izg2Aay6Qi9OVQiAc5AwZk5kQkNn3U_SQUaM05_xLxHF06m5mzIKPYMhHbC21dP2jk-WMhkT7IX-kHwubTDVbmo Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:38.764849 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e978719b4343487b89798b19916e1b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e978719b4343487b89798b19916e1b17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a4611152b20c48f8a42fc209e286c684 Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.766148 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:numa_nodes'} Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:38.766737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 10:34:38.767754 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.770814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38b37ddf-b14b-4ad0-8108-07bce115d569 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.774797 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38b37ddf-b14b-4ad0-8108-07bce115d569 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] 10.222.0.47 "DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030850 Aug 29 10:34:38.776046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 75/146] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:34:38 2022] DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:38.789273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2c9485c3-5c9d-4fa8-ad37-c0098f2c7e08 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.844128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2c9485c3-5c9d-4fa8-ad37-c0098f2c7e08 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/270652877/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061596 Aug 29 10:34:38.850231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 76/147] 10.222.0.47 () {60 vars in 1221 bytes} [Mon Aug 29 10:34:38 2022] POST /compute/v2.1/flavors/270652877/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:38.855180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bdaf84a-b320-4a6e-8154-b513b3d0d7c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.864204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9bdaf84a-b320-4a6e-8154-b513b3d0d7c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a4611152b20c48f8a42fc209e286c684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e978719b4343487b89798b19916e1b17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bdaf84a-b320-4a6e-8154-b513b3d0d7c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Request method failure captured: Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 22 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY7TmPT7Da5-JL4Hz9oCsnxx7uZ5x2cxQ4Eb3Rq20PnRHYJgDdmPGYLdV5GVNocIwMCG-oLJTIe_K_fjfCaR2y2Izg2Aay6Qi9OVQiAc5AwZk5kQkNn3U_SQUaM05_xLxHF06m5mzIKPYMhHbC21dP2jk-WMhkT7IX-kHwubTDVbmo Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:38.868795 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e978719b4343487b89798b19916e1b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e978719b4343487b89798b19916e1b17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e978719b4343487b89798b19916e1b17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e978719b4343487b89798b19916e1b17 Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a4611152b20c48f8a42fc209e286c684 Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: {"hw:numa_nodes": "1"} Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.870363 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:38.871067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 10:34:38.872143 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.873149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bdaf84a-b320-4a6e-8154-b513b3d0d7c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.873149 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9bdaf84a-b320-4a6e-8154-b513b3d0d7c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963 tempest-FlavorsExtraSpecsNegativeTestJSON-1190958963-project] 10.222.0.47 "PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020973 Aug 29 10:34:38.873149 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 77/148] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:34:38 2022] PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:38.883141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcc6883b-5170-4b81-95ec-8e7764abe10a tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:38.906659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-fcc6883b-5170-4b81-95ec-8e7764abe10a tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] HTTP exception thrown: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcc6883b-5170-4b81-95ec-8e7764abe10a tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Request method failure captured: Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY9tYppMB-R7-C5RJgKdDnxwUwimMdHh4mruOP70qGIZqK1KKgEXJBOclQY4b_8BLouhKoxEFTEaPFyOSpTU5p4Tyb_zM8qwxnU_E2VA7zwoYdcel-CJLBCfygjmhpnRRzTzjZEc5TmIuPeOGtrPm_te4QO8Xaxe7UYlbwoZxFGshk Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:38.919625 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e05e086732e047df93b643ba77273579 Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.921046 n-d-854121-10 devstack@n-api.service[128682]: exception: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:cpu_thread_policy'} Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.921797 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. Aug 29 10:34:38.923149 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.925109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcc6883b-5170-4b81-95ec-8e7764abe10a tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Returning 404 to user: Flavor 270652877 has no extra specs with key hw:cpu_thread_policy. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.926525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fcc6883b-5170-4b81-95ec-8e7764abe10a tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.047435 Aug 29 10:34:38.934410 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 78/149] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:34:38 2022] DELETE /compute/v2.1/flavors/270652877/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:38.945102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f46c6ebc-adb2-499b-9538-344ba58f4ac8 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.951466 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-cd0a9121-1e3f-47ef-856e-d19b6909809b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. Aug 29 10:34:38.954401 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-f46c6ebc-adb2-499b-9538-344ba58f4ac8 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f46c6ebc-adb2-499b-9538-344ba58f4ac8 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Request method failure captured: Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 27 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY9tYppMB-R7-C5RJgKdDnxwUwimMdHh4mruOP70qGIZqK1KKgEXJBOclQY4b_8BLouhKoxEFTEaPFyOSpTU5p4Tyb_zM8qwxnU_E2VA7zwoYdcel-CJLBCfygjmhpnRRzTzjZEc5TmIuPeOGtrPm_te4QO8Xaxe7UYlbwoZxFGshk Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:38.955763 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e05e086732e047df93b643ba77273579 Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: {"hw:cpu_policy": "shared"} Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:38.956876 n-d-854121-10 devstack@n-api.service[128682]: exception: Request body and URI mismatch Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:38.958237 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f46c6ebc-adb2-499b-9538-344ba58f4ac8 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:38.959434 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f46c6ebc-adb2-499b-9538-344ba58f4ac8 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.021780 Aug 29 10:34:38.967777 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 79/150] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:34:38 2022] PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:34:38.983135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5652c009-b5c4-4c9f-9051-9caf8641d125 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cd0a9121-1e3f-47ef-856e-d19b6909809b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Request method failure captured: Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/flavors/1228086068/action HTTP/1.1 Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 67 Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJY7fIXfXb76RVn6WTQsJK_Cx5JwRRmrFIn5XFvDleAyRS31bmuuTwSn024oroYzaZ0NzlGJMch2cDZyjK2Uznwnw24DjSA3Osxqnzh-EcZG3aEpSnJF7ePjGWQcQ1-cguxJ4_srgqUmzsnORuipx8etK9HTpeEFC0890LtXBOkUtHY Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:38.986432 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d823d2c592140f99724b21716e16aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d823d2c592140f99724b21716e16aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e18d4f97f06e412fb99b994e82d3c8fb Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} Aug 29 10:34:38.987659 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: exception: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1228086068', 'body': {'addTenantAccess': {'tenant': '4fc3b174c28e4896b5e885e622378eef'}}} Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:34:38.989262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-4fc3b174c28e4896b5e885e622378eef' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 10:34:38.990777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 10:34:38.993776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:34:38.995715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-4fc3b174c28e4896b5e885e622378eef' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 10, 34, 38, 936783), 'updated_at': None, 'flavor_id': 29, 'project_id': '4fc3b174c28e4896b5e885e622378eef'}] Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:38.998721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:39.006222 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:39.008538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:39.010433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. Aug 29 10:34:39.010433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.010433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cd0a9121-1e3f-47ef-856e-d19b6909809b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 4fc3b174c28e4896b5e885e622378eef combination. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:39.010433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cd0a9121-1e3f-47ef-856e-d19b6909809b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1228086068/action" status: 409 len: 152 microversion: 2.1 time: 0.616998 Aug 29 10:34:39.010433 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 72/151] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:38 2022] POST /compute/v2.1/flavors/1228086068/action => generated 152 bytes in 618 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5652c009-b5c4-4c9f-9051-9caf8641d125 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Request method failure captured: Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 49 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJY9tYppMB-R7-C5RJgKdDnxwUwimMdHh4mruOP70qGIZqK1KKgEXJBOclQY4b_8BLouhKoxEFTEaPFyOSpTU5p4Tyb_zM8qwxnU_E2VA7zwoYdcel-CJLBCfygjmhpnRRzTzjZEc5TmIuPeOGtrPm_te4QO8Xaxe7UYlbwoZxFGshk Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:39.011079 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa4bfbf56146493586b58d177a7494d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: fa4bfbf56146493586b58d177a7494d5 Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e05e086732e047df93b643ba77273579 Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 29 10:34:39.013314 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'flavor_id': '270652877', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance: Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 29 10:34:39.014665 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.017046 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5652c009-b5c4-4c9f-9051-9caf8641d125 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:39.019341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5652c009-b5c4-4c9f-9051-9caf8641d125 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.037284 Aug 29 10:34:39.020435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-74f5edb9-803e-451f-8e56-27e176058811 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:39.020589 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 80/152] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:34:38 2022] PUT /compute/v2.1/flavors/270652877/os-extra_specs/hw:numa_nodes => generated 117 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:34:39.020589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a7716ca-7dac-43f9-baa5-9c185ea9bf67 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.059966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a7716ca-7dac-43f9-baa5-9c185ea9bf67 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/270652877" status: 202 len: 0 microversion: 2.1 time: 0.048045 Aug 29 10:34:39.060627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 81/153] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:39 2022] DELETE /compute/v2.1/flavors/270652877 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:39.074835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae8f4433-c925-4040-bdd3-fb70f3bbb2d0 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.124567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae8f4433-c925-4040-bdd3-fb70f3bbb2d0 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413 tempest-FlavorsExtraSpecsNegativeTestJSON-217332413-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059675 Aug 29 10:34:39.126916 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 82/154] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:39.204788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.205648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:39.219937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:39.221726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:39.224125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:39.225544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:39.226553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:39.227466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:39.632686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:39.654069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5122000a-4d13-4959-aff4-fbf41ba20009 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.441434 Aug 29 10:34:39.654964 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 83/155] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:39 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:39.660285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.660911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:39.686086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:39.686589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:39.687906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:39.688008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:39.688455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:39.689905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:39.788246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-74f5edb9-803e-451f-8e56-27e176058811 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1228086068/action" status: 200 len: 21 microversion: 2.1 time: 0.791018 Aug 29 10:34:39.796457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 73/156] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:38 2022] POST /compute/v2.1/flavors/1228086068/action => generated 21 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:39.808257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23716166-7e25-4fbd-8a76-6669a310fe3b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.864867 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23716166-7e25-4fbd-8a76-6669a310fe3b tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1228086068" status: 202 len: 0 microversion: 2.1 time: 0.066070 Aug 29 10:34:39.865643 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 74/157] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:39 2022] DELETE /compute/v2.1/flavors/1228086068 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:39.875362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9eae5bc5-838c-41ec-849a-99afd5c783ab tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:39.919339 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9eae5bc5-838c-41ec-849a-99afd5c783ab tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047840 Aug 29 10:34:39.921265 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 75/158] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:40.193081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Calling method '.version_select at 0x7f66c7926ee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:40.199496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.200292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.201339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.226195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.227191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.227744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.294107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.295319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.296186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.312963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.313934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.314583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.366098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.367908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.370275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.387825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a086e3ce-457a-4e87-a8b1-f0d32cd6b6e8 tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.451583 Aug 29 10:34:40.397859 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 76/159] 10.222.0.47 () {60 vars in 1243 bytes} [Mon Aug 29 10:34:39 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:34:40.411846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-228afdd1-1c33-495a-8e22-dc769ad72198 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1801220346", "id": 716885266, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:40.449794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-228afdd1-1c33-495a-8e22-dc769ad72198 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.046484 Aug 29 10:34:40.451162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 77/160] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:40 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:40.522228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:40.533277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8ee015b-9fb5-420c-8bab-aa734a191590 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.876984 Aug 29 10:34:40.547496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 84/161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:39 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:40.559687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Calling method '.version_select at 0x7f66c7b66ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:40.580093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.580856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.583450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.628174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.631332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.631818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.693316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7886462-e99c-44ec-83ad-b20fb636c20f", "name": "network-vif-plugged", "status": "completed", "tag": "4acef93e-5143-4bb1-af85-79f2d603955c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:40.702405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:40.718050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.718541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.719151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.733885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.738296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.740669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.758149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.758649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.759084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.776619 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] Creating event network-vif-plugged:4acef93e-5143-4bb1-af85-79f2d603955c for instance c7886462-e99c-44ec-83ad-b20fb636c20f on n-h2-854121-10 Aug 29 10:34:40.786517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-259d9f97-7aa0-4ddb-a40c-7152814738b1 req-fc04679e-ea57-4314-8af6-c28cfccc979f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332894 Aug 29 10:34:40.788190 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 78/162] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:40.792714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.793370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.793943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.798043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63aec120-8ce9-49f7-bcaa-e87d1cc3764c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:40.809439 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fdc8f9df-ad8c-4db5-91d5-9829706a1e7a tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.260514 Aug 29 10:34:40.810309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 85/163] 10.222.0.47 () {60 vars in 1222 bytes} [Mon Aug 29 10:34:40 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:40.810881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-63aec120-8ce9-49f7-bcaa-e87d1cc3764c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63aec120-8ce9-49f7-bcaa-e87d1cc3764c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Request method failure captured: Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/flavors/716885266/os-flavor-access HTTP/1.1 Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJY7fIXfXb76RVn6WTQsJK_Cx5JwRRmrFIn5XFvDleAyRS31bmuuTwSn024oroYzaZ0NzlGJMch2cDZyjK2Uznwnw24DjSA3Osxqnzh-EcZG3aEpSnJF7ePjGWQcQ1-cguxJ4_srgqUmzsnORuipx8etK9HTpeEFC0890LtXBOkUtHY Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:40.812710 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d823d2c592140f99724b21716e16aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d823d2c592140f99724b21716e16aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e18d4f97f06e412fb99b994e82d3c8fb Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: exception: Access list not available for public flavors. Aug 29 10:34:40.814169 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'flavor_id': '716885266'} Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 29 10:34:40.814879 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:40.815985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63aec120-8ce9-49f7-bcaa-e87d1cc3764c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:40.815985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63aec120-8ce9-49f7-bcaa-e87d1cc3764c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/716885266/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025071 Aug 29 10:34:40.818102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 79/164] 10.222.0.47 () {58 vars in 1206 bytes} [Mon Aug 29 10:34:40 2022] GET /compute/v2.1/flavors/716885266/os-flavor-access => generated 91 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:40.827283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:40.829577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:40.840537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.841018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.841445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.842483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:40.844640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:40.844640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:40.936703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5b05722-2d7a-4436-a922-e89d0057f7ca tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] Calling method '.version_select at 0x7f66c7926670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:41.155611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:41.566903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a5b05722-2d7a-4436-a922-e89d0057f7ca tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks" status: 200 len: 3329 microversion: 2.1 time: 0.746096 Aug 29 10:34:41.567958 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 80/165] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:34:40 2022] GET /compute/v2.1/os-networks => generated 3329 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:41.573468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Calling method '.version_select at 0x7f66c798bf70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:41.577368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:41.580701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:41.581411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:41.583103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:41.588839 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a5861da7-7458-4003-bc48-1801244318fe tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.769128 Aug 29 10:34:41.590843 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 86/166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:40 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:41.599248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65633ef8-0870-4f8b-8661-fb778f87210e tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:41.619080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:41.619963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:41.620418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:41.623700 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65633ef8-0870-4f8b-8661-fb778f87210e tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/716885266" status: 202 len: 0 microversion: 2.1 time: 0.031399 Aug 29 10:34:41.625354 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 87/167] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:34:41 2022] DELETE /compute/v2.1/flavors/716885266 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:41.632480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d703e0bb-a719-4f0c-bdc9-a46fd523ae0e tempest-HypervisorAdminV253TestBase-782798098 tempest-HypervisorAdminV253TestBase-782798098-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/8f68ab4a-2893-46ed-ae2e-f98f1347cdd2" status: 200 len: 794 microversion: 2.53 time: 0.063159 Aug 29 10:34:41.642765 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 81/168] 10.222.0.47 () {60 vars in 1298 bytes} [Mon Aug 29 10:34:41 2022] GET /compute/v2.1/os-hypervisors/8f68ab4a-2893-46ed-ae2e-f98f1347cdd2 => generated 794 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:41.642765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9e62f5f-b8bf-47b4-b111-34ea50c0d7e5 tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] Calling method '.version_select at 0x7f66c791e790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:41.650385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:41.651227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:41.663334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:41.664287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:41.665334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:41.666464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:41.667180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:41.667657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:42.133056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9e62f5f-b8bf-47b4-b111-34ea50c0d7e5 tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks/7b4815eb-0686-4480-b1c1-43f6f902729a" status: 200 len: 652 microversion: 2.1 time: 0.497929 Aug 29 10:34:42.146100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 82/169] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:34:41 2022] GET /compute/v2.1/os-networks/7b4815eb-0686-4480-b1c1-43f6f902729a => generated 652 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:42.156989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0b55846-dffa-4003-9c21-15ab99b2c3ee tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:42.189856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:42.201916 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95791d3b-e964-4e2a-86a6-8fa5bd031209 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.574278 Aug 29 10:34:42.202484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 88/170] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:41 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:42.207836 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0b55846-dffa-4003-9c21-15ab99b2c3ee tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055342 Aug 29 10:34:42.213260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36fc1ae4-3640-4bbc-b6d3-cb2a374f66e5 tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] Calling method '.version_select at 0x7f66c7bd93a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:42.222123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 83/171] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:42.231446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b10374b-b093-4d13-ac3d-6e755b4d3dd8 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1003045342", "id": 1508618746, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:42.278704 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b10374b-b093-4d13-ac3d-6e755b4d3dd8 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.050858 Aug 29 10:34:42.289622 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 84/172] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:42.477481 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36fc1ae4-3640-4bbc-b6d3-cb2a374f66e5 tempest-NetworksTest-1034656818 tempest-NetworksTest-1034656818-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks" status: 200 len: 3329 microversion: 2.1 time: 0.271799 Aug 29 10:34:42.482379 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 89/173] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:34:42 2022] GET /compute/v2.1/os-networks => generated 3329 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:42.610797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:42.611407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:42.621646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-befaaf0e-cda2-44d8-ac1c-3ab2d904eb4f tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:42.625971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-befaaf0e-cda2-44d8-ac1c-3ab2d904eb4f tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '718f40e10299441c933784d12db7d646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b174c28e4896b5e885e622378eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:42.629944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:42.630653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:42.631088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-befaaf0e-cda2-44d8-ac1c-3ab2d904eb4f tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Request method failure captured: Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/flavors/1508618746/action HTTP/1.1 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 67 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJY5ScRdVn7AjUR9ZKMm4vREVTcP9NfUtHq_rqpwRLUVWL3DrQ8Lwhxy9JKQgiFT3zIOMgQHI5o5yZ6LvZNsrG_2uHa39De1h1sMcxDkgbwDdKfgdvMUO7kkDAe1wgmZe59Z9qqq2ppwhOxNFE8hzqnNAXb5hwCzjGM7wvkPd_Ue5t0 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4fc3b174c28e4896b5e885e622378eef Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:42.632384 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4fc3b174c28e4896b5e885e622378eef Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsAccessNegativeTestJSON-338581572-project Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 718f40e10299441c933784d12db7d646 Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-338581572-project Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} Aug 29 10:34:42.633911 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1508618746', 'body': {'addTenantAccess': {'tenant': '4fc3b174c28e4896b5e885e622378eef'}}} Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:42.634849 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 10:34:42.636056 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:42.637283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:42.637716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:42.637966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:42.647982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-befaaf0e-cda2-44d8-ac1c-3ab2d904eb4f tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:42.653322 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-befaaf0e-cda2-44d8-ac1c-3ab2d904eb4f tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] 10.222.0.47 "POST /compute/v2.1/flavors/1508618746/action" status: 403 len: 130 microversion: 2.1 time: 0.361806 Aug 29 10:34:42.656977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 85/174] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:42 2022] POST /compute/v2.1/flavors/1508618746/action => generated 130 bytes in 366 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:42.682105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-556700ad-c1d5-454b-b387-8904d067712f tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:42.700708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:42.750151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-556700ad-c1d5-454b-b387-8904d067712f tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1508618746" status: 202 len: 0 microversion: 2.1 time: 0.088850 Aug 29 10:34:42.751194 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 86/175] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:42 2022] DELETE /compute/v2.1/flavors/1508618746 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:42.763886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65855b0e-8a10-49c5-9962-d03deb24b29d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:42.799101 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65855b0e-8a10-49c5-9962-d03deb24b29d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039546 Aug 29 10:34:42.800217 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 87/176] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:42.825102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2c388248-bcf0-4461-955c-dc074d8f8b44 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-449173038", "id": 1857268076, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:42.840896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:42.865453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2c388248-bcf0-4461-955c-dc074d8f8b44 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.046806 Aug 29 10:34:42.866844 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 88/177] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:42 2022] POST /compute/v2.1/flavors => generated 438 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:42.891748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c27c08de-1361-4bae-9fe9-4704b99d970a tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:43.032665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:43.047591 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dce98dc6-672f-4933-8040-dbf0a22a1f75 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1338 microversion: 2.1 time: 0.439308 Aug 29 10:34:43.061755 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 90/178] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:42 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:43.181518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9dcbe4-377d-4bcd-b0be-4545017af0ca", "name": "network-vif-plugged", "status": "completed", "tag": "d02e916b-0a31-4bcb-b132-5ee62cabe851"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:43.203996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:43.205470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:43.208561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:43.245372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] Creating event network-vif-plugged:d02e916b-0a31-4bcb-b132-5ee62cabe851 for instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca on n-h1-854121-10 Aug 29 10:34:43.258435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e4d95d93-129d-4f23-b96e-05eb4ec5238f req-156960cb-6d4e-4098-85cd-48373c916802 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082929 Aug 29 10:34:43.259207 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 91/179] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:43.267240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:43.268844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:43.283698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:43.284208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:43.286137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:43.288487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:43.298666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:43.301563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:43.501258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:43.921231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:43.932526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28039718-12fc-4734-a611-5fc4c479b07c tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 0.670883 Aug 29 10:34:43.933726 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 92/180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:43 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:44.040706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:44.073533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:44.074388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:44.093423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:44.095781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:44.096470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:44.099448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:44.103776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:44.104924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:44.159977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c27c08de-1361-4bae-9fe9-4704b99d970a tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1857268076/action" status: 200 len: 97 microversion: 2.1 time: 1.285206 Aug 29 10:34:44.160671 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 89/181] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:42 2022] POST /compute/v2.1/flavors/1857268076/action => generated 97 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:44.180485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eeef1c97-62f0-4bec-af7a-5a6247395559 tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:44.188724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eeef1c97-62f0-4bec-af7a-5a6247395559 tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '718f40e10299441c933784d12db7d646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b174c28e4896b5e885e622378eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eeef1c97-62f0-4bec-af7a-5a6247395559 tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Request method failure captured: Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/flavors/1857268076/action HTTP/1.1 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 70 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJY5ScRdVn7AjUR9ZKMm4vREVTcP9NfUtHq_rqpwRLUVWL3DrQ8Lwhxy9JKQgiFT3zIOMgQHI5o5yZ6LvZNsrG_2uHa39De1h1sMcxDkgbwDdKfgdvMUO7kkDAe1wgmZe59Z9qqq2ppwhOxNFE8hzqnNAXb5hwCzjGM7wvkPd_Ue5t0 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4fc3b174c28e4896b5e885e622378eef Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:44.191991 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4fc3b174c28e4896b5e885e622378eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4fc3b174c28e4896b5e885e622378eef Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-338581572 Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsAccessNegativeTestJSON-338581572-project Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 718f40e10299441c933784d12db7d646 Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-338581572-project Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: {"removeTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} Aug 29 10:34:44.193337 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1857268076', 'body': {'removeTenantAccess': {'tenant': '4fc3b174c28e4896b5e885e622378eef'}}} Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can( Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:44.194088 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 10:34:44.195196 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:44.197913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eeef1c97-62f0-4bec-af7a-5a6247395559 tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:44.199124 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eeef1c97-62f0-4bec-af7a-5a6247395559 tempest-FlavorsAccessNegativeTestJSON-338581572 tempest-FlavorsAccessNegativeTestJSON-338581572-project] 10.222.0.47 "POST /compute/v2.1/flavors/1857268076/action" status: 403 len: 133 microversion: 2.1 time: 0.032075 Aug 29 10:34:44.200384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 90/182] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:44 2022] POST /compute/v2.1/flavors/1857268076/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:34:44.219258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b41a8415-f842-4961-8f83-9204f9126b53 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4fc3b174c28e4896b5e885e622378eef"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:44.634168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b41a8415-f842-4961-8f83-9204f9126b53 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1857268076/action" status: 200 len: 21 microversion: 2.1 time: 0.428713 Aug 29 10:34:44.634968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 91/183] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:44 2022] POST /compute/v2.1/flavors/1857268076/action => generated 21 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:34:44.657423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3083db38-91d7-4c35-96fe-2728453af11d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:44.725269 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3083db38-91d7-4c35-96fe-2728453af11d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1857268076" status: 202 len: 0 microversion: 2.1 time: 0.076986 Aug 29 10:34:44.727169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 92/184] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:44 2022] DELETE /compute/v2.1/flavors/1857268076 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:44.758485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6ae7dfaf-e0e0-4f63-919d-e905870a5238 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:44.842650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6ae7dfaf-e0e0-4f63-919d-e905870a5238 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099304 Aug 29 10:34:44.843987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 93/185] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:44.878038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-000f6fbd-d439-4bc4-87a8-dbc26b1df424 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1342248042", "id": 1004691446, "os-flavor-access:is_public": "False"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:44.921836 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-000f6fbd-d439-4bc4-87a8-dbc26b1df424 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.053639 Aug 29 10:34:44.932207 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 94/186] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:44.945295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84221038-cb27-4af5-b2c7-d5da81fdce8c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dc37558633434dc3b4b12246d15c4e93"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:45.146406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:45.156632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95b9871b-ee83-432a-a2b3-3cead19261b1 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1488 microversion: 2.1 time: 1.088003 Aug 29 10:34:45.189152 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 93/187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:44 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1488 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:45.215499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:45.216339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:45.239352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:45.240174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:45.241496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:45.242440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:45.243122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:45.243780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:45.472478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-84221038-cb27-4af5-b2c7-d5da81fdce8c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] HTTP exception thrown: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84221038-cb27-4af5-b2c7-d5da81fdce8c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Request method failure captured: Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/flavors/1004691446/action HTTP/1.1 Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 70 Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJY7fIXfXb76RVn6WTQsJK_Cx5JwRRmrFIn5XFvDleAyRS31bmuuTwSn024oroYzaZ0NzlGJMch2cDZyjK2Uznwnw24DjSA3Osxqnzh-EcZG3aEpSnJF7ePjGWQcQ1-cguxJ4_srgqUmzsnORuipx8etK9HTpeEFC0890LtXBOkUtHY Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:45.481034 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d823d2c592140f99724b21716e16aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d823d2c592140f99724b21716e16aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d823d2c592140f99724b21716e16aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d823d2c592140f99724b21716e16aea Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-284261008 Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e18d4f97f06e412fb99b994e82d3c8fb Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: {"removeTenantAccess": {"tenant": "dc37558633434dc3b4b12246d15c4e93"}} Aug 29 10:34:45.482381 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: exception: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1004691446', 'body': {'removeTenantAccess': {'tenant': 'dc37558633434dc3b4b12246d15c4e93'}}} Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 29 10:34:45.483184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:45.484382 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:45.485664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84221038-cb27-4af5-b2c7-d5da81fdce8c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Returning 404 to user: Flavor access not found for 34 / dc37558633434dc3b4b12246d15c4e93 combination. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:45.490828 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84221038-cb27-4af5-b2c7-d5da81fdce8c tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1004691446/action" status: 404 len: 124 microversion: 2.1 time: 0.557436 Aug 29 10:34:45.495276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 95/188] 10.222.0.47 () {60 vars in 1200 bytes} [Mon Aug 29 10:34:44 2022] POST /compute/v2.1/flavors/1004691446/action => generated 124 bytes in 562 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:45.504359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:45.508309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:45.517659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:45.518515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:45.520085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:45.521400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:45.522075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:45.522975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:46.253506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:46.263687 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97959651-365f-41cb-a89e-30bd94103d27 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1319 microversion: 2.1 time: 1.072209 Aug 29 10:34:46.267424 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 94/189] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:45 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1319 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:46.275806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bacb345-fcbf-4e6f-b01f-2ef587f64094 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:46.333909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bacb345-fcbf-4e6f-b01f-2ef587f64094 tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1004691446" status: 202 len: 0 microversion: 2.1 time: 0.062052 Aug 29 10:34:46.335029 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 95/190] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:34:46 2022] DELETE /compute/v2.1/flavors/1004691446 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:46.344102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-655765da-d3ea-4ead-93eb-37a8d949f88d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:46.411602 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-655765da-d3ea-4ead-93eb-37a8d949f88d tempest-FlavorsAccessNegativeTestJSON-284261008 tempest-FlavorsAccessNegativeTestJSON-284261008-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072300 Aug 29 10:34:46.412194 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 96/191] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:46.967454 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a5bcca6-ea11-4374-8014-b87b0c3efa98 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1641 microversion: 2.1 time: 1.470500 Aug 29 10:34:46.995886 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 96/192] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:45 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1641 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:47.000663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:47.001181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:47.031974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.034377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.037979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:47.041467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.044513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.044972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:47.128293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:34:47.289979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:47.293138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:47.312322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.314910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.315496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:47.316177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.316643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.340488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:47.564198 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50b99ba5-a963-4a46-98ff-b93b87adfffd tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 204 len: 0 microversion: 2.1 time: 0.574592 Aug 29 10:34:47.567389 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 97/193] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:34:46 2022] DELETE /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:34:47.584945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:47.587393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:47.604307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.604307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.604711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:47.605957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:47.613792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:47.615417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.014429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:48.024301 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff115a97-0dfc-46dd-a7f4-10e85916593a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1469 microversion: 2.1 time: 0.740127 Aug 29 10:34:48.030219 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 97/194] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:47 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1469 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:48.122889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:48.145018 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87ad155b-e558-42ca-aa6f-f2d52dca2b21 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1494 microversion: 2.1 time: 0.571526 Aug 29 10:34:48.148935 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 98/195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:47 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1494 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:48.350654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Calling method '.version_select at 0x7f66c7b09e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.352692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.353378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.354030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.391598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.392840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.393553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.419102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.424453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.428091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.443716 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-63c986ed-99f6-4f5c-a8b6-1de888a842e3 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.206544 Aug 29 10:34:48.450994 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 99/196] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:48.472088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.473598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:48.490150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.490936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.491831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.492835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.493711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.494408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.560636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:34:48.686649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb277e78-4112-424f-abd3-fc8a702a74aa tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Calling method '.version_select at 0x7f66c7ab0280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.689277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb277e78-4112-424f-abd3-fc8a702a74aa tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '52a893f92de948ccbbf84fcb6d1914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2063b85b6a445b6b76f7d5fd8d76a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb277e78-4112-424f-abd3-fc8a702a74aa tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Request method failure captured: Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/n-h2-854121-10/search HTTP/1.1 Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZGUEod4itvW_4MXyDJoYwdtIVGTQt-_gW4iK7K4BETAHkLn10gUJcmEfXiEQyS5XHjbVpToF-f2lRJZ4PYn5x_VVoTpH75hCOMLha0CojE-69rZZX15jx3qTzwlyvkFiSl4jcDOdEfh29rZOqop8ceRcgBTHM2I7nrxonzsHbW47A Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f2063b85b6a445b6b76f7d5fd8d76a0a Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:48.708564 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f2063b85b6a445b6b76f7d5fd8d76a0a Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-671398065-project Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 52a893f92de948ccbbf84fcb6d1914ad Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065-project Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 10:34:48.709894 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'n-h2-854121-10'} Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:48.710575 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 10:34:48.711566 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.718159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb277e78-4112-424f-abd3-fc8a702a74aa tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:48.720865 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb277e78-4112-424f-abd3-fc8a702a74aa tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h2-854121-10/search" status: 403 len: 117 microversion: 2.1 time: 0.262482 Aug 29 10:34:48.722002 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 100/197] 10.222.0.47 () {58 vars in 1212 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors/n-h2-854121-10/search => generated 117 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:34:48.741414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Calling method '.version_select at 0x7f66c7b491f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.744587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.747273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.750011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.771727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Request method failure captured: Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZIaF_29_tkVZBCY9hNhtqS-sZcoULW4FmbMBp_dih9b1cGBsCwV7BdC7X_nKqEUTSsRTrQdWz_J31i-VciYPPKBRpFLEb36eqiAjRRwq_3jagYEvEVyTUYOcsip_dSUnrxbSP0oZ1t_xB93DyosYh-nbk8Feib3WtAwnrwvhsaeBk Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b228a0b31b3443c08c79e10eb5ab19e7 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:48.774058 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b228a0b31b3443c08c79e10eb5ab19e7 Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 55c7678880254f04a91512e652c4fc10 Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 10:34:48.776135 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.777489 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.779126 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.779126 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:48.779126 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:48.779126 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 10:34:48.779126 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.782080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:48.784047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f51430f5-461c-45d6-8366-cf6ef5563e61 tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.055067 Aug 29 10:34:48.790537 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 101/198] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:48.798086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Calling method '.version_select at 0x7f66c7bb2f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.800175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.801450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.802155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.841070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.842253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.842941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.860148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.862584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.866018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.888478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8a690b45-f764-46ce-b7ae-568003d0bd4f tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.095745 Aug 29 10:34:48.899637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 102/199] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:48.912003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1545316a-83cb-484f-a6aa-97c36aedf7b9 tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Calling method '.version_select at 0x7f66c7ade3a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.913633 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b23ce97-694d-42ec-9e34-0c80732b0f58 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 204 len: 0 microversion: 2.1 time: 0.864058 Aug 29 10:34:48.917033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1545316a-83cb-484f-a6aa-97c36aedf7b9 tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '52a893f92de948ccbbf84fcb6d1914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2063b85b6a445b6b76f7d5fd8d76a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:48.917239 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 98/200] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:34:48 2022] DELETE /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 0 bytes in 869 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1545316a-83cb-484f-a6aa-97c36aedf7b9 tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Request method failure captured: Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZGUEod4itvW_4MXyDJoYwdtIVGTQt-_gW4iK7K4BETAHkLn10gUJcmEfXiEQyS5XHjbVpToF-f2lRJZ4PYn5x_VVoTpH75hCOMLha0CojE-69rZZX15jx3qTzwlyvkFiSl4jcDOdEfh29rZOqop8ceRcgBTHM2I7nrxonzsHbW47A Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f2063b85b6a445b6b76f7d5fd8d76a0a Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:48.921003 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f2063b85b6a445b6b76f7d5fd8d76a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f2063b85b6a445b6b76f7d5fd8d76a0a Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065 Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-671398065-project Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 52a893f92de948ccbbf84fcb6d1914ad Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-671398065-project Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 10:34:48.922447 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '1'} Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:48.923240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 10:34:48.924462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:48.925748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.928330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1545316a-83cb-484f-a6aa-97c36aedf7b9 tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:48.929330 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1545316a-83cb-484f-a6aa-97c36aedf7b9 tempest-HypervisorAdminNegativeUnderV252Test-671398065 tempest-HypervisorAdminNegativeUnderV252Test-671398065-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.027902 Aug 29 10:34:48.931415 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 103/201] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:48.938408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:48.946753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Calling method '.version_select at 0x7f66c7a35f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:48.949899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.955950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.957302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.959695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.962869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.963473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:48.965956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:48.970811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:48.971462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:49.250616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] HTTP exception thrown: No hypervisor matching '4f7ff14f-d228-4c78-bd3d-5e273d7a2417' could be found. Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Request method failure captured: Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hypervisors/4f7ff14f-d228-4c78-bd3d-5e273d7a2417/servers HTTP/1.1 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZIaF_29_tkVZBCY9hNhtqS-sZcoULW4FmbMBp_dih9b1cGBsCwV7BdC7X_nKqEUTSsRTrQdWz_J31i-VciYPPKBRpFLEb36eqiAjRRwq_3jagYEvEVyTUYOcsip_dSUnrxbSP0oZ1t_xB93DyosYh-nbk8Feib3WtAwnrwvhsaeBk Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b228a0b31b3443c08c79e10eb5ab19e7 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:49.253081 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b228a0b31b3443c08c79e10eb5ab19e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b228a0b31b3443c08c79e10eb5ab19e7 Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326 Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 55c7678880254f04a91512e652c4fc10 Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: exception: No hypervisor matching '4f7ff14f-d228-4c78-bd3d-5e273d7a2417' could be found. Aug 29 10:34:49.255168 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '4f7ff14f-d228-4c78-bd3d-5e273d7a2417'} Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '4f7ff14f-d228-4c78-bd3d-5e273d7a2417' could be found. Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:49.255807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '4f7ff14f-d228-4c78-bd3d-5e273d7a2417' could be found. Aug 29 10:34:49.256897 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:49.257978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] Returning 404 to user: No hypervisor matching '4f7ff14f-d228-4c78-bd3d-5e273d7a2417' could be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:49.258998 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1cde7a9-599e-479e-858c-f2a8a188f84d tempest-HypervisorAdminNegativeUnderV252Test-286166326 tempest-HypervisorAdminNegativeUnderV252Test-286166326-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/4f7ff14f-d228-4c78-bd3d-5e273d7a2417/servers" status: 404 len: 123 microversion: 2.1 time: 0.321990 Aug 29 10:34:49.265212 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 104/202] 10.222.0.47 () {58 vars in 1281 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/os-hypervisors/4f7ff14f-d228-4c78-bd3d-5e273d7a2417/servers => generated 123 bytes in 328 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:49.272360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:49.273364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:49.280592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:49.281634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:49.282536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:49.285063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:49.285830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:49.286414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:49.887490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:49.899966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7358de61-78ea-4f32-b881-0ebd71a7f0ac tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1494 microversion: 2.1 time: 0.633173 Aug 29 10:34:49.908025 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 105/203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:49 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1494 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:50.051924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:50.064771 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1340436d-a0d7-4e50-b22a-5a9d3b29f427 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1475 microversion: 2.1 time: 1.143045 Aug 29 10:34:50.065402 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 99/204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:48 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1475 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:50.920496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:50.921199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:50.935404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:50.935909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:50.936356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:50.937108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:50.937564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:50.938032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:51.090356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:51.091689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:51.105954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b267f9b2c424539a7543043afdfcba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8ab73107804b3198e73b0b99e97f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:51.109840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:51.111505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:51.115928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:51.119046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:51.121618 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e81fa99e-b871-4087-a2e2-5d86e041f318 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 200 len: 1452 microversion: 2.1 time: 0.204967 Aug 29 10:34:51.122513 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 106/205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:50 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:51.137757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:51.140647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:51.162648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7886462-e99c-44ec-83ad-b20fb636c20f", "name": "network-vif-deleted", "tag": "4acef93e-5143-4bb1-af85-79f2d603955c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:51.203538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:51.204053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:51.210374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:51.261771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] Creating event network-vif-deleted:4acef93e-5143-4bb1-af85-79f2d603955c for instance c7886462-e99c-44ec-83ad-b20fb636c20f on n-h2-854121-10 Aug 29 10:34:51.287325 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f900acbf-7339-40f0-bb31-05e0cfcc8f6a req-97c59c2a-55d1-4e01-bfc3-2831237b53bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129088 Aug 29 10:34:51.291414 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 107/206] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:51.932044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:51.945270 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04693165-d960-49dc-8f93-2a0602511e52 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1475 microversion: 2.1 time: 0.859312 Aug 29 10:34:51.946227 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 100/207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:51 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:34:52.174000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:52.175432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:52.237565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:52.248617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:52.249080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:52.249860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:52.250324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:52.250757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:52.288371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] HTTP exception thrown: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Request method failure captured: Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f HTTP/1.1 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYekNNFll-5uFLZp-a33W8xt4DXog-zv8NWG0YDJsRNqL13FY5twz6EJwx9rALa_50NRMDSokdBUA7RFKGzlYLTlmKwDbnRnaRaZcTWgrTKOu0RBB1CsBBkdA_K_aHCmCzPY0l34M1HukhcuOUoo78uHiRmRfuzZR1ZLeqfxtpNFMw Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:34:52.298216 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b267f9b2c424539a7543043afdfcba7 Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:34:52.299393 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c7886462-e99c-44ec-83ad-b20fb636c20f'} Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:52.300037 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:34:52.303631 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:52.306087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Returning 404 to user: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:52.307436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4925a580-1d7d-46b1-897f-3c0dee90f385 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 404 len: 111 microversion: 2.1 time: 0.165358 Aug 29 10:34:52.308571 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 108/208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:52 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:52.325926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-00f9a06b-594e-495d-bdba-ea4cb8a26210 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:52.355498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00f9a06b-594e-495d-bdba-ea4cb8a26210 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:52.359941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00f9a06b-594e-495d-bdba-ea4cb8a26210 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:52.360437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00f9a06b-594e-495d-bdba-ea4cb8a26210 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:52.594339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94c37d09-8251-4133-86cc-1158d9d852ce tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c79261f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:53.692170 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94c37d09-8251-4133-86cc-1158d9d852ce tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e" status: 200 len: 371 microversion: 2.1 time: 1.414767 Aug 29 10:34:53.695135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 101/209] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:34:52 2022] GET /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e => generated 371 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:53.717634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9dcbe4-377d-4bcd-b0be-4545017af0ca", "name": "network-vif-deleted", "tag": "d02e916b-0a31-4bcb-b132-5ee62cabe851"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:53.767081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:53.772980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:53.773695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:53.814713 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] Creating event network-vif-deleted:d02e916b-0a31-4bcb-b132-5ee62cabe851 for instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca on n-h1-854121-10 Aug 29 10:34:53.824066 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8ef32d40-7c7a-4a38-a28d-e31825216239 req-8502621d-187d-4ff1-a63f-ba85edf798db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126880 Aug 29 10:34:53.829468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 102/210] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:53.862282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:53.866275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:53.877934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:53.879751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:53.880681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:53.881850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:53.882648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:53.887361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:53.930846 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-00f9a06b-594e-495d-bdba-ea4cb8a26210 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 1.607414 Aug 29 10:34:53.933926 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 109/211] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:53.944234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Action: 'update', calling method: .version_select at 0x7f66c7d014c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:54.001942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:54.068938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:54.071502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:54.074097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:54.074711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lazy-loading 'fault' on Instance uuid 3e9dcbe4-377d-4bcd-b0be-4545017af0ca {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:34:54.421032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:54.429559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48834e20-7b53-4889-b89f-917507f68ad2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 200 len: 1309 microversion: 2.1 time: 0.597766 Aug 29 10:34:54.436297 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 103/212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:53 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 1309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:54.463091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17bc725c-6e62-4d69-b93c-b06ba60f012b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:54.643740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:54.645112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:54.645563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:54.646402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:54.646857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:54.647287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:54.760551 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17bc725c-6e62-4d69-b93c-b06ba60f012b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.309273 Aug 29 10:34:54.765278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 104/213] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:54 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:34:54.784000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54febc68-c554-4c8c-9523-d3945dd69bc8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496095137"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:54.789116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-54febc68-c554-4c8c-9523-d3945dd69bc8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid b359a717-c988-4043-959f-def34d173ddb for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:54.796852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b63628d-f0b2-417e-9f7a-96dd3f48844f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e" status: 200 len: 328 microversion: 2.1 time: 0.861380 Aug 29 10:34:54.805229 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 110/214] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:34:53 2022] PUT /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e => generated 328 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:54.811298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f855d71-2954-4dbf-b325-85695e5e560f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:54.836520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f855d71-2954-4dbf-b325-85695e5e560f tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e" status: 202 len: 0 microversion: 2.1 time: 0.030072 Aug 29 10:34:54.837115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 111/215] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:34:54 2022] DELETE /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:34:54.845347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d52428d9-358f-4ded-bc5c-501acfe37a5d tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c78daee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:54.848917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54febc68-c554-4c8c-9523-d3945dd69bc8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070720 Aug 29 10:34:54.849875 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 105/216] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:34:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:54.869970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10038904-129f-48a9-a2a8-a3bbff225c79 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:54.885082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10038904-129f-48a9-a2a8-a3bbff225c79 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:54.886323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10038904-129f-48a9-a2a8-a3bbff225c79 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:54.887020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10038904-129f-48a9-a2a8-a3bbff225c79 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:55.064884 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d52428d9-358f-4ded-bc5c-501acfe37a5d tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e" status: 200 len: 371 microversion: 2.1 time: 0.223153 Aug 29 10:34:55.066827 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 112/217] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:34:54 2022] GET /compute/v2.1/os-quota-sets/37ed30d845cc444aabca6a6c8605604e => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:55.120385 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10038904-129f-48a9-a2a8-a3bbff225c79 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.263601 Aug 29 10:34:55.121025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 106/218] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:55.133395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d08304ca-7006-490b-b898-e05923946dba tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:55.153419 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d08304ca-7006-490b-b898-e05923946dba tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.023497 Aug 29 10:34:55.163365 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 113/219] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:34:55 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:55.175545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d4d4b25-15f0-4a2b-b516-b6ad00a52168 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:55.195375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d4d4b25-15f0-4a2b-b516-b6ad00a52168 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:55.195879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d4d4b25-15f0-4a2b-b516-b6ad00a52168 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:55.196328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d4d4b25-15f0-4a2b-b516-b6ad00a52168 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:55.360463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f72c5878-0035-4487-901c-72227e3e591c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c78d5820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:55.403390 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d4d4b25-15f0-4a2b-b516-b6ad00a52168 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.232071 Aug 29 10:34:55.412900 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 107/220] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:55 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:55.423641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7ec68f8-c527-40bd-81ea-58cda31d515f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:55.477599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7ec68f8-c527-40bd-81ea-58cda31d515f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057695 Aug 29 10:34:55.478294 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 108/221] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:55 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 10:34:55.500808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:55.504938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:55.515318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:55.534752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:55.536637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:55.541104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:55.542796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:55.543741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:55.565426 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca HTTP/1.1 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:34:55.571972 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:34:55.574617 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3e9dcbe4-377d-4bcd-b0be-4545017af0ca'} Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:55.576503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:34:55.580335 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:55.595237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:55.606002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-012eb80b-8979-4e11-86e9-a2554ddf4934 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 404 len: 111 microversion: 2.1 time: 0.125685 Aug 29 10:34:55.610963 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 109/222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:55 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:34:55.637788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a3a315f-345a-40c8-a08f-10a292e27102 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1172684712"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:55.643025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-4a3a315f-345a-40c8-a08f-10a292e27102 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Generated uuid 584fa4fc-5002-4d2a-8920-a8f81c64375a for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:55.694973 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a3a315f-345a-40c8-a08f-10a292e27102 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.081053 Aug 29 10:34:55.697315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 110/223] 10.222.0.47 () {62 vars in 1205 bytes} [Mon Aug 29 10:34:55 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:55.712666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b86d6936-09d3-4f95-bc3a-a8966f232927 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-239941398"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:55.797431 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f72c5878-0035-4487-901c-72227e3e591c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07/defaults" status: 200 len: 371 microversion: 2.1 time: 0.440326 Aug 29 10:34:55.799841 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 114/224] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:34:55 2022] GET /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07/defaults => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:55.848076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-446335044", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:55.886877 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b86d6936-09d3-4f95-bc3a-a8966f232927 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.181851 Aug 29 10:34:55.894945 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 111/225] 10.222.0.47 () {62 vars in 1210 bytes} [Mon Aug 29 10:34:55 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:55.901203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1012cb9-a1b1-4800-accd-474b8cb032ca tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:55.911649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:55.928028 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1012cb9-a1b1-4800-accd-474b8cb032ca tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.031680 Aug 29 10:34:55.928538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 112/226] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:34:55 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:55.955645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16fb3511-ae59-4ef1-b2d4-ac0806db2194 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:55.975391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:34:55.998670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb3511-ae59-4ef1-b2d4-ac0806db2194 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:55.999292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb3511-ae59-4ef1-b2d4-ac0806db2194 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:55.999806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb3511-ae59-4ef1-b2d4-ac0806db2194 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:56.250097 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16fb3511-ae59-4ef1-b2d4-ac0806db2194 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.311275 Aug 29 10:34:56.259173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 113/227] 10.222.0.47 () {62 vars in 1232 bytes} [Mon Aug 29 10:34:55 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:56.276257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c046d021-9468-4f37-a6af-1a865f7b8384 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:56.292726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c046d021-9468-4f37-a6af-1a865f7b8384 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:56.294050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c046d021-9468-4f37-a6af-1a865f7b8384 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:56.295037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c046d021-9468-4f37-a6af-1a865f7b8384 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:56.479957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c046d021-9468-4f37-a6af-1a865f7b8384 tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.218839 Aug 29 10:34:56.492533 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 114/228] 10.222.0.47 () {62 vars in 1232 bytes} [Mon Aug 29 10:34:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:34:56.509622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Action: 'update', calling method: .version_select at 0x7f66c76dc700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:56.556758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:34:56.557240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:34:56.558074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:34:56.558498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:34:56.558912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:34:56.586384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:56.588230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:56.589619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:56.592076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:56.593980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:56.598425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:56.626871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:56.654392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Getting quotas for project 27860db656e848829f1e4e46936c28d7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:34:56.673261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Getting quotas for user 4b022ffddbc349a196a26b77bfd62dfd and project 27860db656e848829f1e4e46936c28d7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:34:56.711205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:34:56.720872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:34:56.891694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fd59a072-4208-40b2-80e1-1e4aa2f3ce24 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045504 Aug 29 10:34:56.895086 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 115/229] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:34:56.928094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6fd73c2f-6a37-455a-b1ff-85ad463309fd tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:56.979166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6fd73c2f-6a37-455a-b1ff-85ad463309fd tempest-AggregatesAdminTestV241-808708488 tempest-AggregatesAdminTestV241-808708488-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.080147 Aug 29 10:34:56.982544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 116/230] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:34:56 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:57.008839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be30ad93-c8a5-4850-9fe0-b44ca962cdc8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:57.010674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be30ad93-c8a5-4850-9fe0-b44ca962cdc8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:57.143354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be30ad93-c8a5-4850-9fe0-b44ca962cdc8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:57.153260 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be30ad93-c8a5-4850-9fe0-b44ca962cdc8 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1219 microversion: 2.1 time: 0.161462 Aug 29 10:34:57.161079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 117/231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:56 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:57.170543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66765835-d1a9-49fa-a8e4-e96717778315 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-163181890"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:57.193307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-66765835-d1a9-49fa-a8e4-e96717778315 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 1deef0a6-02d2-4e1e-9c60-3489e11bd468 for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:57.270281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-66765835-d1a9-49fa-a8e4-e96717778315 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.103920 Aug 29 10:34:57.270910 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 118/232] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:34:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:57.295358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8f55ae0a-181c-41b2-90a0-9a90df18ba6e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:57.332168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f55ae0a-181c-41b2-90a0-9a90df18ba6e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:57.334605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f55ae0a-181c-41b2-90a0-9a90df18ba6e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:57.335263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f55ae0a-181c-41b2-90a0-9a90df18ba6e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:57.642040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8f55ae0a-181c-41b2-90a0-9a90df18ba6e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.360087 Aug 29 10:34:57.642968 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 119/233] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:34:57.653328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df7b8e41-34b4-462c-bd49-50021d890c0e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:57.712629 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df7b8e41-34b4-462c-bd49-50021d890c0e tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.062798 Aug 29 10:34:57.715105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:57.715627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:57.716907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:57.718569 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 120/234] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:34:57 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:57.719390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:57.726316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:57.726824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:57.730583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2a0340c-ecc8-4184-b51e-7d75c5129f21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:57.761880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2a0340c-ecc8-4184-b51e-7d75c5129f21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:57.762775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2a0340c-ecc8-4184-b51e-7d75c5129f21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:57.763428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2a0340c-ecc8-4184-b51e-7d75c5129f21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:58.058724 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a0769cc-6af8-47f0-aec2-955e0dcce518 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a" status: 200 len: 328 microversion: 2.1 time: 1.560487 Aug 29 10:34:58.067817 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 115/235] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:34:56 2022] PUT /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a => generated 328 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:58.075256 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2a0340c-ecc8-4184-b51e-7d75c5129f21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.346516 Aug 29 10:34:58.079607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c76dcd30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:58.091156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 121/236] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:58.126958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a37b7109-178f-4dd1-8062-6d67972dd426 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:58.211870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a37b7109-178f-4dd1-8062-6d67972dd426 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.112471 Aug 29 10:34:58.217268 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 122/237] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:58 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:34:58.244445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:58.245565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:58.262118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:58.263864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:58.273902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:58.275533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:58.277894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:58.278596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:58.545233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:58.561150 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5272c1cd-2f6f-483b-9ca5-f909cb8dd604 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1215 microversion: 2.1 time: 0.337284 Aug 29 10:34:58.562517 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 123/238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:58 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:58.571082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5383f7a-3b3b-42ed-9cbb-a3f0afbe4985 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-518254664"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:58.579563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-c5383f7a-3b3b-42ed-9cbb-a3f0afbe4985 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 2911d379-6fa5-430d-a69d-4138f701edf5 for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:58.625990 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5383f7a-3b3b-42ed-9cbb-a3f0afbe4985 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060795 Aug 29 10:34:58.628915 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 124/239] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:34:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:58.644976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba6dedb6-5919-401c-98e9-6a8f51927402 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:58.662202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6dedb6-5919-401c-98e9-6a8f51927402 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:58.663498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6dedb6-5919-401c-98e9-6a8f51927402 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:58.664099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6dedb6-5919-401c-98e9-6a8f51927402 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:58.668696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:34:58.952172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba6dedb6-5919-401c-98e9-6a8f51927402 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.313290 Aug 29 10:34:58.977167 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 125/240] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:58.984611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8916cd18-be0f-4a36-9ad2-cd8b59b16bcb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:59.008319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8916cd18-be0f-4a36-9ad2-cd8b59b16bcb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:59.009098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8916cd18-be0f-4a36-9ad2-cd8b59b16bcb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:59.013987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8916cd18-be0f-4a36-9ad2-cd8b59b16bcb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:59.211044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:59.211567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:59.212065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:59.216170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:59.216888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:59.217154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:59.251665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8916cd18-be0f-4a36-9ad2-cd8b59b16bcb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.270985 Aug 29 10:34:59.253232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 126/241] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:34:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:59.270774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1bf22fc-ad4f-4050-ad45-b575d3428960 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a/detail" status: 200 len: 916 microversion: 2.1 time: 1.196275 Aug 29 10:34:59.271678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 116/242] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:34:58 2022] GET /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a/detail => generated 916 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:59.279102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb827185-9481-4853-9a71-be01d6f04f85 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.326545 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb827185-9481-4853-9a71-be01d6f04f85 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059666 Aug 29 10:34:59.327555 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 127/243] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:59 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:34:59.338257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c2c9fee7-b80e-423b-b1f4-14454c10bb21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2015831736"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:59.342516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-c2c9fee7-b80e-423b-b1f4-14454c10bb21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 68e6aca9-0d87-4ce6-bea7-81d84751eed0 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:59.387965 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c2c9fee7-b80e-423b-b1f4-14454c10bb21 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053646 Aug 29 10:34:59.393758 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 117/244] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:34:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:59.404478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb1758e2-96db-4236-bc87-0c22a966821f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.456507 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb1758e2-96db-4236-bc87-0c22a966821f tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.055866 Aug 29 10:34:59.473138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc64b674-db2d-40bf-ad3c-2840c60de0ad tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.479042 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 128/245] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:34:59.489403 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-fc64b674-db2d-40bf-ad3c-2840c60de0ad tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc64b674-db2d-40bf-ad3c-2840c60de0ad tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Request method failure captured: Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYgTJMEKGHZd2Dcf_3AWQTgtks2DeB0P82sy2QQkWeoCtZcNxZQ_YdIiCXMNnfdAeTmWlraNCM3kKGVg7SgMiCic5IVcRZNAJsOkGy-HpFUck4RCxBfoIglomCFSj9PXvqzkf4N3ek_vtNyLcqg5eVZX0-QpUqnKB17vck0rUMAsSA Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:59.495392 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 51dc9086a46d4b17ac1965f05b3d5c08 Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate 6 could not be found. Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6'} Aug 29 10:34:59.497041 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.497986 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 29 10:34:59.499215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.516325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc64b674-db2d-40bf-ad3c-2840c60de0ad tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:59.523594 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc64b674-db2d-40bf-ad3c-2840c60de0ad tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.059343 Aug 29 10:34:59.525334 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 118/246] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:34:59 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:59.538298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d11a0893-05e4-4632-b218-1491cb5c01dd tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.575438 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d11a0893-05e4-4632-b218-1491cb5c01dd tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 29 10:34:59.591738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.592643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d11a0893-05e4-4632-b218-1491cb5c01dd tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Request method failure captured: Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYgTJMEKGHZd2Dcf_3AWQTgtks2DeB0P82sy2QQkWeoCtZcNxZQ_YdIiCXMNnfdAeTmWlraNCM3kKGVg7SgMiCic5IVcRZNAJsOkGy-HpFUck4RCxBfoIglomCFSj9PXvqzkf4N3ek_vtNyLcqg5eVZX0-QpUqnKB17vck0rUMAsSA Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:59.609347 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51dc9086a46d4b17ac1965f05b3d5c08 Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: exception: Aggregate 6 could not be found. Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6'} Aug 29 10:34:59.612231 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:59.614115 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.615668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.617113 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.617113 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:59.617113 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:59.617113 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 29 10:34:59.617113 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.619545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d11a0893-05e4-4632-b218-1491cb5c01dd tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:59.625957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:59.627457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:59.629524 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d11a0893-05e4-4632-b218-1491cb5c01dd tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.096800 Aug 29 10:34:59.633240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:59.634165 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 129/247] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:59.637438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:34:59.640278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:34:59.642914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:34:59.649145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6d0c230-4562-42d7-8a03-ca0a6e7b50ab tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-462594752", "name": "tempest-test_aggregate-583979746"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:34:59.702557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-b6d0c230-4562-42d7-8a03-ca0a6e7b50ab tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 333de2fc-9297-41ea-963b-22972cf5280a for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:34:59.784166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6d0c230-4562-42d7-8a03-ca0a6e7b50ab tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.144788 Aug 29 10:34:59.788007 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 130/248] 10.222.0.47 () {60 vars in 1165 bytes} [Mon Aug 29 10:34:59 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:34:59.798434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f133d9ee-5597-49d4-921d-4df4dcebdba3 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.857678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f133d9ee-5597-49d4-921d-4df4dcebdba3 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.062855 Aug 29 10:34:59.861667 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 131/249] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:34:59.885782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84e57e88-c060-4538-96af-22fd523de169 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.888664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:34:59.897905 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-84e57e88-c060-4538-96af-22fd523de169 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 29 10:34:59.899117 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1de8ef3e-5deb-4146-91be-b05c6257d8ea tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1277 microversion: 2.1 time: 0.312424 Aug 29 10:34:59.903628 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 119/250] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:34:59 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84e57e88-c060-4538-96af-22fd523de169 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Request method failure captured: Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYgTJMEKGHZd2Dcf_3AWQTgtks2DeB0P82sy2QQkWeoCtZcNxZQ_YdIiCXMNnfdAeTmWlraNCM3kKGVg7SgMiCic5IVcRZNAJsOkGy-HpFUck4RCxBfoIglomCFSj9PXvqzkf4N3ek_vtNyLcqg5eVZX0-QpUqnKB17vck0rUMAsSA Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:34:59.908121 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51dc9086a46d4b17ac1965f05b3d5c08 Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: exception: Aggregate 7 could not be found. Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7'} Aug 29 10:34:59.910527 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.911384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.912628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84e57e88-c060-4538-96af-22fd523de169 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:59.918138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84e57e88-c060-4538-96af-22fd523de169 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.055494 Aug 29 10:34:59.922320 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 132/251] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:34:59 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:59.930921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55b7934e-4cfb-47c4-9bef-00917832b207 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:34:59.976455 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-55b7934e-4cfb-47c4-9bef-00917832b207 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55b7934e-4cfb-47c4-9bef-00917832b207 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Request method failure captured: Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYgTJMEKGHZd2Dcf_3AWQTgtks2DeB0P82sy2QQkWeoCtZcNxZQ_YdIiCXMNnfdAeTmWlraNCM3kKGVg7SgMiCic5IVcRZNAJsOkGy-HpFUck4RCxBfoIglomCFSj9PXvqzkf4N3ek_vtNyLcqg5eVZX0-QpUqnKB17vck0rUMAsSA Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:34:59.979200 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/da7e163ab1e4469e959a1b82bbedef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: da7e163ab1e4469e959a1b82bbedef31 Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-489358211 Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 51dc9086a46d4b17ac1965f05b3d5c08 Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminTestJSON-489358211-project-admin Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate 7 could not be found. Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7'} Aug 29 10:34:59.980460 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:34:59.981228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:34:59.982309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55b7934e-4cfb-47c4-9bef-00917832b207 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55b7934e-4cfb-47c4-9bef-00917832b207 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.055309 Aug 29 10:34:59.983451 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 120/252] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:34:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:34:59.996085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2bd89bf9-ee93-4ef7-8da6-c2d60c323a92 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-801930032"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.001091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-2bd89bf9-ee93-4ef7-8da6-c2d60c323a92 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 7c5994f7-df7d-445c-a094-13ef2878837c for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:00.046386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2bd89bf9-ee93-4ef7-8da6-c2d60c323a92 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053976 Aug 29 10:35:00.047565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 133/253] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:34:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.059616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96ddd14d-57d3-4f00-860b-b804e3cc9531 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.076216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96ddd14d-57d3-4f00-860b-b804e3cc9531 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.016843 Aug 29 10:35:00.088434 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 121/254] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:35:00 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.090142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2627450-be6e-4fd1-9dbb-43f46e7dd0fb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.105137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:DELETE=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:00.155589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2627450-be6e-4fd1-9dbb-43f46e7dd0fb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.069574 Aug 29 10:35:00.156703 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 134/255] 10.222.0.47 () {60 vars in 1191 bytes} [Mon Aug 29 10:35:00 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.172348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93b8a9b6-1b43-460a-b389-509126d46e40 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.185174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Action: 'update', calling method: .version_select at 0x7f66c78da5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.193745 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-93b8a9b6-1b43-460a-b389-509126d46e40 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.026405 Aug 29 10:35:00.194368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 122/256] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:35:00 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.210850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef04cff9-b109-4752-a726-5bb5a8cc0eb8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.275423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef04cff9-b109-4752-a726-5bb5a8cc0eb8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.073181 Aug 29 10:35:00.276482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 123/257] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:35:00 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:00.289485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07c2238e-5c65-4e21-8e1e-8ba7ae1be95c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-270791033", "availability_zone": "tempest-test_az-33687889"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.342129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-07c2238e-5c65-4e21-8e1e-8ba7ae1be95c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 294710d0-8318-4a04-ae0f-ef8c23a90135 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:00.381016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07c2238e-5c65-4e21-8e1e-8ba7ae1be95c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.096735 Aug 29 10:35:00.382156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 124/258] 10.222.0.47 () {60 vars in 1165 bytes} [Mon Aug 29 10:35:00 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.396478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91c2b7fe-3e53-49c5-9574-ae179100ed5c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-270791033_new", "availability_zone": "tempest-test_az-33687889_new"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.451937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91c2b7fe-3e53-49c5-9574-ae179100ed5c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.455095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91c2b7fe-3e53-49c5-9574-ae179100ed5c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.455912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91c2b7fe-3e53-49c5-9574-ae179100ed5c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.543355 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91c2b7fe-3e53-49c5-9574-ae179100ed5c tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 331 microversion: 2.1 time: 0.153760 Aug 29 10:35:00.552963 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 125/259] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:35:00 2022] PUT /compute/v2.1/os-aggregates/9 => generated 331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:00.566496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d61b649-daa3-49a0-b10a-3a4084bd60fb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.575921 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d61b649-daa3-49a0-b10a-3a4084bd60fb tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 334 microversion: 2.1 time: 0.014913 Aug 29 10:35:00.576728 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 126/260] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:35:00 2022] GET /compute/v2.1/os-aggregates => generated 334 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.600316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a88081dd-1554-49d8-93c6-d24cc640f0b8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.669653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a88081dd-1554-49d8-93c6-d24cc640f0b8 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.083641 Aug 29 10:35:00.679972 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 127/261] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:35:00 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:00.685342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f953e8d3-ee64-4fad-b92d-eaafb8b16c60 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-622296461"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:00.691535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-f953e8d3-ee64-4fad-b92d-eaafb8b16c60 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Generated uuid 2062261d-686e-4b12-b4cd-5982b8aa9be5 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:00.742170 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f953e8d3-ee64-4fad-b92d-eaafb8b16c60 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060559 Aug 29 10:35:00.742797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 128/262] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.763070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.763566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.763968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.764681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.765302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9a48cde-c300-4ec0-af31-5dad8916865b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.766770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.769746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.794394 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9a48cde-c300-4ec0-af31-5dad8916865b tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.042823 Aug 29 10:35:00.806924 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 129/263] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:35:00 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:00.812062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e97775d4-8efc-4ccc-bc22-07a08d02c9f5 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.850486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.851805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.852444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.853388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.854121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.854746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.864646 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e97775d4-8efc-4ccc-bc22-07a08d02c9f5 tempest-AggregatesAdminTestJSON-489358211 tempest-AggregatesAdminTestJSON-489358211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056444 Aug 29 10:35:00.868740 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 130/264] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:00 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 10:35:00.905551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:00.906207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:00.916599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.917104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.917543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.926094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:00.926598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:00.927041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:00.952865 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] HTTP exception thrown: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Request method failure captured: Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f HTTP/1.1 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYekNNFll-5uFLZp-a33W8xt4DXog-zv8NWG0YDJsRNqL13FY5twz6EJwx9rALa_50NRMDSokdBUA7RFKGzlYLTlmKwDbnRnaRaZcTWgrTKOu0RBB1CsBBkdA_K_aHCmCzPY0l34M1HukhcuOUoo78uHiRmRfuzZR1ZLeqfxtpNFMw Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:00.954566 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b267f9b2c424539a7543043afdfcba7 Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:00.957129 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c7886462-e99c-44ec-83ad-b20fb636c20f'} Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:00.958206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:00.960027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:00.961094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Returning 404 to user: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:00.961094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5cd2ca7e-3807-4c02-9a55-6e5602490f4f tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 404 len: 111 microversion: 2.1 time: 0.077066 Aug 29 10:35:00.971259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 131/265] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:35:00 2022] DELETE /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:01.000019 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b314788f-f969-47ed-964a-9f31b34a43a7 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a?user_id=526a071e90144888ada373edf4f4be35" status: 200 len: 328 microversion: 2.1 time: 0.820234 Aug 29 10:35:01.001314 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 135/266] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:35:00 2022] PUT /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a?user_id=526a071e90144888ada373edf4f4be35 => generated 328 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:01.002631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:01.004137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:01.007273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:01.008103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] [instance: c7886462-e99c-44ec-83ad-b20fb636c20f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:01.014667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:01.015446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:01.016061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:01.016949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:01.017582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:01.018256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:01.024344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:01.024690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:01.025129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:01.025909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:01.026542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:01.027147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:01.035579 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] HTTP exception thrown: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Request method failure captured: Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f HTTP/1.1 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYekNNFll-5uFLZp-a33W8xt4DXog-zv8NWG0YDJsRNqL13FY5twz6EJwx9rALa_50NRMDSokdBUA7RFKGzlYLTlmKwDbnRnaRaZcTWgrTKOu0RBB1CsBBkdA_K_aHCmCzPY0l34M1HukhcuOUoo78uHiRmRfuzZR1ZLeqfxtpNFMw Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:01.037491 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf8ab73107804b3198e73b0b99e97f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: bf8ab73107804b3198e73b0b99e97f17 Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-613387260 Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b267f9b2c424539a7543043afdfcba7 Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminTestJSON-613387260-project Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:01.038808 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c7886462-e99c-44ec-83ad-b20fb636c20f'} Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:01.039490 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. Aug 29 10:35:01.040521 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:01.043575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] Returning 404 to user: Instance c7886462-e99c-44ec-83ad-b20fb636c20f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:01.044659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ffbc8707-f27e-4c0f-b277-c4bcef4caa92 tempest-AggregatesAdminTestJSON-613387260 tempest-AggregatesAdminTestJSON-613387260-project] 10.222.0.47 "GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f" status: 404 len: 111 microversion: 2.1 time: 0.042035 Aug 29 10:35:01.045691 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 136/267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:01 2022] GET /compute/v2.1/servers/c7886462-e99c-44ec-83ad-b20fb636c20f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:01.051075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b06dcdbe-be17-4859-bc2e-98d26765f057 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c78d5790>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:01.760698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b06dcdbe-be17-4859-bc2e-98d26765f057 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a?user_id=526a071e90144888ada373edf4f4be35" status: 200 len: 370 microversion: 2.1 time: 0.713684 Aug 29 10:35:01.765800 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1323 bytes} [Mon Aug 29 10:35:01 2022] GET /compute/v2.1/os-quota-sets/e01ed15d5bb14bf385ab8d761495833a?user_id=526a071e90144888ada373edf4f4be35 => generated 370 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:01.942058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:01.953381 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d642d7e-f55b-4853-b5bc-c14cc7eef9a2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1319 microversion: 2.1 time: 0.983443 Aug 29 10:35:01.954019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 132/269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:00 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1319 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:02.696534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e051c3e-8fab-4f0b-8454-53d9561156ef tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Calling method '.version_select at 0x7f66c7867820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:02.808210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2cba945-ed85-43a7-aeab-ca4e0eacd4df", "tag": "3d36372b-5eba-4a5b-9de8-578c4ce2cab5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:02.824134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:02.830387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:02.835760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:02.864663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] Creating event network-changed:3d36372b-5eba-4a5b-9de8-578c4ce2cab5 for instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df on n-h1-854121-10 Aug 29 10:35:02.881286 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1d5b6a79-487a-49f2-bb29-aa88a94cc1fd req-68d09520-025f-4ee6-bced-1eeb35b77e4d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076960 Aug 29 10:35:02.890105 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 133/270] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:03.587381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Calling method '.version_select at 0x7f66c76dc430>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:03.589602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:03.590903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:03.590903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:03.630151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e051c3e-8fab-4f0b-8454-53d9561156ef tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07/defaults" status: 200 len: 371 microversion: 2.1 time: 0.929612 Aug 29 10:35:03.631547 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 138/271] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:35:02 2022] GET /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07/defaults => generated 371 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:03.647685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:03.654003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:03.654526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:03.655268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:03.657358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:03.657852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:03.678162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:03.679151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:03.680099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:03.682173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:03.682758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:03.683418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:03.702756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:03.703251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:03.705892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:03.719989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c002d146-a627-4cb1-a132-feb73fff6fb5 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.755189 Aug 29 10:35:03.725242 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 134/272] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:35:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:03.736455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Action: 'update', calling method: .version_select at 0x7f66c76c7b80>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:04.052201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.054277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.056887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.057899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.062523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.063097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.401908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:04.413993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-19c9e087-bc97-4b21-8826-3078964f69cf tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1319 microversion: 2.1 time: 0.778961 Aug 29 10:35:04.429097 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 139/273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:03 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:04.434660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Calling method '.version_select at 0x7f66c78da9d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:04.436367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.437151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.437918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.464269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.464898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.465581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.505655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.506652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.507353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.515241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f5e2f4a-5239-4c5f-ad04-587b653675ab tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h2-854121-10/servers" status: 200 len: 105 microversion: 2.1 time: 0.084276 Aug 29 10:35:04.519808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 140/274] 10.222.0.47 () {58 vars in 1215 bytes} [Mon Aug 29 10:35:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-854121-10/servers => generated 105 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:04.528590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1097702-69c9-4dfc-8f08-c3e75bad0f54 tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07" status: 200 len: 329 microversion: 2.1 time: 0.801812 Aug 29 10:35:04.531181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 135/275] 10.222.0.47 () {60 vars in 1263 bytes} [Mon Aug 29 10:35:03 2022] PUT /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07 => generated 329 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:04.541968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Calling method '.version_select at 0x7f66c76dc670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:04.543797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.546431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.547272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.586693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.587185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.587829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.617260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:04.617776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:04.620884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:04.662983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d51b0182-9f4a-4e93-80cc-8f9dbb056a18 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.128795 Aug 29 10:35:04.670156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 136/276] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:35:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:04.684805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Action: 'update', calling method: .version_select at 0x7f66c76ae9d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:05.078797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-614392468", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:05.197321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:05.485600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:05.488572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:05.490067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:05.491416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:05.493190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:05.494819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.012640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=25,nova_api:UPDATE=11 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:06.115525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:06.116090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:06.116763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:06.117445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:06.118358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:06.118786 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a60f395-270c-4213-8ef1-6e7d8580bd4c tempest-QuotasAdminTestJSON-1767961444 tempest-QuotasAdminTestJSON-1767961444-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07" status: 200 len: 329 microversion: 2.1 time: 1.447087 Aug 29 10:35:06.120536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 137/277] 10.222.0.47 () {60 vars in 1263 bytes} [Mon Aug 29 10:35:04 2022] PUT /compute/v2.1/os-quota-sets/d41a7c3a71ab419d88b7676e39e53b07 => generated 329 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:06.128586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Calling method '.version_select at 0x7f66c76c34c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:06.131501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.132384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.133016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.144760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.147261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.147997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.149169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.151643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.158232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.168136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.169118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.169891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.180125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c3fe22bb-db67-41f8-a484-cd27fc22b5b4 tempest-HypervisorAdminUnderV252Test-656095742 tempest-HypervisorAdminUnderV252Test-656095742-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h2-854121-10/search" status: 200 len: 105 microversion: 2.1 time: 0.057965 Aug 29 10:35:06.181146 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 138/278] 10.222.0.47 () {58 vars in 1212 bytes} [Mon Aug 29 10:35:06 2022] GET /compute/v2.1/os-hypervisors/n-h2-854121-10/search => generated 105 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:06.188564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:06.189612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:06.200928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.201777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.202355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.203541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:06.204244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:06.204887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:06.212302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Getting quotas for project 873f13601c7a4557a06a3fc972e7a8be. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:06.218680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Getting quotas for user a4024838a7d442e69c2e650a9720d4ff and project 873f13601c7a4557a06a3fc972e7a8be. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:06.247039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:35:06.252694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:35:06.364704 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53f9c219-7d75-414a-9e6a-357591c098c2 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841870 Aug 29 10:35:06.369053 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 141/279] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:35:06.379287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fd74f171-0724-4e8d-99f3-cfc9c0673f08 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:06.379914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd74f171-0724-4e8d-99f3-cfc9c0673f08 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:06.577391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd74f171-0724-4e8d-99f3-cfc9c0673f08 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:06.587232 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fd74f171-0724-4e8d-99f3-cfc9c0673f08 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1213 microversion: 2.1 time: 0.213839 Aug 29 10:35:06.587824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 142/280] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:06 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:35:06.694419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:06.703162 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-71b30b4f-a460-4959-b887-864c7516ab8f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1319 microversion: 2.1 time: 0.520770 Aug 29 10:35:06.706073 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 139/281] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:06 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:07.609441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:07.610766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:07.626494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:07.629671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:07.631329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:07.633134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:07.635264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:07.635938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:07.733797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:07.734914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:07.763023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:07.763519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:07.763961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:07.777524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:07.778150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:07.781393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:07.970334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:07.979474 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9f87740-ee30-4654-9f61-7e6fc0e742da tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1209 microversion: 2.1 time: 0.374559 Aug 29 10:35:07.987052 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 143/282] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:07 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1209 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:08.462236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:08.476641 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f6a1bd0-c2db-4f43-878b-b0370ce74896 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1319 microversion: 2.1 time: 0.750023 Aug 29 10:35:08.479320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 140/283] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:07 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:35:09.013561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:09.015987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:09.027663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:09.029493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:09.030141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:09.031092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:09.031712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:09.032318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:09.079352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d688afce-8279-476f-bb8d-b6eaa7d3e463 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-938659669", "id": 911740037, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:09.125254 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d688afce-8279-476f-bb8d-b6eaa7d3e463 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.557156 Aug 29 10:35:09.126574 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 144/284] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:35:08 2022] POST /compute/v2.1/flavors => generated 445 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:09.388379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:09.420822 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8be9f756-bcc4-4809-b62c-a3c3fde53e2f tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1271 microversion: 2.1 time: 0.410965 Aug 29 10:35:09.424458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 141/285] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:09 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:35:09.436593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2cba945-ed85-43a7-aeab-ca4e0eacd4df", "name": "network-vif-plugged", "status": "completed", "tag": "3d36372b-5eba-4a5b-9de8-578c4ce2cab5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:09.454625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:09.455894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:09.456944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:09.473209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] Creating event network-vif-plugged:3d36372b-5eba-4a5b-9de8-578c4ce2cab5 for instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df on n-h1-854121-10 Aug 29 10:35:09.481596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8b4ea066-635a-4f28-bfc5-8dd3e1f03b9b req-ae43132b-8a5a-4fd7-b223-e946581b1acb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055439 Aug 29 10:35:09.483321 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 142/286] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:09.521357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:09.523635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:09.544596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:09.547593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:09.549257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:09.552829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:09.554367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:09.557161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:09.845846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:09.858697 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ea72cf7-302c-45e5-be2b-5e7b83684d2a tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1319 microversion: 2.1 time: 0.358495 Aug 29 10:35:09.884428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-39c9b678-c7f7-40f0-9d70-7ff3cc142682 tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:09.889801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 143/287] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:09 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:09.895021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-39c9b678-c7f7-40f0-9d70-7ff3cc142682 tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] 10.222.0.47 "GET /compute/v2.1/flavors/911740037" status: 200 len: 445 microversion: 2.55 time: 0.759149 Aug 29 10:35:09.895720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 145/288] 10.222.0.47 () {60 vars in 1196 bytes} [Mon Aug 29 10:35:09 2022] GET /compute/v2.1/flavors/911740037 => generated 445 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 10:35:09.910980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f36465a0-c4c9-43c1-a986-9e9d05ebfdcc tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] Action: 'update', calling method: .version_select at 0x7f66c8cb2f70>, body: {"flavor": {"description": "new"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:09.993407 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f36465a0-c4c9-43c1-a986-9e9d05ebfdcc tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/911740037" status: 200 len: 446 microversion: 2.55 time: 0.088757 Aug 29 10:35:09.995368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 144/289] 10.222.0.47 () {62 vars in 1216 bytes} [Mon Aug 29 10:35:09 2022] PUT /compute/v2.1/flavors/911740037 => generated 446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:10.010436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1db39ea-6a8b-4b52-8d76-8cd40e35c57f tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:10.053462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1db39ea-6a8b-4b52-8d76-8cd40e35c57f tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.048913 Aug 29 10:35:10.054046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 146/290] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:35:10 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:10.074030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a5c29f2-0e8a-4042-8c96-d5e1c71a151f tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:10.119910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a5c29f2-0e8a-4042-8c96-d5e1c71a151f tempest-FlavorsV255TestJSON-1978728220 tempest-FlavorsV255TestJSON-1978728220-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.050060 Aug 29 10:35:10.134107 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 145/291] 10.222.0.47 () {60 vars in 1166 bytes} [Mon Aug 29 10:35:10 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:10.143415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cad4ef28-63cc-402c-acb5-79f243620116 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:10.178188 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cad4ef28-63cc-402c-acb5-79f243620116 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/911740037" status: 202 len: 0 microversion: 2.55 time: 0.038314 Aug 29 10:35:10.179669 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 147/292] 10.222.0.47 () {60 vars in 1199 bytes} [Mon Aug 29 10:35:10 2022] DELETE /compute/v2.1/flavors/911740037 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:35:10.194997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f2c92bca-5706-4069-8655-9c7d4df7d101 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:10.234561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f2c92bca-5706-4069-8655-9c7d4df7d101 tempest-FlavorsV255TestJSON-2016202730 tempest-FlavorsV255TestJSON-2016202730-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.050614 Aug 29 10:35:10.246456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 146/293] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:35:10 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:10.446001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:10.447064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:10.464349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:10.465251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:10.465845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:10.467527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:10.468447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:10.469137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.037887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:11.072329 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d33103b-b820-4428-8c2b-765a45ba86b9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.632823 Aug 29 10:35:11.104830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 148/294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:10 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:11.119719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:11.121796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:11.134468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.135321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.135760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.140241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.141212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.143391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.229376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:11.233493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.234011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.238759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.249505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.250268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.250855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.331856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d8257a02-c24b-48bf-b602-b2669ac8f270 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.673698 Aug 29 10:35:11.341601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 147/295] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:35:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:11.365035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dd676211-9b55-4cc2-84a8-d34a834a1042 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-900373795"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:11.380764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-dd676211-9b55-4cc2-84a8-d34a834a1042 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 974690e4-0c9d-4247-9d74-d8f094b33372 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:11.435598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dd676211-9b55-4cc2-84a8-d34a834a1042 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.089166 Aug 29 10:35:11.436226 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 148/296] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:11.449306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e6f0748-1d16-4d14-94a6-c715de82a8d2 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:11.478697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e6f0748-1d16-4d14-94a6-c715de82a8d2 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.479578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e6f0748-1d16-4d14-94a6-c715de82a8d2 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.480232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e6f0748-1d16-4d14-94a6-c715de82a8d2 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.657528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:11.671500 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cc430b2a-1817-488d-8b84-7d4616628e49 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1468 microversion: 2.1 time: 0.564578 Aug 29 10:35:11.675718 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 149/297] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:11 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1468 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:11.695493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e6f0748-1d16-4d14-94a6-c715de82a8d2 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.251115 Aug 29 10:35:11.699616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:11.701076 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 149/298] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:11.711808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:11.718881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:11.745075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.747716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.748183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.748976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.749449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.749909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.770032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.773743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.776800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.842814 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-854121-10. Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 40 Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:11.848501 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: {"add_host": {"host": "n-h2-854121-10"}} Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:11.849888 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate 11 already has host n-h2-854121-10. Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-854121-10'}}} Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:35:11.850685 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854121-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 10:35:11.851816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 10:35:11.852874 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:35:11.855481 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854121-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 10, 35, 11, 827502), 'updated_at': None, 'host': 'n-h2-854121-10', 'aggregate_id': 11}] Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:11.859182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-854121-10. Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.860245 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-854121-10. Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:11.862503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:11.864293 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-854121-10. Aug 29 10:35:11.864293 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:11.864293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-854121-10. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:11.864293 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ac525a1-8952-434a-adaa-d6e7bc8bf0c1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.136529 Aug 29 10:35:11.864293 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 150/299] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Aug 29 10:35:11.867276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-153c8e4e-aea5-475c-a115-882916dd83f1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:11.914541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-153c8e4e-aea5-475c-a115-882916dd83f1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:11.916271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-153c8e4e-aea5-475c-a115-882916dd83f1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:11.916743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-153c8e4e-aea5-475c-a115-882916dd83f1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:11.927345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:12.110575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aca8da51-abe5-4f34-af15-d3e8d07ce922 tempest-DeleteServersAdminTestJSON-317153475 tempest-DeleteServersAdminTestJSON-317153475-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df/action" status: 202 len: 0 microversion: 2.1 time: 0.416770 Aug 29 10:35:12.117245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 150/300] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:35:11 2022] POST /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:35:12.125853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:12.134439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:12.147917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.149323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.150202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.152189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.155440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.156097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.251655 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-153c8e4e-aea5-475c-a115-882916dd83f1 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.391596 Aug 29 10:35:12.262810 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 151/301] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:12.280149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:12.280877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:12.300729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.301640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.303188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.305333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.307515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.308357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.364799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.366336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.367075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.367755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lazy-loading 'fault' on Instance uuid b2cba945-ed85-43a7-aeab-ca4e0eacd4df {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:12.531972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:12.551246 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7806f13c-db7c-4ad1-a2cb-43098cd56420 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.432059 Aug 29 10:35:12.552199 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 151/302] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:12 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:12.556659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30a70d3f-b469-4c87-8eb8-189e15b1bdce tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:12.607247 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30a70d3f-b469-4c87-8eb8-189e15b1bdce tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.053715 Aug 29 10:35:12.608313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 152/303] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:12 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:12.620493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ce95f97-997d-4142-b695-90056ca0c235 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-856353724"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:12.626042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-2ce95f97-997d-4142-b695-90056ca0c235 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid dd26f1b2-605a-42d3-8bc7-bb624ae46ef6 for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:12.660906 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ce95f97-997d-4142-b695-90056ca0c235 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044166 Aug 29 10:35:12.670001 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 153/304] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:12.727080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:12.740305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f88958a-bbb7-4a88-bfbb-b3930dc5895e tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1451 microversion: 2.1 time: 0.482247 Aug 29 10:35:12.741829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 152/305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:12 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1451 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:12.768995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:12.769995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:12.785323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.786492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.791085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.792635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:12.793295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:12.793963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:12.873187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:35:13.193151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8063f4cf-b540-4204-b198-3b52616351f0 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 204 len: 0 microversion: 2.1 time: 0.426586 Aug 29 10:35:13.194607 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 153/306] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:35:12 2022] DELETE /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:35:13.214953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681f33b8-d257-4db6-b999-ca2484ac1efa", "tag": "ea257286-cbd0-457c-bd73-a26d8c870a98"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:13.255359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.264058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.265200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.288352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] Creating event network-changed:ea257286-cbd0-457c-bd73-a26d8c870a98 for instance 681f33b8-d257-4db6-b999-ca2484ac1efa on n-h2-854121-10 Aug 29 10:35:13.305393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a362b02d-8e33-4a74-8047-3c4de7410944 req-7fbb90cc-d1ab-4da5-b87b-479027d5ce58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105480 Aug 29 10:35:13.308807 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 154/307] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:13.316621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f05aee0-467a-44fb-b506-5bb83d2a6668 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:13.320216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f05aee0-467a-44fb-b506-5bb83d2a6668 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:13.324040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:13.324654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f05aee0-467a-44fb-b506-5bb83d2a6668 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 40 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:13.325090 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: {"add_host": {"host": "n-h2-854121-10"}} Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:13.326351 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-854121-10'}}} Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:13.327092 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 10:35:13.328196 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:13.331129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f05aee0-467a-44fb-b506-5bb83d2a6668 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:13.331129 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f05aee0-467a-44fb-b506-5bb83d2a6668 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.657430 Aug 29 10:35:13.336333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 154/308] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:12 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:13.338712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.342511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.343546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.344303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.344768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.352103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.414518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.415492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.416019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.416559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lazy-loading 'fault' on Instance uuid b2cba945-ed85-43a7-aeab-ca4e0eacd4df {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:13.651337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:13.660954 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2bab9de9-87cc-4d2a-a743-4af9f80580ee tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1457 microversion: 2.1 time: 0.346970 Aug 29 10:35:13.662477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 155/309] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:13 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1457 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:13.667473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-739114f4-5f7b-4e6b-bbce-3695c82a82ce tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:13.702993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-739114f4-5f7b-4e6b-bbce-3695c82a82ce tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.038765 Aug 29 10:35:13.711417 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 156/310] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:13 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:13.718715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:13.719628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:13.738899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.739696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.740387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.741319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:13.742018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:13.742699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:13.932538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:13.943143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8cdfb1c5-24ec-4f80-8bcb-6060ce1f593c tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.230188 Aug 29 10:35:13.957753 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 157/311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:13 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:13.964341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-41857188", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "216ce7f7-153f-4fc4-88fa-0b56f8f31bc3"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:13.965174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b66113eb-893e-461c-bb7f-50dd89f79473 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1367154674"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:13.972142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-b66113eb-893e-461c-bb7f-50dd89f79473 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 9af4e5ae-d8fa-489c-83de-25c61e8389a1 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:14.008927 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b66113eb-893e-461c-bb7f-50dd89f79473 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049573 Aug 29 10:35:14.010027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 158/312] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:14.022834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1446090638"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.032766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=85,nova_api:UPDATE=5,nova_api:DELETE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:14.036906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:14.037515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:14.038078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:14.046862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:14.047352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:14.047791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:14.057062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1446090638 could not be found. Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 58 Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:14.059629 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: {"add_host": {"host": "tempest-nonexist_host-1446090638"}} Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.061188 n-d-854121-10 devstack@n-api.service[128681]: exception: Compute host tempest-nonexist_host-1446090638 could not be found. Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1446090638'}}} Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1446090638' is not mapped to any cell Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.062093 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 29 10:35:14.063538 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1446090638 could not be found. Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1446090638 could not be found. Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.064784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1446090638 could not be found. Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.067033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1446090638 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.068742 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fb8b1b8-e1b3-4269-81d3-7070c1d52a2b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.051314 Aug 29 10:35:14.073532 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 159/313] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:14.079746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35f0a7bf-58a7-46af-8b51-59958a1d9b2e tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.087749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] validate_networks() for [('216ce7f7-153f-4fc4-88fa-0b56f8f31bc3', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:14.111044 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35f0a7bf-58a7-46af-8b51-59958a1d9b2e tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.035913 Aug 29 10:35:14.117035 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 160/314] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:14.122955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e69bcebe-4f25-4ee2-9a36-70a183630c51 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e69bcebe-4f25-4ee2-9a36-70a183630c51 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 283 Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:14.129054 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.130500 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:35:14.131060 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.131632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.132558 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.134375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:35:14.134375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:35:14.134375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:35:14.134375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.134375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e69bcebe-4f25-4ee2-9a36-70a183630c51 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.134881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e69bcebe-4f25-4ee2-9a36-70a183630c51 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013535 Aug 29 10:35:14.134881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 161/315] 10.222.0.47 () {60 vars in 1165 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:35:14.146556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b37d715e-191d-417e-b3ca-ad4cc41d94d3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b37d715e-191d-417e-b3ca-ad4cc41d94d3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 27 Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:14.153128 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: {"aggregate": {"name": ""}} Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.154419 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '' Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.155141 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:35:14.157022 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.159006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b37d715e-191d-417e-b3ca-ad4cc41d94d3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.159006 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b37d715e-191d-417e-b3ca-ad4cc41d94d3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016634 Aug 29 10:35:14.159735 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 162/316] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:35:14.167687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c94eb34-f216-4f91-9980-ac4774a388dd tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-486462657"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.172273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c94eb34-f216-4f91-9980-ac4774a388dd tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c94eb34-f216-4f91-9980-ac4774a388dd tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 59 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:14.174101 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: {"aggregate": {"name": "tempest-test_aggregate-486462657"}} Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.175890 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-486462657'}}} Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:14.176612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:14.178234 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 10:35:14.179305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.179305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c94eb34-f216-4f91-9980-ac4774a388dd tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.179305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c94eb34-f216-4f91-9980-ac4774a388dd tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015195 Aug 29 10:35:14.181680 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 163/317] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:14.188891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d0ed647-f635-45ec-bbd5-b1659547534b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1705763121"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.194794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-0d0ed647-f635-45ec-bbd5-b1659547534b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid a52cfda0-42ca-4210-be2d-dc31e2a3e865 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:14.236800 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d0ed647-f635-45ec-bbd5-b1659547534b tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053248 Aug 29 10:35:14.244824 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 164/318] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:14.250931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1705763121"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.255411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 3d1858e9-d47e-4fa2-9791-06810e6e9f2f for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:14.264933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1705763121 already exists. Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 60 Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:14.267110 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: {"aggregate": {"name": "tempest-test_aggregate-1705763121"}} Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.268937 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate tempest-test_aggregate-1705763121 already exists. Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1705763121'}}} Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 29 10:35:14.269644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1705763121 already exists. Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:14.270721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1705763121 already exists. Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1705763121 already exists. Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1705763121 already exists. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.272931 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5bee35be-a520-4570-880c-36ad46c1041d tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.023052 Aug 29 10:35:14.274582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 165/319] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 29 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:14.280228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2aa63a47-0352-4781-aa4a-53aa7ffebed8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.322318 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2aa63a47-0352-4781-aa4a-53aa7ffebed8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.045878 Aug 29 10:35:14.325010 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 166/320] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:14.339006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a067672-de29-4d8d-9b93-674c8f0573c3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212835101"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.344547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-2a067672-de29-4d8d-9b93-674c8f0573c3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 0b73e9de-4601-491f-b83c-360bce501322 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:14.380811 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a067672-de29-4d8d-9b93-674c8f0573c3 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049953 Aug 29 10:35:14.382502 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 167/321] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:14.400019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-715b535c-53e1-438b-a79d-f6d78ba84ec4 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.403097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-715b535c-53e1-438b-a79d-f6d78ba84ec4 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-715b535c-53e1-438b-a79d-f6d78ba84ec4 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:14.405025 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 10:35:14.406518 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '15'} Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.407339 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 10:35:14.409209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.418872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-715b535c-53e1-438b-a79d-f6d78ba84ec4 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.420366 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-715b535c-53e1-438b-a79d-f6d78ba84ec4 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.031245 Aug 29 10:35:14.421084 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 168/322] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:14 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:14.431609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0871b507-2657-41f0-8cad-00d538501d55 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.498441 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0871b507-2657-41f0-8cad-00d538501d55 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.066510 Aug 29 10:35:14.504417 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 169/323] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:14 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:14.518832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa236a3e-ad3f-4353-81c2-e0d44ffa2334 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.548298 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-fa236a3e-ad3f-4353-81c2-e0d44ffa2334 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa236a3e-ad3f-4353-81c2-e0d44ffa2334 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:14.553091 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate -1 could not be found. Aug 29 10:35:14.554808 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '-1'} Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:35:14.555667 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.556930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 10:35:14.559076 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.568308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa236a3e-ad3f-4353-81c2-e0d44ffa2334 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.569333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa236a3e-ad3f-4353-81c2-e0d44ffa2334 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.059562 Aug 29 10:35:14.576416 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 170/324] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:14 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:14.591120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-739a7c75-5abf-4cfc-ba05-599251ea5b86 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2092422578"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:14.594873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-739a7c75-5abf-4cfc-ba05-599251ea5b86 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 791badcc-9ef1-4e7d-b587-6c0b46cc86ce for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:14.646498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-739a7c75-5abf-4cfc-ba05-599251ea5b86 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068655 Aug 29 10:35:14.647862 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 171/325] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:14.660728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8336bcf-7426-41e4-a3aa-56f250a7c9dc tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.664756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8336bcf-7426-41e4-a3aa-56f250a7c9dc tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8336bcf-7426-41e4-a3aa-56f250a7c9dc tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:14.671046 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 10:35:14.672606 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '16'} Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:14.673454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 10:35:14.676050 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:14.680354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8336bcf-7426-41e4-a3aa-56f250a7c9dc tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:14.682050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8336bcf-7426-41e4-a3aa-56f250a7c9dc tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.027064 Aug 29 10:35:14.683836 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 172/326] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:35:14 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:35:14.700282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:14.701118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:14.717527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:14.719346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:14.723462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:14.726258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:14.726970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:14.727652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:14.803362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:14.804928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:14.805799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:14.808800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lazy-loading 'fault' on Instance uuid b2cba945-ed85-43a7-aeab-ca4e0eacd4df {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:15.443089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b022ffddbc349a196a26b77bfd62dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27860db656e848829f1e4e46936c28d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:15.454917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5216deaa-8759-4b43-b156-707c62336e4f tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 200 len: 1457 microversion: 2.1 time: 0.768748 Aug 29 10:35:15.469762 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 173/327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:14 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 1457 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:15.479946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-091e0046-85ae-4af8-a379-2ed912e1d18f tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:15.540105 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-091e0046-85ae-4af8-a379-2ed912e1d18f tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.068976 Aug 29 10:35:15.541041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 174/328] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:15 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:15.550931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:15.556493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:15.567762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:15.570240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:15.571165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:15.572179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:15.573928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:15.574991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.109954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=80 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:16.177989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=11 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:16.367850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:16.388766 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9305c294-15e0-4668-8b70-9e351c3b4db0 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.845984 Aug 29 10:35:16.397618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 175/329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:15 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:16.397618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2cba945-ed85-43a7-aeab-ca4e0eacd4df", "name": "network-vif-deleted", "tag": "3d36372b-5eba-4a5b-9de8-578c4ce2cab5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:16.417253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:16.417851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:16.418309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.441254 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] Creating event network-vif-deleted:3d36372b-5eba-4a5b-9de8-578c4ce2cab5 for instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df on n-h1-854121-10 Aug 29 10:35:16.449017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-196a82c7-5c81-4dc3-a982-723b943bd2ac req-dd23fdd1-ed3a-46a2-9149-90a3ca507819 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058027 Aug 29 10:35:16.450846 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 176/330] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:16.467693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7e4ac10-e038-497e-99f2-bcc98a827cf4 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:16.491552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a7e4ac10-e038-497e-99f2-bcc98a827cf4 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7e4ac10-e038-497e-99f2-bcc98a827cf4 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:16.495394 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: exception: Aggregate -1 could not be found. Aug 29 10:35:16.497057 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '-1'} Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.498070 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 10:35:16.500673 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.523552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7e4ac10-e038-497e-99f2-bcc98a827cf4 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:16.525919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7e4ac10-e038-497e-99f2-bcc98a827cf4 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.073632 Aug 29 10:35:16.528803 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 177/331] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:35:16 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:16.586958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=42 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:16.879570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b85b5f4e-4768-4bf1-9810-44f8068c7fff tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] Calling method '.version_select at 0x7f66c76ae1f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:16.883224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:16.883655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:16.884245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:16.884931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:16.885428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:16.888463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:16.898832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:16.899323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:16.899807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.900398 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b85b5f4e-4768-4bf1-9810-44f8068c7fff tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.370167 Aug 29 10:35:16.900899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:16.901391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:16.901939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.902209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 178/332] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:35:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:16.907535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:16.908614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:16.917335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:16.918553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:16.919886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.921164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:16.921886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:16.923007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:16.926630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:16.931391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for user ad7622f1f2834d1e9171f6525f0e6481 and project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:16.941528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df HTTP/1.1 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:16.943593 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:16.945048 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b2cba945-ed85-43a7-aeab-ca4e0eacd4df'} Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:16.945909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:16.947188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.948374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:16.948596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e3b8b5c-52ee-428e-a762-5395df7e6850 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 404 len: 111 microversion: 2.1 time: 0.044544 Aug 29 10:35:16.949991 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 179/333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:16 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:16.954721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:35:16.955640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9b29ad-bcde-48f6-906a-5f0ed546f997 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:16.957287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:35:16.957741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6c9b29ad-bcde-48f6-906a-5f0ed546f997 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9b29ad-bcde-48f6-906a-5f0ed546f997 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:16.959548 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 10:35:16.960923 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:16.961737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 10:35:16.962979 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:16.965591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9b29ad-bcde-48f6-906a-5f0ed546f997 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:16.966721 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6c9b29ad-bcde-48f6-906a-5f0ed546f997 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015346 Aug 29 10:35:16.967684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 180/334] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:35:16 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:16.972713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a74af42-b6b0-4699-8d27-9978fdc3b50d tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] Action: 'update', calling method: .version_select at 0x7f66c761c4c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.045833 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab7e754a-0f5a-421e-b27a-8fdc61aa9456 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.706081 Aug 29 10:35:17.047079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 155/335] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:35:17.060745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.074521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.092304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.092949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.093514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.094396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.095078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.095746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.114202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df HTTP/1.1 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:17.116262 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.118441 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b2cba945-ed85-43a7-aeab-ca4e0eacd4df'} Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:17.119290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.120337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.121415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:17.123583 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a219fc67-808c-4679-9fcb-310d891fdbc2 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 404 len: 111 microversion: 2.1 time: 0.074794 Aug 29 10:35:17.124992 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 156/336] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:35:17 2022] DELETE /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:17.130723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cff40262-17cb-4319-b087-7cfc53e79309 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1196675560"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.135123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-cff40262-17cb-4319-b087-7cfc53e79309 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid 4a422d8f-79dd-4227-9d33-b3bc3b0cee0e for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:17.165529 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cff40262-17cb-4319-b087-7cfc53e79309 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039209 Aug 29 10:35:17.173805 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 157/337] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:17.180656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.182324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.349621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:17.363636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:17.367838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:17.369251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa9b1467-f6bc-4707-afe2-6332f895d585 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1260 microversion: 2.25 time: 0.200428 Aug 29 10:35:17.372079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 158/338] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:17 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:17.378737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.383532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: b2cba945-ed85-43a7-aeab-ca4e0eacd4df] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.386199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=8,nova_api:INSERT=12,nova_api:UPDATE=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:17.398807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.401319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.402080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.404459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.405043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.405677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.436541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df HTTP/1.1 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:17.438355 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.440434 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b2cba945-ed85-43a7-aeab-ca4e0eacd4df'} Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:17.441246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. Aug 29 10:35:17.442600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.444343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance b2cba945-ed85-43a7-aeab-ca4e0eacd4df could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:17.448356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-797ed1ff-722f-48d3-abf4-0c6d78a00987 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df" status: 404 len: 111 microversion: 2.1 time: 0.073023 Aug 29 10:35:17.451972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 159/339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:17 2022] GET /compute/v2.1/servers/b2cba945-ed85-43a7-aeab-ca4e0eacd4df => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:17.454627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8473095f-ad90-43bb-8f2a-802cbf53f5f8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.468308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8473095f-ad90-43bb-8f2a-802cbf53f5f8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.468792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8473095f-ad90-43bb-8f2a-802cbf53f5f8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.469352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8473095f-ad90-43bb-8f2a-802cbf53f5f8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.496535 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a74af42-b6b0-4699-8d27-9978fdc3b50d tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.527169 Aug 29 10:35:17.505896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 181/340] 10.222.0.47 () {60 vars in 1206 bytes} [Mon Aug 29 10:35:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:17.511884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.512829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.521260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.522053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.522711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.523685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.524370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.525014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.653151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8473095f-ad90-43bb-8f2a-802cbf53f5f8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.202403 Aug 29 10:35:17.654060 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 160/341] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:17.668237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.669031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.691346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.693425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.694071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.696116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.698807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.699776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.738718 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca HTTP/1.1 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:17.742828 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.744303 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3e9dcbe4-377d-4bcd-b0be-4545017af0ca'} Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:17.745084 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.746418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.749969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:17.751438 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3920c1b1-bfa9-4fc8-88e7-6635d13e4341 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 404 len: 111 microversion: 2.1 time: 0.096029 Aug 29 10:35:17.753599 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 161/342] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:35:17 2022] DELETE /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:17.764996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0610dd2a-150d-4356-bf46-2483fdb24095 tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] Calling method '.version_select at 0x7f66c78f9670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.776496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:17.791386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea0a0dbc-239b-45f8-8850-424d60ee1651 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.283384 Aug 29 10:35:17.802240 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0610dd2a-150d-4356-bf46-2483fdb24095 tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.042373 Aug 29 10:35:17.803815 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 162/343] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:35:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:17.804394 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 182/344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:17 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:17.815490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:17.816866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] [instance: 3e9dcbe4-377d-4bcd-b0be-4545017af0ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:17.818109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d68c9f9-e5ca-431d-8a6d-3d1413434bf2 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.824213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.824886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8d68c9f9-e5ca-431d-8a6d-3d1413434bf2 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6fdb0a04ec6245d5b8154fbf836ca73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ba8b492f7a4e1989eca322d6a2c0ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d68c9f9-e5ca-431d-8a6d-3d1413434bf2 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Request method failure captured: Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 43 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZclIcsU-Mn9_3Lc-JxpTkj3DvwS5fT_Atkd0Bv2dbt3Ul7K3Feey1Aitp4GXdObIlqhSL3DT8jgkmXCQcz0m_cefgZwKo3hjjl76sOXil9zH5uAJIWrVWyv2_54CGkkmleDfGZSmpoFn9BD5KtHUhFKgq9PzwEmCnHGVD6uRuFcF4 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:17.836519 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/47ba8b492f7a4e1989eca322d6a2c0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 47ba8b492f7a4e1989eca322d6a2c0ae Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907 Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6fdb0a04ec6245d5b8154fbf836ca73a Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2047798907-project Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: {"remove_host": {"host": "n-h2-854121-10"}} Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:17.839083 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-854121-10'}}} Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:17.839961 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 10:35:17.841767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.843250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d68c9f9-e5ca-431d-8a6d-3d1413434bf2 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:17.843250 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8d68c9f9-e5ca-431d-8a6d-3d1413434bf2 tempest-AggregatesAdminNegativeTestJSON-2047798907 tempest-AggregatesAdminNegativeTestJSON-2047798907-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026496 Aug 29 10:35:17.843250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 163/345] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:17.847592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.848826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.851092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.851701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:17.866693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1877d95e-40e0-48a2-a25e-f8cb80a19bc0 tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] Action: 'update', calling method: .version_select at 0x7f66c7c0b940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.870723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] HTTP exception thrown: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Request method failure captured: Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca HTTP/1.1 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJYeNL4WjTEv7cNs8e_hguqZ8LQ5u2Am6VByEKZvhPEqnvNTnlCZdeNInw7_HJUIpSDAJZRUp7tRjIYY__nQuFDzPm8f8V9suqeKyihYGJDGCZ6IBzRNyygR3Wu7IWsrIvwuzcCyeQ6aziAjBczhdEhVzm95if7o35f9MrxWadMRfMw Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:17.872934 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_27860db656e848829f1e4e46936c28d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/27860db656e848829f1e4e46936c28d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/27860db656e848829f1e4e46936c28d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 27860db656e848829f1e4e46936c28d7 Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1670178188 Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4b022ffddbc349a196a26b77bfd62dfd Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersAdminTestJSON-1670178188-project Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.874382 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3e9dcbe4-377d-4bcd-b0be-4545017af0ca'} Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:17.875292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. Aug 29 10:35:17.876485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:17.880412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] Returning 404 to user: Instance 3e9dcbe4-377d-4bcd-b0be-4545017af0ca could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:17.881615 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad7833e2-3624-489f-b781-030ae11e9f38 tempest-DeleteServersAdminTestJSON-1670178188 tempest-DeleteServersAdminTestJSON-1670178188-project] 10.222.0.47 "GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca" status: 404 len: 111 microversion: 2.1 time: 0.071314 Aug 29 10:35:17.882555 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 183/346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:17 2022] GET /compute/v2.1/servers/3e9dcbe4-377d-4bcd-b0be-4545017af0ca => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:17.888673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b1621680-1af1-4012-b0af-16dcd93e2c4c tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:17.901314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1621680-1af1-4012-b0af-16dcd93e2c4c tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:17.901955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1621680-1af1-4012-b0af-16dcd93e2c4c tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:17.902456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1621680-1af1-4012-b0af-16dcd93e2c4c tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.109067 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b1621680-1af1-4012-b0af-16dcd93e2c4c tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.225261 Aug 29 10:35:18.120742 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 184/347] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:18.127810 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1877d95e-40e0-48a2-a25e-f8cb80a19bc0 tempest-QuotaClassesAdminTestJSON-1296176178 tempest-QuotaClassesAdminTestJSON-1296176178-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.290025 Aug 29 10:35:18.128578 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 164/348] 10.222.0.47 () {60 vars in 1206 bytes} [Mon Aug 29 10:35:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:18.130815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9f9f8fb3-7ff0-4d11-92f1-656e85585995 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:18.164138 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9f9f8fb3-7ff0-4d11-92f1-656e85585995 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.039670 Aug 29 10:35:18.165193 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 185/349] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:18 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:18.178655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a7c8652-0ccf-4bdd-9c34-13be9a8a49b8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1584806330"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:18.182250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.aggregate [None req-6a7c8652-0ccf-4bdd-9c34-13be9a8a49b8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Generated uuid f782ee3d-14c9-4f23-87e0-633efffbffcd for aggregate {{(pid=128682) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 10:35:18.205138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a7c8652-0ccf-4bdd-9c34-13be9a8a49b8 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034204 Aug 29 10:35:18.207113 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 165/350] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 10:35:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:18.218271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:18.232489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.233266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.233882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.240595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.241155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.241666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.250544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.compute.aggregates [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 10:35:18.251582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Request method failure captured: Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 42 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZeQVLNpWUiM5ScysW8ikJDdwMBg-x8JMcO1Z-y-StCLSZ8UUBu1OZkFe9iMLCJYtXKeHuuxql-Yygg8OdJ6c8nI840IpmusJKH4_-T9orX4QJbwne3tScSBnt-n8UnCP3f7I2VNhHgSm7zq8R82Hxr1CrRLuCYrjApIHNnfCvxJdE Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:18.254241 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/866dc7fa83bf45e79bdc858e024ffa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 866dc7fa83bf45e79bdc858e024ffa3b Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-739673372 Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2bde2a0bc3af4dde958a0c6768b0dcf2 Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: {"remove_host": {"host": "nonexist_host"}} Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:18.255452 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 10:35:18.256215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 29 10:35:18.257309 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.259215 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54d48c3a-3657-404b-92a1-87e424823960 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.041364 Aug 29 10:35:18.261394 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 186/351] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 10:35:18 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:18.264766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da623bd2-b155-4e1c-99e3-fea4bb57ad45 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:18.288552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da623bd2-b155-4e1c-99e3-fea4bb57ad45 tempest-AggregatesAdminNegativeTestJSON-739673372 tempest-AggregatesAdminNegativeTestJSON-739673372-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.027122 Aug 29 10:35:18.289077 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 166/352] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:35:18 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:18.396537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:18.397489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:18.404188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.404944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.405624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.406581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.407831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.409645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.485308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:18.494031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:18.496785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:18.499020 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53c6c2fc-6123-4da3-8d1b-3175f288db9e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1312 microversion: 2.25 time: 0.107181 Aug 29 10:35:18.499772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 187/353] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:18 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:35:18.739679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681f33b8-d257-4db6-b999-ca2484ac1efa", "name": "network-vif-plugged", "status": "completed", "tag": "ea257286-cbd0-457c-bd73-a26d8c870a98"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:18.754960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.758533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.760366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.793422 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] Creating event network-vif-plugged:ea257286-cbd0-457c-bd73-a26d8c870a98 for instance 681f33b8-d257-4db6-b999-ca2484ac1efa on n-h2-854121-10 Aug 29 10:35:18.802596 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4e0f8392-8230-4b6d-9581-060747a2abf8 req-960edbe3-4e8a-4646-9445-00cc93b3ed26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064330 Aug 29 10:35:18.803239 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 167/354] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:18.822836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:18.828568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:18.851172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.851172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.853881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:18.853881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:18.853881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:18.853881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:19.165039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:19.173062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5006ca86-dbbe-4b3b-b891-dd9c79767ecb tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1313 microversion: 2.1 time: 0.361573 Aug 29 10:35:19.173670 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 188/355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:18 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:19.404366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Action: 'update', calling method: .version_select at 0x7f66c77edee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:19.522999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:19.524027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:19.532486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:19.533540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:19.535168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:19.536285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:19.537120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:19.541913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:19.650488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:19.664496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:19.665976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:19.676550 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1318 microversion: 2.25 time: 0.155847 Aug 29 10:35:19.691148 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 189/356] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:19 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:19.772176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:19.773274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7ac875f-6a20-4275-a9bc-43e1e1daf49d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001850 Aug 29 10:35:19.780478 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 190/357] 10.222.0.47 () {56 vars in 886 bytes} [Mon Aug 29 10:35:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 29 10:35:19.909749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:19.910245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:19.910692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:19.911421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:19.911879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:19.912341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:19.981484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c13a21a-e0a5-4ea7-a32a-6bf4aeb73372 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac" status: 200 len: 148 microversion: 2.57 time: 0.928504 Aug 29 10:35:19.983745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 168/358] 10.222.0.47 () {62 vars in 1303 bytes} [Mon Aug 29 10:35:19 2022] PUT /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac => generated 148 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 10:35:19.996169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Calling method '.version_select at 0x7f66c755f8b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:20.197195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:20.197971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:20.211724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.212050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.212710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.213928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.214757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.215637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.490562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:20.504636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cea90aff-d4ad-45b9-bb73-b2e259912ef9 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1463 microversion: 2.1 time: 0.311888 Aug 29 10:35:20.506516 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 169/359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:20 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1463 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:20.789689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.790463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.791054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.791809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.792265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.793156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.842882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-62b5370e-5e4c-4120-99c0-58175494fe88 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac/detail" status: 200 len: 463 microversion: 2.57 time: 0.851997 Aug 29 10:35:20.844505 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 191/360] 10.222.0.47 () {60 vars in 1304 bytes} [Mon Aug 29 10:35:19 2022] GET /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac/detail => generated 463 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:20.849484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:20.850185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:20.857106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.857893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.858524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.859512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:20.860237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:20.860855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:20.883720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:21.107116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Calling method '.version_select at 0x7f66c77edc10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:21.131849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.133177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.134083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.164994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:21.169735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.170252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.171304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.175291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:21.176997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:21.178154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f9c211a-286e-46f4-9967-2a3635d614dd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.332504 Aug 29 10:35:21.191540 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 192/361] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:20 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:21.218687 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cef09fd0-d423-4af0-a1f7-9c8063289149 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/873f13601c7a4557a06a3fc972e7a8be?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445" status: 200 len: 695 microversion: 2.1 time: 0.690575 Aug 29 10:35:21.219882 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 170/362] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Aug 29 10:35:20 2022] GET /compute/v2.1/os-simple-tenant-usage/873f13601c7a4557a06a3fc972e7a8be?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445 => generated 695 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:21.238584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '.version_select at 0x7f66c755fd30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:21.252788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.253738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.254516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.277792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=17 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:21.279659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.280917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.282035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.305233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b093fb0d-feab-488c-b62b-ab4c3ed2ea32 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/873f13601c7a4557a06a3fc972e7a8be?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445" status: 200 len: 698 microversion: 2.1 time: 0.071708 Aug 29 10:35:21.318103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 193/363] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Aug 29 10:35:21 2022] GET /compute/v2.1/os-simple-tenant-usage/873f13601c7a4557a06a3fc972e7a8be?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445 => generated 698 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:21.323499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Calling method '.version_select at 0x7f66c77c8700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:21.333939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.334418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.335066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.351648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.352437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.353053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.380682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3538ea5f-5cfd-4111-93f9-5fbd46e4b880 tempest-TenantUsagesTestJSON-428728509 tempest-TenantUsagesTestJSON-428728509-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445&detailed=1" status: 200 len: 2510 microversion: 2.1 time: 0.061273 Aug 29 10:35:21.392674 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 171/364] 10.222.0.47 () {58 vars in 1335 bytes} [Mon Aug 29 10:35:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T10%3A35%3A20.519445&end=2022-08-30T10%3A35%3A20.519445&detailed=1 => generated 2510 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:35:21.398819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:21.399664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:21.407043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.407728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.408372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.409299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.414945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d08942-c152-4c43-a806-61ad692ed714", "tag": "c3ae8e87-ef11-4e59-a485-916ea3de6d7c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:21.416864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.417569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.434802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.438268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.438885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.460078 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] Creating event network-changed:c3ae8e87-ef11-4e59-a485-916ea3de6d7c for instance 13d08942-c152-4c43-a806-61ad692ed714 on n-h1-854121-10 Aug 29 10:35:21.465516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:35:21.465761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7db522d3-7129-455a-9dcf-7f288dc1e971 req-7b779751-5662-466b-a392-285dc8de2d53 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054248 Aug 29 10:35:21.466658 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 172/365] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:21.619350 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2fb6fd9f-657e-424c-ad10-6f253c1c9b54 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "DELETE /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 204 len: 0 microversion: 2.1 time: 0.223731 Aug 29 10:35:21.620536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 194/366] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:35:21 2022] DELETE /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:35:21.632128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:21.632920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:21.652871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.655075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.657141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.659315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:21.661528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:21.664448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:21.861153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:21.867040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:21.874125 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d81e4ad-0215-4217-a35b-73ef361bb924 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1469 microversion: 2.1 time: 0.248999 Aug 29 10:35:21.882200 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 173/367] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:21 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:22.063544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Action: 'update', calling method: .version_select at 0x7f66c755f700>, body: {"quota_set": {"ram": "2048"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:22.202958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:22.203541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:22.207487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:UPDATE=12,nova_api:DELETE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:22.213815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.214542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.215220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.216251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.216932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.217840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.378752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:22.387295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:22.388891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:22.390022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-011fc633-efc6-4c9b-9e9c-a9ff7de80984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.193016 Aug 29 10:35:22.394976 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 174/368] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:22 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:35:22.519366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.519848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.520452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.521178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.521817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.522248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.556525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.557162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.557689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.558659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.559194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.559715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.653469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a46fbbf-fd25-435d-a70e-a97fc50325f3 tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac?user_id=7544daf84056443e8f15a8f6c6198609" status: 200 len: 148 microversion: 2.57 time: 0.599960 Aug 29 10:35:22.654322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 195/369] 10.222.0.47 () {62 vars in 1384 bytes} [Mon Aug 29 10:35:22 2022] PUT /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac?user_id=7544daf84056443e8f15a8f6c6198609 => generated 148 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:22.664948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e36b40ce-1c29-4e6f-b68b-39e1a79cdc5d tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] Calling method '.version_select at 0x7f66c771c040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:22.898344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:22.899263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:22.911931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.918217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.918673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:22.919403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:22.919959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:22.920391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:23.257263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:23.265140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87a7476a-9c2b-410a-82c2-f34862b50415 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1469 microversion: 2.1 time: 0.370707 Aug 29 10:35:23.278740 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 196/370] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:22 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:23.375040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e36b40ce-1c29-4e6f-b68b-39e1a79cdc5d tempest-QuotasAdminTestV257-1407147792 tempest-QuotasAdminTestV257-1407147792-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac?user_id=7544daf84056443e8f15a8f6c6198609" status: 200 len: 190 microversion: 2.57 time: 0.713660 Aug 29 10:35:23.376494 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 175/371] 10.222.0.47 () {60 vars in 1364 bytes} [Mon Aug 29 10:35:22 2022] GET /compute/v2.1/os-quota-sets/d962a2695b3d42bca9d69cb4d7d657ac?user_id=7544daf84056443e8f15a8f6c6198609 => generated 190 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:23.412976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:23.413673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:23.422940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:23.428821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:23.429486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:23.431166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:23.432070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:23.435495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:23.676749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:23.686878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:23.689133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:23.691218 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69ec5dc7-207b-4c24-8320-04f6b8ebf94e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.282297 Aug 29 10:35:23.692468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 197/372] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:23 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:23.811638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681f33b8-d257-4db6-b999-ca2484ac1efa", "name": "network-vif-deleted", "tag": "ea257286-cbd0-457c-bd73-a26d8c870a98"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:23.831874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:23.833291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:23.834376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:23.851861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] Creating event network-vif-deleted:ea257286-cbd0-457c-bd73-a26d8c870a98 for instance 681f33b8-d257-4db6-b999-ca2484ac1efa on n-h2-854121-10 Aug 29 10:35:23.859053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dc19e840-1851-4b0e-bf3b-69452416bbb1 req-0e81f66e-8acf-44ad-9fce-f830a852db73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051773 Aug 29 10:35:23.860150 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 176/373] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:24.298265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:24.299324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:24.308927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:24.309408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:24.309871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:24.311477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:24.312164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:24.312772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:24.353429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:24.353969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:24.354409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:24.354911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lazy-loading 'fault' on Instance uuid 681f33b8-d257-4db6-b999-ca2484ac1efa {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:24.402398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4024838a7d442e69c2e650a9720d4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873f13601c7a4557a06a3fc972e7a8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:24.411804 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0bebaffa-a907-4dae-aafb-338f84512b18 tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 200 len: 1303 microversion: 2.1 time: 0.117360 Aug 29 10:35:24.412381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 198/374] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:24 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:24.721324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:24.721324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:24.725591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:24.726104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:24.726539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:24.727239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:24.727675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:24.728273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:24.884435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:24.896566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:24.898690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:24.901021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-401bfe1e-ebd1-48dd-910e-3db32c86ba86 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.186364 Aug 29 10:35:24.901856 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 177/375] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:24 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:25.453987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:25.457261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] [instance: 681f33b8-d257-4db6-b999-ca2484ac1efa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:25.479530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:25.482250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:25.483791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:25.485658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:25.488117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:25.488952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:25.523522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] HTTP exception thrown: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Request method failure captured: Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa HTTP/1.1 Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZUAyhESTcDM7vpe5by-Zy4DFImGjLrj8ED32RKGpFZCHH0zj4x13YJGMmk2F1RgPdo1gfk0CnhEp0L1PsEwYLa5sbmhIpMXzs3cpVAbhgRkhPwN_8MSHD6pGudzXwZOQrD1dC2_RbkiaC3CowpISzbhi0CmVOutgv1M_3YgcOJyGU Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 873f13601c7a4557a06a3fc972e7a8be Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TenantUsagesTestJSON-1933960986 Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:25.525867 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/873f13601c7a4557a06a3fc972e7a8be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_873f13601c7a4557a06a3fc972e7a8be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/873f13601c7a4557a06a3fc972e7a8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/873f13601c7a4557a06a3fc972e7a8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TenantUsagesTestJSON-1933960986 Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 873f13601c7a4557a06a3fc972e7a8be Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1933960986 Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TenantUsagesTestJSON-1933960986-project Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a4024838a7d442e69c2e650a9720d4ff Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TenantUsagesTestJSON-1933960986-project Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. Aug 29 10:35:25.527129 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '681f33b8-d257-4db6-b999-ca2484ac1efa'} Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:25.527796 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. Aug 29 10:35:25.528855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:25.529927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] Returning 404 to user: Instance 681f33b8-d257-4db6-b999-ca2484ac1efa could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:25.529927 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f69be76-c21b-4d2c-8bbb-b1f23a259a0b tempest-TenantUsagesTestJSON-1933960986 tempest-TenantUsagesTestJSON-1933960986-project] 10.222.0.47 "GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa" status: 404 len: 111 microversion: 2.1 time: 0.097446 Aug 29 10:35:25.530053 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 199/376] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:25 2022] GET /compute/v2.1/servers/681f33b8-d257-4db6-b999-ca2484ac1efa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:25.819810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Action: 'update', calling method: .version_select at 0x7f66c77f8700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:25.885215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f366756-0f1b-4c58-8a35-5877fe8098f9 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-31207818", "ram": 512, "vcpus": 1, "disk": 10, "id": 1954646206, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:25.912647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f366756-0f1b-4c58-8a35-5877fe8098f9 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.372939 Aug 29 10:35:25.921464 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 200/377] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:25.927749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fad78b2-8a7d-4afb-99ae-6ea9fdabe300 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:25.949346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:SAVEPOINT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:25.967179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fad78b2-8a7d-4afb-99ae-6ea9fdabe300 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044647 Aug 29 10:35:25.968167 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 201/378] 10.222.0.47 () {60 vars in 1224 bytes} [Mon Aug 29 10:35:25 2022] POST /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:35:25.973380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:25.974211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:25.982012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:25.982542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:25.983982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:25.985193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:25.985985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:25.987425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:26.225273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:26.241637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:26.244542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:26.246651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e316c623-6811-4628-8687-eb231341b37a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.277222 Aug 29 10:35:26.263394 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 202/379] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:25 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:26.491061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:26.492337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:26.494360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:26.495381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:26.497034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:26.497657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:26.596144 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c0bcdbf-f488-4154-9ba7-1dfcced5b13d tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5" status: 200 len: 240 microversion: 2.36 time: 1.084373 Aug 29 10:35:26.598026 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 178/380] 10.222.0.47 () {62 vars in 1303 bytes} [Mon Aug 29 10:35:25 2022] PUT /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5 => generated 240 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:27.071935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de1c898b-3307-47d4-8aac-625c3e3c76c7 tempest-FlavorsExtraSpecsTestJSON-2119603730 tempest-FlavorsExtraSpecsTestJSON-2119603730-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:27.072727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a81e5ff1-02cf-4f0c-be66-ebfc2e91ea9d tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Calling method '.version_select at 0x7f66c77edc10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:27.128050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de1c898b-3307-47d4-8aac-625c3e3c76c7 tempest-FlavorsExtraSpecsTestJSON-2119603730 tempest-FlavorsExtraSpecsTestJSON-2119603730-project] 10.222.0.47 "GET /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.862433 Aug 29 10:35:27.129310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 203/381] 10.222.0.47 () {58 vars in 1203 bytes} [Mon Aug 29 10:35:26 2022] GET /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:27.147559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Calling method '.version_select at 0x7f66c761c160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:27.208826 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a81e5ff1-02cf-4f0c-be66-ebfc2e91ea9d tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 371 microversion: 2.1 time: 0.608028 Aug 29 10:35:27.210525 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 179/382] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:35:26 2022] GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 371 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:27.220941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe064130-52eb-40d4-abb4-bc12303d4251 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:27.278568 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe064130-52eb-40d4-abb4-bc12303d4251 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066921 Aug 29 10:35:27.279609 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 180/383] 10.222.0.47 () {60 vars in 1224 bytes} [Mon Aug 29 10:35:27 2022] POST /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:27.284258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c772e700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:27.703322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:27.704379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:27.707062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:27.708498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:27.710129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:27.712529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:27.785169 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb664ed1-2006-4ac2-840a-425619db7283 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5/detail" status: 200 len: 672 microversion: 2.36 time: 0.654422 Aug 29 10:35:27.795873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 204/384] 10.222.0.47 () {60 vars in 1304 bytes} [Mon Aug 29 10:35:27 2022] GET /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5/detail => generated 672 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:27.804520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:27.805974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:27.815785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:27.816832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:27.821084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:27.822338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:27.823007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:27.823927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:28.141494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:28.143837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:28.144751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:28.145622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:28.146182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:28.147176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:28.177593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:28.194233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:28.197855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:28.204113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06b3fe55-cbbb-4a00-b601-cee86d9c091c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.404901 Aug 29 10:35:28.208114 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 205/385] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:27 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:28.234094 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-de994d56-04a6-4914-b28d-14085fca4d6a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 328 microversion: 2.1 time: 0.953387 Aug 29 10:35:28.234807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1df3a232-8dbc-42cf-a59d-7a5661e02d23 tempest-FlavorsExtraSpecsTestJSON-2119603730 tempest-FlavorsExtraSpecsTestJSON-2119603730-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.248113 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 181/386] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:27 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 328 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:28.256931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d08942-c152-4c43-a806-61ad692ed714", "name": "network-vif-plugged", "status": "completed", "tag": "c3ae8e87-ef11-4e59-a485-916ea3de6d7c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:28.259816 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1df3a232-8dbc-42cf-a59d-7a5661e02d23 tempest-FlavorsExtraSpecsTestJSON-2119603730 tempest-FlavorsExtraSpecsTestJSON-2119603730-project] 10.222.0.47 "GET /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045386 Aug 29 10:35:28.264489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 206/387] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:35:28 2022] GET /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes => generated 22 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:28.271449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:28.273739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:28.275711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:28.279271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dfcc517d-3917-4d63-922a-a4e64042c2e5 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:28.307312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] Creating event network-vif-plugged:c3ae8e87-ef11-4e59-a485-916ea3de6d7c for instance 13d08942-c152-4c43-a806-61ad692ed714 on n-h1-854121-10 Aug 29 10:35:28.319397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ffec8c6e-9dcf-43c8-bc95-f65a88601db4 req-567851df-a5de-4430-a6a5-ee8c79a0bfc6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066281 Aug 29 10:35:28.321657 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 182/388] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:28.359827 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dfcc517d-3917-4d63-922a-a4e64042c2e5 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090232 Aug 29 10:35:28.365110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 207/389] 10.222.0.47 () {60 vars in 1224 bytes} [Mon Aug 29 10:35:28 2022] POST /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:28.370832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f3c36642-e7b1-4062-a454-51668eaa0e70 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.382195 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f3c36642-e7b1-4062-a454-51668eaa0e70 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015316 Aug 29 10:35:28.386071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 183/390] 10.222.0.47 () {58 vars in 1203 bytes} [Mon Aug 29 10:35:28 2022] GET /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:35:28.396425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06e3aad9-af9b-4502-9c20-56be2753a0fd tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:28.454464 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06e3aad9-af9b-4502-9c20-56be2753a0fd tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.061442 Aug 29 10:35:28.456884 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 208/391] 10.222.0.47 () {60 vars in 1265 bytes} [Mon Aug 29 10:35:28 2022] PUT /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes => generated 22 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:35:28.467580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81e29636-5885-4bd6-b860-cb645599f02b tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.486750 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81e29636-5885-4bd6-b860-cb645599f02b tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019121 Aug 29 10:35:28.486750 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 184/392] 10.222.0.47 () {58 vars in 1203 bytes} [Mon Aug 29 10:35:28 2022] GET /compute/v2.1/flavors/1954646206/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:28.497046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39c385ae-5031-4dcd-bd6d-d33c6ab7e3f0 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.555204 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39c385ae-5031-4dcd-bd6d-d33c6ab7e3f0 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.062076 Aug 29 10:35:28.557583 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 209/393] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:35:28 2022] DELETE /compute/v2.1/flavors/1954646206/os-extra_specs/hw:numa_nodes => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:28.568593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb8b7c8e-e63d-46e1-8105-e07b99488b54 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.610108 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb8b7c8e-e63d-46e1-8105-e07b99488b54 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1954646206/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.047160 Aug 29 10:35:28.610671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 185/394] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:35:28 2022] DELETE /compute/v2.1/flavors/1954646206/os-extra_specs/hw:cpu_policy => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 10:35:28.620434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67de1c7c-76df-4a55-a032-2ec0dae92e45 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.630349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67de1c7c-76df-4a55-a032-2ec0dae92e45 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/1954646206/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013560 Aug 29 10:35:28.641933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-177449cf-50cc-417b-adcb-c37460be3389 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.647079 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 210/395] 10.222.0.47 () {58 vars in 1203 bytes} [Mon Aug 29 10:35:28 2022] GET /compute/v2.1/flavors/1954646206/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:28.672048 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-177449cf-50cc-417b-adcb-c37460be3389 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1954646206" status: 202 len: 0 microversion: 2.1 time: 0.034081 Aug 29 10:35:28.672940 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 186/396] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:35:28 2022] DELETE /compute/v2.1/flavors/1954646206 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:35:28.682974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d80aafe-eafa-46ca-a052-8714b8b77397 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:28.721224 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d80aafe-eafa-46ca-a052-8714b8b77397 tempest-FlavorsExtraSpecsTestJSON-854695234 tempest-FlavorsExtraSpecsTestJSON-854695234-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042327 Aug 29 10:35:28.734956 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 211/397] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:35:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:29.234121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:29.234830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:29.246974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:29.248097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:29.249567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:29.250559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:29.252931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:29.255244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:29.293044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-488288478", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:29.388201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:30.035313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:30.046703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:30.048433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:30.054603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1700e99a-8c02-49eb-9cf5-54dcc344a2c1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1360 microversion: 2.25 time: 0.826377 Aug 29 10:35:30.056385 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 212/398] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:29 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1360 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:30.065332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Action: 'update', calling method: .version_select at 0x7f66c750a5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:30.133618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:30.134074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:30.134592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:30.135001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:30.135411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:30.147505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.152452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.152957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.155840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.156588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.157178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.182596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:30.207630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for user 59aaf14b01eb4ee6abbb318c7c4f057c and project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:30.258757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.utils [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] cores quota exceeded for 259b6916e4ca41069796b6c41a3f2805, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128682) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 10:35:30.262036 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Request method failure captured: Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 144 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZsttL-veO0tnYR27XD5H34DrQr8wxhtg3dUcjVPKa7ndOxqDmp6UAR9FcSnHHkO8MDHUbDyxmMup4K9yDgIK22yE82A0mGTqf7zqelrogQ2loHrQc_IfWDN0yBE9Nn1pM6Mb_GtNvWB0HTdlhiW3RsYH_8S1QQAGDXWeu2iIp_gCM Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:30.277422 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 59aaf14b01eb4ee6abbb318c7c4f057c Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-488288478", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} Aug 29 10:35:30.278718 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-488288478', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452'}}} Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 10:35:30.279436 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:30.280580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.281982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 10:35:30.284502 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:30.287308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:30.290736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4da14a55-f86d-4d7a-92bf-463c48eb647f tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.598529 Aug 29 10:35:30.297100 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 187/399] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:28 2022] POST /compute/v2.1/servers => generated 111 bytes in 1607 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:30.620546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.624004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.624656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.632049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.633575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.634448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.725354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.726174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.726818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.728320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:30.728849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:30.729501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:30.821003 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea13312c-cc46-4ebb-a53b-416930281410 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5?user_id=d513ccaf6af44fd3a1aed0a59d51ea36" status: 200 len: 240 microversion: 2.36 time: 0.762048 Aug 29 10:35:30.821670 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 213/400] 10.222.0.47 () {62 vars in 1384 bytes} [Mon Aug 29 10:35:30 2022] PUT /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5?user_id=d513ccaf6af44fd3a1aed0a59d51ea36 => generated 240 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:30.833347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c7517940>, body: {"quota_set": {"cores": 20}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:30.992034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Calling method '.version_select at 0x7f66c77f8c10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:30.999489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.000824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.002721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.004413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.005542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.006640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.083352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf3caa78-3daf-4751-9b4a-39e58029b83b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.784307 Aug 29 10:35:31.086110 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 188/401] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:35:30 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:31.102866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89c15310-598b-4034-a72a-871708c7a488 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] Calling method '.version_select at 0x7f66c7adeee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:31.572467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.573254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.578875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.581745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.582530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.584024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.783887 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7fab8f4a-fcf4-42a5-8b29-180e86e59fee tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 329 microversion: 2.1 time: 0.959998 Aug 29 10:35:31.786293 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 214/402] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:30 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 329 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:31.803392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:31.804466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:31.826131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.828329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.829479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.831627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:31.832357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:31.832894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:31.997821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89c15310-598b-4034-a72a-871708c7a488 tempest-QuotasAdminTestV236-1298147678 tempest-QuotasAdminTestV236-1298147678-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5?user_id=d513ccaf6af44fd3a1aed0a59d51ea36" status: 200 len: 282 microversion: 2.36 time: 0.909587 Aug 29 10:35:31.999386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 189/403] 10.222.0.47 () {60 vars in 1364 bytes} [Mon Aug 29 10:35:31 2022] GET /compute/v2.1/os-quota-sets/5dae96a8b42b4c988a16ca990a3c3cc5?user_id=d513ccaf6af44fd3a1aed0a59d51ea36 => generated 282 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:32.272744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:32.282573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:32.284643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:32.285842 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bd51928-60d8-4059-8902-4d0f62555ed5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1556 microversion: 2.25 time: 0.498107 Aug 29 10:35:32.308604 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 215/404] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:31 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1556 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:32.315131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a7c9190-ba68-4766-bfe0-6464a86e6707 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Calling method '.version_select at 0x7f66c76bbee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:32.434145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a30bed2-7613-498c-a58c-f97357a2c09b tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Calling method '.version_select at 0x7f66c76a2160>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:32.437854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5a30bed2-7613-498c-a58c-f97357a2c09b tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a30bed2-7613-498c-a58c-f97357a2c09b tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:32.441367 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: action_args: {} Aug 29 10:35:32.442865 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:32.443755 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 10:35:32.445024 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.446941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a30bed2-7613-498c-a58c-f97357a2c09b tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:32.447776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a30bed2-7613-498c-a58c-f97357a2c09b tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.447238 Aug 29 10:35:32.452828 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 190/405] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:35:31 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 448 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:32.912828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17d64c22-36ea-4356-bf00-6fb042c1e11e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Calling method '.version_select at 0x7f66c78f9dc0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:32.936329 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-17d64c22-36ea-4356-bf00-6fb042c1e11e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17d64c22-36ea-4356-bf00-6fb042c1e11e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/a5f1bd39-6acf-4d7b-84d2-f3150bcc4386/metadata/os_distro HTTP/1.1 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:32.950326 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'image_id': 'a5f1bd39-6acf-4d7b-84d2-f3150bcc4386', 'id': 'os_distro'} Aug 29 10:35:32.951599 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:32.952327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a5f1bd39-6acf-4d7b-84d2-f3150bcc4386 Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:32.953334 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5f1bd39-6acf-4d7b-84d2-f3150bcc4386 could not be found. Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:32.956011 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:32.957940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17d64c22-36ea-4356-bf00-6fb042c1e11e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:32.960766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-17d64c22-36ea-4356-bf00-6fb042c1e11e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "DELETE /compute/v2.1/images/a5f1bd39-6acf-4d7b-84d2-f3150bcc4386/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.502334 Aug 29 10:35:32.960766 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 191/406] 10.222.0.47 () {58 vars in 1293 bytes} [Mon Aug 29 10:35:32 2022] DELETE /compute/v2.1/images/a5f1bd39-6acf-4d7b-84d2-f3150bcc4386/metadata/os_distro => generated 62 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:33.095935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:RELEASE=7,nova_api:SAVEPOINT=6,nova_api:INSERT=3,nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:33.129968 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a7c9190-ba68-4766-bfe0-6464a86e6707 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 371 microversion: 2.1 time: 0.819200 Aug 29 10:35:33.130566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 216/407] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:35:32 2022] GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:33.143769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7df569a-bb3b-44de-bcf5-10291d231606 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Calling method '.version_select at 0x7f66c74d4d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.145573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f7df569a-bb3b-44de-bcf5-10291d231606 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7df569a-bb3b-44de-bcf5-10291d231606 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hosts/n-d-854121-10/reboot HTTP/1.1 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:33.147549 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10'} Aug 29 10:35:33.149131 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:33.150045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 10:35:33.151338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.154003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7df569a-bb3b-44de-bcf5-10291d231606 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:33.155125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f7df569a-bb3b-44de-bcf5-10291d231606 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-854121-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017349 Aug 29 10:35:33.156193 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 217/408] 10.222.0.47 () {58 vars in 1191 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/os-hosts/n-d-854121-10/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:33.163780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cddb90e8-edab-4e51-ac38-e5fac168354f tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Calling method '.version_select at 0x7f66c74a61f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.205934 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-cddb90e8-edab-4e51-ac38-e5fac168354f tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cddb90e8-edab-4e51-ac38-e5fac168354f tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/images/6600044d-c05d-4314-b11a-581f508fcb04/metadata/os_version HTTP/1.1 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:33.212321 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'image_id': '6600044d-c05d-4314-b11a-581f508fcb04', 'id': 'os_version'} Aug 29 10:35:33.213987 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:33.214853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6600044d-c05d-4314-b11a-581f508fcb04 Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:33.216058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6600044d-c05d-4314-b11a-581f508fcb04 could not be found. Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:33.217195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.218352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cddb90e8-edab-4e51-ac38-e5fac168354f tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:33.221238 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cddb90e8-edab-4e51-ac38-e5fac168354f tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "GET /compute/v2.1/images/6600044d-c05d-4314-b11a-581f508fcb04/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058096 Aug 29 10:35:33.222538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 218/409] 10.222.0.47 () {58 vars in 1293 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/images/6600044d-c05d-4314-b11a-581f508fcb04/metadata/os_version => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:33.430527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.431439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:33.452982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.454322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.455797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.457433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.457961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.458338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.603541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.607337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.608433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.612236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.613006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.614266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.614780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.681143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b3dbda7-23ab-4c25-9646-7bdab85bb8ed tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.456934 Aug 29 10:35:33.681936 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 219/410] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/os-services => generated 949 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:33.687185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c750ab80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:33.719035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 13d08942-c152-4c43-a806-61ad692ed714 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:33.823727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0616781-d4dd-4802-b105-a06ddf0b1e0f tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 2049 microversion: 2.25 time: 0.870286 Aug 29 10:35:33.831416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 192/411] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:32 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 2049 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:33.836786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16f3410a-86fb-486e-b34d-2486a6b0b087 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Calling method '.version_select at 0x7f66c7921430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.859433 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-16f3410a-86fb-486e-b34d-2486a6b0b087 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16f3410a-86fb-486e-b34d-2486a6b0b087 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:35:33.863575 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'nonexistent_hostname'} Aug 29 10:35:33.866686 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:33.867661 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 10:35:33.868839 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16f3410a-86fb-486e-b34d-2486a6b0b087 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16f3410a-86fb-486e-b34d-2486a6b0b087 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032117 Aug 29 10:35:33.869899 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 193/412] 10.222.0.47 () {58 vars in 1212 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:33.877118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1e9178f-4817-4b84-902d-37b7e1c9e7fc tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Calling method '.version_select at 0x7f66c76a29d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.914530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a1e9178f-4817-4b84-902d-37b7e1c9e7fc tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1e9178f-4817-4b84-902d-37b7e1c9e7fc tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/images/a39484d7-843e-4000-9ada-791cb1693173/metadata HTTP/1.1 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:33.917855 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'image_id': 'a39484d7-843e-4000-9ada-791cb1693173'} Aug 29 10:35:33.919186 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:33.919907 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a39484d7-843e-4000-9ada-791cb1693173 Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:33.920951 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a39484d7-843e-4000-9ada-791cb1693173 could not be found. Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:33.922064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:33.923095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1e9178f-4817-4b84-902d-37b7e1c9e7fc tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:33.924811 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1e9178f-4817-4b84-902d-37b7e1c9e7fc tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "GET /compute/v2.1/images/a39484d7-843e-4000-9ada-791cb1693173/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055861 Aug 29 10:35:33.929864 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 194/413] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/images/a39484d7-843e-4000-9ada-791cb1693173/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:33.938386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:33.951073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.951773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.952146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.953067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:33.955404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:33.956422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:33.995007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:34.043368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33665cfc-461b-4cae-9fd5-b451733047f7 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.111888 Aug 29 10:35:34.044433 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 195/414] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:35:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:34.074815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.077111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:34.086897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.087656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.088541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.089453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.090094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.090678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.387399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 13d08942-c152-4c43-a806-61ad692ed714 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:34.415366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.415941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.416621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.419183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.421297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.421791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.429581 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b3ffeb0-0887-4644-90fe-83d7c02a9962 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 2049 microversion: 2.25 time: 0.367543 Aug 29 10:35:34.438639 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 196/415] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 2049 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:34.454161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3707021c-4ef7-4c60-9511-c962b385c2e3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Calling method '.version_select at 0x7f66c78f9ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.457805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3707021c-4ef7-4c60-9511-c962b385c2e3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3707021c-4ef7-4c60-9511-c962b385c2e3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hosts/n-d-854121-10 HTTP/1.1 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:34.464157 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'n-d-854121-10'} Aug 29 10:35:34.465757 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:34.466735 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 10:35:34.468061 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.469262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3707021c-4ef7-4c60-9511-c962b385c2e3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.469262 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3707021c-4ef7-4c60-9511-c962b385c2e3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-854121-10" status: 403 len: 109 microversion: 2.1 time: 0.028115 Aug 29 10:35:34.469529 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 197/416] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-hosts/n-d-854121-10 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:34.479931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdae154e-3636-424d-85e8-bdc57151761c tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Action: 'update_all', calling method: .version_select at 0x7f66c76259d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:34.511790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cdae154e-3636-424d-85e8-bdc57151761c tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdae154e-3636-424d-85e8-bdc57151761c tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/images/da60a3c3-10a1-43db-9ff7-130b82871597/metadata HTTP/1.1 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 57 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:34.515359 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:34.517234 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'image_id': 'da60a3c3-10a1-43db-9ff7-130b82871597', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.518274 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da60a3c3-10a1-43db-9ff7-130b82871597 Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.519788 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da60a3c3-10a1-43db-9ff7-130b82871597 could not be found. Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.521277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:34.522581 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.529900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdae154e-3636-424d-85e8-bdc57151761c tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.529900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdae154e-3636-424d-85e8-bdc57151761c tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "PUT /compute/v2.1/images/da60a3c3-10a1-43db-9ff7-130b82871597/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051782 Aug 29 10:35:34.529900 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 198/417] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:35:34 2022] PUT /compute/v2.1/images/da60a3c3-10a1-43db-9ff7-130b82871597/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:34.531984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.536797 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92b3c9bf-8d80-43df-96e9-9fcba189049a tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 328 microversion: 2.1 time: 0.853551 Aug 29 10:35:34.537202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.537900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.538978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.539908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.540371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.540798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.550261 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 220/418] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:33 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 328 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:34.559874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.569388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.569912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.571567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.572703 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c70b7b9b-fdcf-426c-85c4-20da9ad33840 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044688 Aug 29 10:35:34.573816 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 199/419] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-services => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:34.580291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.581072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.581518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.585769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26ffb0d0-f65e-47d9-8cb2-39da04ca55a4 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Calling method '.version_select at 0x7f66c76a20d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.594606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-26ffb0d0-f65e-47d9-8cb2-39da04ca55a4 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26ffb0d0-f65e-47d9-8cb2-39da04ca55a4 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:35:34.598522 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'nonexistent_hostname'} Aug 29 10:35:34.600024 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.601227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.602580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.606707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26ffb0d0-f65e-47d9-8cb2-39da04ca55a4 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.607865 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-26ffb0d0-f65e-47d9-8cb2-39da04ca55a4 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032830 Aug 29 10:35:34.609061 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 200/420] 10.222.0.47 () {58 vars in 1191 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:34.617266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab2d562e-6cc8-456c-bf16-aac121b03b3a tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Action: 'update', calling method: .version_select at 0x7f66c7625f70>, body: {"meta": {"os_distro": "alt"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:34.655218 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ab2d562e-6cc8-456c-bf16-aac121b03b3a tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:34.656747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b296b85-50ab-4a60-a989-fb21dbdeee9c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.105328 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab2d562e-6cc8-456c-bf16-aac121b03b3a tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/images/e379b184-2b9e-4b28-8d05-fc8095cc0c5c/metadata/os_distro HTTP/1.1 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 30 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:34.660507 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: {"meta": {"os_distro": "alt"}} Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:35:34.661785 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'image_id': 'e379b184-2b9e-4b28-8d05-fc8095cc0c5c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.662584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e379b184-2b9e-4b28-8d05-fc8095cc0c5c Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.663555 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e379b184-2b9e-4b28-8d05-fc8095cc0c5c could not be found. Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.664810 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:34.667225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.674588 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 221/421] 10.222.0.47 () {60 vars in 1217 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:35:34.675063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab2d562e-6cc8-456c-bf16-aac121b03b3a tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.675063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab2d562e-6cc8-456c-bf16-aac121b03b3a tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "PUT /compute/v2.1/images/e379b184-2b9e-4b28-8d05-fc8095cc0c5c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.051651 Aug 29 10:35:34.675063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 201/422] 10.222.0.47 () {60 vars in 1310 bytes} [Mon Aug 29 10:35:34 2022] PUT /compute/v2.1/images/e379b184-2b9e-4b28-8d05-fc8095cc0c5c/metadata/os_distro => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:34.675063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-839a8ab3-1176-40f0-807c-a35b0ee4af1e tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Calling method '.version_select at 0x7f66c77edaf0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.675491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-839a8ab3-1176-40f0-807c-a35b0ee4af1e tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-839a8ab3-1176-40f0-807c-a35b0ee4af1e tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-hosts/n-d-854121-10/shutdown HTTP/1.1 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:34.676288 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'n-d-854121-10'} Aug 29 10:35:34.678066 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:34.679006 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 10:35:34.680247 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.681196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-839a8ab3-1176-40f0-807c-a35b0ee4af1e tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.681196 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-839a8ab3-1176-40f0-807c-a35b0ee4af1e tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-854121-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.013857 Aug 29 10:35:34.681343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.681426 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 202/423] 10.222.0.47 () {58 vars in 1197 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-hosts/n-d-854121-10/shutdown => generated 113 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:34.685661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-10", "block_migration": "auto"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:34.687315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.689623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:34.689757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.690379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.691147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.691609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.692039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.697973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.699289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.699744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.700457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.700912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.701337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.754809 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8eeac9b-d012-40aa-a37e-e21d063d05b9 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-854121-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.091088 Aug 29 10:35:34.755861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 222/424] 10.222.0.47 () {58 vars in 1196 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-services?host=n-d-854121-10&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:34.761615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e8cba31-16e4-453c-b933-f1b7b61a656e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Action: 'create', calling method: .version_select at 0x7f66c7485ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:34.809896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8e8cba31-16e4-453c-b933-f1b7b61a656e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] HTTP exception thrown: Image not found. Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e8cba31-16e4-453c-b933-f1b7b61a656e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Request method failure captured: Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/images/83614e74-e5dc-47cc-af9b-668ef4723170/metadata HTTP/1.1 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 57 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZzVVBAfvjcBVLSGgz8Jy4hHgv7wO9nymTtyAo-6inatO5be4UOHy3RT42O-V-mQzZlo8dTxg5pgZndkyRzjtEtK0jE3VXa5RK1Qv_41Xnb4WnWQVIXr0CmOV0BfHWSbAODIOrIcS9WuA6Mso8IfikYP5I9PmNiJTRZhS8t5xBpcSw Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:34.812935 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d88c0cf354374fecbb7a7c27efb5b0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: d88c0cf354374fecbb7a7c27efb5b0d0 Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397 Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 36d9286c41824a15aa9b153820fdaebf Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1764338397-project Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:35:34.814873 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'image_id': '83614e74-e5dc-47cc-af9b-668ef4723170', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.817342 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83614e74-e5dc-47cc-af9b-668ef4723170 Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:34.818387 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83614e74-e5dc-47cc-af9b-668ef4723170 could not be found. Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.819444 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:34.822045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.825819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e8cba31-16e4-453c-b933-f1b7b61a656e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.825819 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e8cba31-16e4-453c-b933-f1b7b61a656e tempest-ImagesMetadataNegativeTestJSON-1764338397 tempest-ImagesMetadataNegativeTestJSON-1764338397-project] 10.222.0.47 "POST /compute/v2.1/images/83614e74-e5dc-47cc-af9b-668ef4723170/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058167 Aug 29 10:35:34.825819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 223/425] 10.222.0.47 () {60 vars in 1281 bytes} [Mon Aug 29 10:35:34 2022] POST /compute/v2.1/images/83614e74-e5dc-47cc-af9b-668ef4723170/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:34.827419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e71cb1ed-3194-48b8-9ba0-f346e99eefe5 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Calling method '.version_select at 0x7f66c74a6040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.844309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e71cb1ed-3194-48b8-9ba0-f346e99eefe5 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e71cb1ed-3194-48b8-9ba0-f346e99eefe5 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:34.847401 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'nonexistent_hostname'} Aug 29 10:35:34.848642 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:34.849478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 10:35:34.850590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:34.852073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e71cb1ed-3194-48b8-9ba0-f346e99eefe5 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:34.853383 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e71cb1ed-3194-48b8-9ba0-f346e99eefe5 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.034930 Aug 29 10:35:34.861302 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 224/426] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:34.863865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'flavor' on Instance uuid 13d08942-c152-4c43-a806-61ad692ed714 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:35:34.867011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:34.880555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.881114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.881619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.882603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:34.884373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:34.885679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:34.955491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Going to try to live migrate instance to n-h2-854121-10 {{(pid=128682) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:35:34.962564 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-731a7e0c-17b7-4db8-a70c-ce2c6de4ed32 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.104509 Aug 29 10:35:34.964665 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 225/427] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:35:34 2022] GET /compute/v2.1/os-services => generated 949 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:34.977242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627248550", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:35.106121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:35.688929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:35.689823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:35.689823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:35.690232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:35.690645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:35.700767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:35.703112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:35.703598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:35.704033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:35.705341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:35.717614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:35.718477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:35.760846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:35.771278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for user 59aaf14b01eb4ee6abbb318c7c4f057c and project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:35.797548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.utils [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] instances quota exceeded for 259b6916e4ca41069796b6c41a3f2805, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128681) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 10:35:35.798864 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Request method failure captured: Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 145 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZsttL-veO0tnYR27XD5H34DrQr8wxhtg3dUcjVPKa7ndOxqDmp6UAR9FcSnHHkO8MDHUbDyxmMup4K9yDgIK22yE82A0mGTqf7zqelrogQ2loHrQc_IfWDN0yBE9Nn1pM6Mb_GtNvWB0HTdlhiW3RsYH_8S1QQAGDXWeu2iIp_gCM Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:35.811751 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 59aaf14b01eb4ee6abbb318c7c4f057c Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627248550", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} Aug 29 10:35:35.813374 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1627248550', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452'}}} Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 10:35:35.814531 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:35.815760 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.817084 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 10:35:35.819039 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.822289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:35.822289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-872bbb2d-8016-4dc0-811e-d1a11c0acf56 tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.855598 Aug 29 10:35:35.822289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 226/428] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:34 2022] POST /compute/v2.1/servers => generated 119 bytes in 857 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:35.829338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4741480c-48cc-4bfd-94a6-062ee60ff8d3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Calling method '.version_select at 0x7f66c7570790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:35.840805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4741480c-48cc-4bfd-94a6-062ee60ff8d3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4741480c-48cc-4bfd-94a6-062ee60ff8d3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hosts/n-d-854121-10/startup HTTP/1.1 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:35.842869 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10'} Aug 29 10:35:35.844277 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:35.845165 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 10:35:35.847454 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:35.849267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4741480c-48cc-4bfd-94a6-062ee60ff8d3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:35.850319 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4741480c-48cc-4bfd-94a6-062ee60ff8d3 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-854121-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.026768 Aug 29 10:35:35.864273 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 227/429] 10.222.0.47 () {58 vars in 1194 bytes} [Mon Aug 29 10:35:35 2022] GET /compute/v2.1/os-hosts/n-d-854121-10/startup => generated 110 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:35.876383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:35.890488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:35.893487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:35.894620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:35.898734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:35.900423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:35.904136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:36.005733 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c70f0a0-ff91-44f5-b6ec-c913bba13f86 tempest-ServicesAdminNegativeTestJSON-1279775985 tempest-ServicesAdminNegativeTestJSON-1279775985-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.140418 Aug 29 10:35:36.006361 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 228/430] 10.222.0.47 () {58 vars in 1198 bytes} [Mon Aug 29 10:35:35 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:36.014561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c75ccaf0>, body: {"quota_set": {"instances": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:36.459661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:36.462360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:36.463732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:36.464747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:36.465624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:36.467503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:36.589834 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7cdcd1f7-9178-4d8a-8e08-dadc905dd6c9 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 329 microversion: 2.1 time: 0.582301 Aug 29 10:35:36.591246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 229/431] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:36 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 329 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:36.600649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b088d2a-55ae-47ca-b2dc-0cb451c72805 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Calling method '.version_select at 0x7f66c750a8b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:36.615940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5b088d2a-55ae-47ca-b2dc-0cb451c72805 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b088d2a-55ae-47ca-b2dc-0cb451c72805 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:36.619431 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'nonexistent_hostname'} Aug 29 10:35:36.620709 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:36.621446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 10:35:36.622561 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:36.623620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b088d2a-55ae-47ca-b2dc-0cb451c72805 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:36.624378 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b088d2a-55ae-47ca-b2dc-0cb451c72805 tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.031878 Aug 29 10:35:36.629515 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 230/432] 10.222.0.47 () {58 vars in 1215 bytes} [Mon Aug 29 10:35:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:37.068539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb346e67-4f54-419b-820f-c3ef826cd514 tempest-ServicesAdminNegativeTestJSON-767584410 tempest-ServicesAdminNegativeTestJSON-767584410-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:37.079088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fb346e67-4f54-419b-820f-c3ef826cd514 tempest-ServicesAdminNegativeTestJSON-767584410 tempest-ServicesAdminNegativeTestJSON-767584410-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c5c621416c7d4023b288abc9ed27ab5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9917aa055fbb4f5b812b1784ab29bce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb346e67-4f54-419b-820f-c3ef826cd514 tempest-ServicesAdminNegativeTestJSON-767584410 tempest-ServicesAdminNegativeTestJSON-767584410-project] Request method failure captured: Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZy3E43VbD8tqNAV4UH7_0ouWTehWqkZhZfiXgNWNfKYfq-GXlkxWmZu8ByNmn7KPvcZOWyrFomtruP7I1L0QqteKeQH7bzA0XouF-wXHxb-rOqByEG7iwEwv_GUppRckSH8BoW9_20hvQ2fVIa92SVlmkU6wXG_vBevp8tbDV2gFU Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 9917aa055fbb4f5b812b1784ab29bce4 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-767584410 Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:37.084047 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9917aa055fbb4f5b812b1784ab29bce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9917aa055fbb4f5b812b1784ab29bce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9917aa055fbb4f5b812b1784ab29bce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9917aa055fbb4f5b812b1784ab29bce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-767584410 Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 9917aa055fbb4f5b812b1784ab29bce4 Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-767584410 Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServicesAdminNegativeTestJSON-767584410-project Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c5c621416c7d4023b288abc9ed27ab5b Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-767584410-project Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:35:37.085337 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:37.086278 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:35:37.087477 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.088882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb346e67-4f54-419b-820f-c3ef826cd514 tempest-ServicesAdminNegativeTestJSON-767584410 tempest-ServicesAdminNegativeTestJSON-767584410-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:37.090309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb346e67-4f54-419b-820f-c3ef826cd514 tempest-ServicesAdminNegativeTestJSON-767584410 tempest-ServicesAdminNegativeTestJSON-767584410-project] 10.222.0.47 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.460153 Aug 29 10:35:37.091014 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 231/433] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:35:36 2022] GET /compute/v2.1/os-services => generated 112 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:37.105334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b5024fe-2c96-47df-9724-c2602d8aa863 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Calling method '.version_select at 0x7f66c73e3550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:37.863495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b5024fe-2c96-47df-9724-c2602d8aa863 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 371 microversion: 2.1 time: 0.771060 Aug 29 10:35:37.877970 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 232/434] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:35:37 2022] GET /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 371 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:37.884514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60510532-fa28-4346-9000-0e2075cb6f3b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Action: 'update', calling method: .version_select at 0x7f66c750ad30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60510532-fa28-4346-9000-0e2075cb6f3b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-hosts/n-d-854121-10 HTTP/1.1 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 51 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:37.898521 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: {"status": "enable", "maintenance_mode": "invalid"} Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:37.900103 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance: Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:37.900957 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:37.902768 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:37.904138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:37.904138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:35:37.904138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:35:37.904138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:37.904138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:37.915182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60510532-fa28-4346-9000-0e2075cb6f3b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:37.917411 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60510532-fa28-4346-9000-0e2075cb6f3b tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-854121-10" status: 400 len: 199 microversion: 2.1 time: 0.038086 Aug 29 10:35:37.918389 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 233/435] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:35:37 2022] PUT /compute/v2.1/os-hosts/n-d-854121-10 => generated 199 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:35:37.940120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c73e3e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:38.738864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:38.739417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:38.740683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:38.741476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:38.744800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:38.746024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:38.893134 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e6435891-eb6c-4d5d-8a2b-99d70fcf8d21 tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 325 microversion: 2.1 time: 0.970430 Aug 29 10:35:38.894480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 234/436] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:37 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 325 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:38.902299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e98c8588-04fb-4705-ad4a-7899a71f49be tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Action: 'update', calling method: .version_select at 0x7f66c73e3f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e98c8588-04fb-4705-ad4a-7899a71f49be tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-hosts/n-d-854121-10 HTTP/1.1 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 51 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:38.918352 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: {"status": "invalid", "maintenance_mode": "enable"} Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:38.919934 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance: Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:38.920706 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:38.924068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e98c8588-04fb-4705-ad4a-7899a71f49be tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:38.926359 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e98c8588-04fb-4705-ad4a-7899a71f49be tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-854121-10" status: 400 len: 189 microversion: 2.1 time: 0.023951 Aug 29 10:35:38.927110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 235/437] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:35:38 2022] PUT /compute/v2.1/os-hosts/n-d-854121-10 => generated 189 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:35:38.940755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90759b47-e535-4138-83ca-4a4c6ab4db01 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Action: 'update', calling method: .version_select at 0x7f66c750adc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:38.945293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-90759b47-e535-4138-83ca-4a4c6ab4db01 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '3f9a00d73e6f43faae00b7d563c9102f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7874512584f48a12cbd5e43d0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90759b47-e535-4138-83ca-4a4c6ab4db01 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Request method failure captured: Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-hosts/n-d-854121-10 HTTP/1.1 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 50 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZuqpGdSI_jV19ZydyxXcFqH6kTgWvj87S1JRIc2QlPzwAbb_0Z8dfE9aPIluS3T-mWMP9R_MGL4vI_0JpT0WIl-7eTS-ke2uBhf4yoABdknCdoJCg-YviIkSrJBklPn1YrEc-D_Inpkm4pfUTSbQ5BWi8YWzxpcAAB7LnlUtVjEo8 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:38.947327 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5b7874512584f48a12cbd5e43d0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f5b7874512584f48a12cbd5e43d0aec6 Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-488850429 Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 3f9a00d73e6f43faae00b7d563c9102f Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-488850429-project Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 10:35:38.948629 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:38.949868 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 10:35:38.951252 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:38.954573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90759b47-e535-4138-83ca-4a4c6ab4db01 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:38.962311 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90759b47-e535-4138-83ca-4a4c6ab4db01 tempest-HostsAdminNegativeTestJSON-488850429 tempest-HostsAdminNegativeTestJSON-488850429-project] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-854121-10" status: 403 len: 111 microversion: 2.1 time: 0.027088 Aug 29 10:35:38.963691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 236/438] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:35:38 2022] PUT /compute/v2.1/os-hosts/n-d-854121-10 => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:35:39.002362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f36884f5-3dc6-4fcc-a02e-c570772bb0cd tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Action: 'update', calling method: .version_select at 0x7f66c7bf8280>, body: {"status": null, "maintenance_mode": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f36884f5-3dc6-4fcc-a02e-c570772bb0cd tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-hosts/n-d-854121-10 HTTP/1.1 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 42 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:39.008159 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: {"status": null, "maintenance_mode": null} Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 10:35:39.009688 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'n-d-854121-10', 'body': {'status': None, 'maintenance_mode': None}} Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance: Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi None Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:39.011174 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:39.012572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:39.013897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:35:39.013897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:35:39.013897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 10:35:39.013897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.019594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f36884f5-3dc6-4fcc-a02e-c570772bb0cd tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:39.021825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f36884f5-3dc6-4fcc-a02e-c570772bb0cd tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-854121-10" status: 400 len: 127 microversion: 2.1 time: 0.050981 Aug 29 10:35:39.028790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 237/439] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 29 10:35:38 2022] PUT /compute/v2.1/os-hosts/n-d-854121-10 => generated 127 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:35:39.040376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Action: 'update', calling method: .version_select at 0x7f66c750a670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:39.047508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.hosts [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Enabling host nonexistent_hostname. Aug 29 10:35:39.068512 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Request method failure captured: Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 50 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZxLBEWI6yYoxy1ghWrzu_YM55bWmzb14Kct-xtd3Hgq86f3YdrYxC35Ue32o8FG9l95p_LoXhkXeZHjotRb6uCJNZrLyj47u4vIjutVq2arvt52Y9uQrm16Cq4tAM_SRviZF440nSS8aeyPmCVa746dm5zXLfQBLmUee54YHgqKUk Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:39.070561 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b334a9c080cc462ba14f34ec40da5fa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: b334a9c080cc462ba14f34ec40da5fa8 Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-787718670 Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f5bebdfab17042a1b1bbd881967dd402 Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-HostsAdminNegativeTestJSON-787718670-project-admin Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:39.071805 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 10:35:39.072620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:39.073652 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 10:35:39.074836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:39.078667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:39.083957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1cadb21b-fcec-4064-ab5d-148126dbee4f tempest-HostsAdminNegativeTestJSON-787718670 tempest-HostsAdminNegativeTestJSON-787718670-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046713 Aug 29 10:35:39.093625 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 238/440] 10.222.0.47 () {60 vars in 1211 bytes} [Mon Aug 29 10:35:39 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:39.549493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-609038344", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:39.651123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:40.190283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:40.191310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:40.191943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:40.192525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:40.193097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:40.207684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:40.208551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:40.209166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:40.210091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:40.210721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:40.211496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:40.224115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:40.237977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:40.250652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Getting quotas for user 59aaf14b01eb4ee6abbb318c7c4f057c and project 259b6916e4ca41069796b6c41a3f2805. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:40.294031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:40.306597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.utils [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] ram quota exceeded for 259b6916e4ca41069796b6c41a3f2805, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128681) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 10:35:40.309471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Request method failure captured: Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 144 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZsttL-veO0tnYR27XD5H34DrQr8wxhtg3dUcjVPKa7ndOxqDmp6UAR9FcSnHHkO8MDHUbDyxmMup4K9yDgIK22yE82A0mGTqf7zqelrogQ2loHrQc_IfWDN0yBE9Nn1pM6Mb_GtNvWB0HTdlhiW3RsYH_8S1QQAGDXWeu2iIp_gCM Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:40.312395 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 59aaf14b01eb4ee6abbb318c7c4f057c Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-609038344", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} Aug 29 10:35:40.314076 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-609038344', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452'}}} Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 10:35:40.315323 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:40.316491 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.318233 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 10:35:40.319672 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:40.324377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:40.325680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fba7454d-127a-4f84-9c40-aeb5b3c0c5ff tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.782716 Aug 29 10:35:40.326843 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 239/441] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 784 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:40.346588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Action: 'update', calling method: .version_select at 0x7f66c750a820>, body: {"quota_set": {"ram": 51200}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:40.645058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:40.645546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:40.646042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:40.647925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:40.653266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:40.653938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:40.761205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-932f2ad7-a822-4a9c-99a9-947a5887822f tempest-QuotasAdminNegativeTest-236166557 tempest-QuotasAdminNegativeTest-236166557-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 200 len: 329 microversion: 2.1 time: 0.422724 Aug 29 10:35:40.761865 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 240/442] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:40 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 329 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:41.056334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42ad0d42-193d-41fb-8482-2380af453b49 tempest-ListImageFiltersNegativeTestJSON-1898206723 tempest-ListImageFiltersNegativeTestJSON-1898206723-project] Calling method '.version_select at 0x7f66c76bbca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:41.090042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-42ad0d42-193d-41fb-8482-2380af453b49 tempest-ListImageFiltersNegativeTestJSON-1898206723 tempest-ListImageFiltersNegativeTestJSON-1898206723-project] HTTP exception thrown: Image not found. Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42ad0d42-193d-41fb-8482-2380af453b49 tempest-ListImageFiltersNegativeTestJSON-1898206723 tempest-ListImageFiltersNegativeTestJSON-1898206723-project] Request method failure captured: Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/images/ce76941d-c6bc-4103-a614-96c3c3b205f2 HTTP/1.1 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ8gZf-L9xJNIIVZI2sMVkBJLI9SeJP17ee_lZBUFraH2gOAvbsNeiAKvB1qFDFDMRz5FkkULkOi1l4BJBwTJ-75juqqw7zs_uS5Cim2p63vreQj2VOD2NPkaljfAwFagx7XdFWbyN6M6sk1XzOsIpbr0kDfXihhPGWVXb_EbMMm78 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1d1c227cfc004cf2a4f482c9d8f6b43a Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1898206723 Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:41.094588 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1d1c227cfc004cf2a4f482c9d8f6b43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1d1c227cfc004cf2a4f482c9d8f6b43a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1d1c227cfc004cf2a4f482c9d8f6b43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1d1c227cfc004cf2a4f482c9d8f6b43a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1898206723 Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1d1c227cfc004cf2a4f482c9d8f6b43a Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1898206723 Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListImageFiltersNegativeTestJSON-1898206723-project Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 0c2beed1f9194fa6a1d12e24528ac9d1 Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1898206723-project Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ce76941d-c6bc-4103-a614-96c3c3b205f2'} Aug 29 10:35:41.096386 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:41.097375 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce76941d-c6bc-4103-a614-96c3c3b205f2 Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:35:41.098730 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce76941d-c6bc-4103-a614-96c3c3b205f2 could not be found. Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:41.100665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.102996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42ad0d42-193d-41fb-8482-2380af453b49 tempest-ListImageFiltersNegativeTestJSON-1898206723 tempest-ListImageFiltersNegativeTestJSON-1898206723-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:41.104683 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-42ad0d42-193d-41fb-8482-2380af453b49 tempest-ListImageFiltersNegativeTestJSON-1898206723 tempest-ListImageFiltersNegativeTestJSON-1898206723-project] 10.222.0.47 "GET /compute/v2.1/images/ce76941d-c6bc-4103-a614-96c3c3b205f2" status: 404 len: 62 microversion: 2.1 time: 0.327790 Aug 29 10:35:41.104683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 241/443] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:35:40 2022] GET /compute/v2.1/images/ce76941d-c6bc-4103-a614-96c3c3b205f2 => generated 62 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:35:41.110184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7823e39-139b-4c94-bd83-fc81c78e570b tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Action: 'update', calling method: .version_select at 0x7f66c7517790>, body: {"quota_set": {"ram": 0}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:41.117568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7823e39-139b-4c94-bd83-fc81c78e570b tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '59aaf14b01eb4ee6abbb318c7c4f057c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259b6916e4ca41069796b6c41a3f2805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7823e39-139b-4c94-bd83-fc81c78e570b tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Request method failure captured: Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 HTTP/1.1 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 25 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZsttL-veO0tnYR27XD5H34DrQr8wxhtg3dUcjVPKa7ndOxqDmp6UAR9FcSnHHkO8MDHUbDyxmMup4K9yDgIK22yE82A0mGTqf7zqelrogQ2loHrQc_IfWDN0yBE9Nn1pM6Mb_GtNvWB0HTdlhiW3RsYH_8S1QQAGDXWeu2iIp_gCM Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:41.120921 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/259b6916e4ca41069796b6c41a3f2805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 259b6916e4ca41069796b6c41a3f2805 Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-283746426 Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 59aaf14b01eb4ee6abbb318c7c4f057c Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-QuotasAdminNegativeTest-283746426-project Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: {"quota_set": {"ram": 0}} Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 10:35:41.122597 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '259b6916e4ca41069796b6c41a3f2805', 'body': {'quota_set': {'ram': 0}}} Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:41.123598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.124823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 10:35:41.127622 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:41.129787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7823e39-139b-4c94-bd83-fc81c78e570b tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:41.130809 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7823e39-139b-4c94-bd83-fc81c78e570b tempest-QuotasAdminNegativeTest-283746426 tempest-QuotasAdminNegativeTest-283746426-project] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805" status: 403 len: 116 microversion: 2.1 time: 0.027336 Aug 29 10:35:41.131586 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 242/444] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:35:41 2022] PUT /compute/v2.1/os-quota-sets/259b6916e4ca41069796b6c41a3f2805 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:41.447916 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d61db1c-e93b-4c7f-bf1d-4d8b5f402640 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714/action" status: 202 len: 0 microversion: 2.25 time: 6.767804 Aug 29 10:35:41.449153 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 203/445] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:35:34 2022] POST /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714/action => generated 0 bytes in 6770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:35:41.464489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:41.466082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:41.521399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:41.522354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:41.523401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:41.525691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:41.526545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:41.527616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:42.375801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:42.385760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:42.393011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:42.398504 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c22356d-370b-4748-b66a-3d29deb07daf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.944751 Aug 29 10:35:42.399343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 243/446] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:41 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:35:43.427327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:43.436899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:43.445069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=52 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:43.449613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:43.450411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:43.451073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:43.458102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:43.459402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:43.459991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:43.844693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:43.855241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:43.862503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:43.870724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7319bfb3-5a3b-4302-a04c-a99090549466 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.445428 Aug 29 10:35:43.873214 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 204/447] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:43 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:44.670330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d08942-c152-4c43-a806-61ad692ed714", "name": "network-vif-unplugged", "status": "completed", "tag": "c3ae8e87-ef11-4e59-a485-916ea3de6d7c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:44.697506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:44.698252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:44.700934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:44.730535 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] Creating event network-vif-unplugged:c3ae8e87-ef11-4e59-a485-916ea3de6d7c for instance 13d08942-c152-4c43-a806-61ad692ed714 on n-h1-854121-10 Aug 29 10:35:44.746212 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-100cde2e-de70-4717-a7ff-fc95b27fa68e req-32d136f4-d4d1-4d81-ad24-2babe1be37aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079993 Aug 29 10:35:44.747094 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 244/448] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:44.899008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:44.900279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:44.904002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=20 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:44.924905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:44.925408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:44.927467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:44.930530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:44.934386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:44.934886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:45.371248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:45.397458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:45.403019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:45.404563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f877f0a2-0c9e-4983-963e-1c001dcfb576 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.510510 Aug 29 10:35:45.410892 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 205/449] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:44 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:46.438101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:46.440107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:46.460362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:46.461463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:46.462165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:46.463976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:46.465854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:46.467135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:46.785130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d08942-c152-4c43-a806-61ad692ed714", "tag": "c3ae8e87-ef11-4e59-a485-916ea3de6d7c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:46.805511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:46.810517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:46.815092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:46.835140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] Creating event network-changed:c3ae8e87-ef11-4e59-a485-916ea3de6d7c for instance 13d08942-c152-4c43-a806-61ad692ed714 on n-h1-854121-10 Aug 29 10:35:46.841322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-822f2357-7c35-4801-bfc7-e5e1f5e07c81 req-e888147e-5373-495d-a9cb-1a3bc3019fb0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062734 Aug 29 10:35:46.842570 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 206/450] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:35:46.901646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:46.914640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:46.918638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:46.921849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d91604a-2a49-40bc-af7f-aeca5f48207e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.488468 Aug 29 10:35:46.940977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 245/451] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:46 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:47.742238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4c0677d-7b68-4236-a69a-cb42cf00231b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:47.757534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4c0677d-7b68-4236-a69a-cb42cf00231b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.724556 Aug 29 10:35:47.764965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 207/452] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:35:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:47.951598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:47.952256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:47.967979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:47.979642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:47.980436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:47.981673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:47.992720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:47.993466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:48.461272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77fcc6c8-00ed-44f2-bc41-a2b681156308 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1545645085", "id": 411152838, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:48.503690 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77fcc6c8-00ed-44f2-bc41-a2b681156308 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.736268 Aug 29 10:35:48.506700 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 246/453] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:47 2022] POST /compute/v2.1/flavors => generated 422 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:48.521295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9f0b7ae-d44e-44c9-9ccd-33a6441533ec tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:48.550099 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9f0b7ae-d44e-44c9-9ccd-33a6441533ec tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030827 Aug 29 10:35:48.551176 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 247/454] 10.222.0.47 () {58 vars in 1182 bytes} [Mon Aug 29 10:35:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:35:48.565846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89016882-3658-4ef5-b242-87b1e10dad1e tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-9361313", "id": 417933780, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:48.574498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:48.584401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:48.592514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:48.596756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59a691a4-1130-4f5e-b501-3de7f334421d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.649353 Aug 29 10:35:48.598138 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 208/455] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:47 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:35:48.633040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89016882-3658-4ef5-b242-87b1e10dad1e tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.075326 Aug 29 10:35:48.636951 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 248/456] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:48 2022] POST /compute/v2.1/flavors => generated 419 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:48.647478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b5cd1f36-1b91-4d6a-9919-eac21a4fb342 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:48.662835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b5cd1f36-1b91-4d6a-9919-eac21a4fb342 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019126 Aug 29 10:35:48.667159 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 209/457] 10.222.0.47 () {58 vars in 1182 bytes} [Mon Aug 29 10:35:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:35:48.682374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b2400d5-ef86-4a67-a728-73ca89e573eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Action: 'create', calling method: .version_select at 0x7f66c7411820>, body: {"keypair": {"name": "tempest-keypair-982429982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMyaHqlV+k4+pWCx5a3T5xXs6roKj+v53Kfh+xWsjd7MjOz2jB8+f2OhVlwpyN00KfEcgo6FTp8hqsp1kmg3xfSNvoTBjHrZH0d0VJ+kOUxfhPiulsEu/a/t43cPn4lwQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:48.717355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2b2400d5-ef86-4a67-a728-73ca89e573eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for project e59eae080bd748178fd926a03feebc21. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:48.729341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2b2400d5-ef86-4a67-a728-73ca89e573eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for user caca964aba784dfd9f250baad9e9ec19 and project e59eae080bd748178fd926a03feebc21. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:48.786927 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b2400d5-ef86-4a67-a728-73ca89e573eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109589 Aug 29 10:35:48.788707 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 249/458] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:35:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:49.622126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:49.625693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:49.636972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Calling method '.version_select at 0x7f66c74fedc0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:49.651722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:49.654509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:49.656171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:49.659238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:49.659926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:49.662223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:49.682419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:49.683502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:49.684277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:49.685393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:49.686430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:49.687608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:49.727840 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a476218-49e8-46b3-b47e-596aa2cba3a1 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] 10.222.0.47 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.735120 Aug 29 10:35:49.729431 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 210/459] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 10:35:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:35:50.101349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-205907541", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:50.254654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:50.598022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:50.616364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:50.619591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:50.622205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b5f52e8-ae0d-45a1-a34b-88c40013d774 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 1.003342 Aug 29 10:35:50.627157 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 250/460] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:49 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:50.667707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=37 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:51.423092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ae2cce2-bd99-433e-b3fb-8a5d41161a3f tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:51.426484 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1ae2cce2-bd99-433e-b3fb-8a5d41161a3f tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ae2cce2-bd99-433e-b3fb-8a5d41161a3f tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin] Request method failure captured: Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaG8_L113oqedP-dEBu8I_MU-Quk22LHt8fX7esJvM89xvs6gq2Vt0gxftN2_62brw-27qxi7Niv6DrHYa18VhHKYcs9YQC8Sn2xJrCIb5yBfbG90I0njyrkJ8LAUe6FROyMIbxaHzQktvhA7sgQ-uo-bLdzIa9NOfCiqorc82IQIk Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 2ca166f43b3c4a32a0ae649f795fb7ad Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ca166f43b3c4a32a0ae649f795fb7ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ca166f43b3c4a32a0ae649f795fb7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ca166f43b3c4a32a0ae649f795fb7ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ca166f43b3c4a32a0ae649f795fb7ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 2ca166f43b3c4a32a0ae649f795fb7ad Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 81a058d2ba3f42669d725b9fde533d37 Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid timestamp for date invalid_time Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'invalid_time'} Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:51.441665 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:51.446643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 29 10:35:51.446643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.448282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ae2cce2-bd99-433e-b3fb-8a5d41161a3f tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:51.454766 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ae2cce2-bd99-433e-b3fb-8a5d41161a3f tempest-InstanceUsageAuditLogNegativeTestJSON-64554202 tempest-InstanceUsageAuditLogNegativeTestJSON-64554202-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.820775 Aug 29 10:35:51.455811 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 251/461] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 10:35:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 828 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:35:51.788333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Getting quotas for project 4cdc2a6ced474f96ad8c25bfb45f7a86. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:51.804868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Getting quotas for user 705dd7d543b845dbaa70f64b95c7e1cf and project 4cdc2a6ced474f96ad8c25bfb45f7a86. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:51.856350 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Request method failure captured: Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 1751 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaEvKrR518Zg9JT9B8H-5GTo1NdF3RMaepRvXpyTw-WAWdzdcQIK9TMv32DzeArnVTm6oNV-_EGqhzddBFseIBogWcQ9VAaDm0phYmsY2gztKSF5sXAN50FTgNcx-8bhKItBOHygTFY01GwVwPJlbZXjOrB5nwKVIFESWX1xHucvX0 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4cdc2a6ced474f96ad8c25bfb45f7a86 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1527795021 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4cdc2a6ced474f96ad8c25bfb45f7a86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4cdc2a6ced474f96ad8c25bfb45f7a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4cdc2a6ced474f96ad8c25bfb45f7a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4cdc2a6ced474f96ad8c25bfb45f7a86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1527795021 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4cdc2a6ced474f96ad8c25bfb45f7a86 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1527795021 Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 705dd7d543b845dbaa70f64b95c7e1cf Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-205907541", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:51.861967 n-d-854121-10 devstack@n-api.service[128682]: exception: Maximum number of metadata items exceeds 128 Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-205907541', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:51.864526 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 29 10:35:51.867689 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:51.870949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:51.871952 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-25024802-7b85-4789-82bb-9d0ca3a5af09 tempest-AbsoluteLimitsNegativeTestJSON-1527795021 tempest-AbsoluteLimitsNegativeTestJSON-1527795021-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.775055 Aug 29 10:35:51.881063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 211/462] 10.222.0.47 () {60 vars in 1148 bytes} [Mon Aug 29 10:35:50 2022] POST /compute/v2.1/servers => generated 87 bytes in 1780 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 29 10:35:51.892992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:51.895655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:51.913110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:51.914664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:51.915214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:51.918424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:51.919475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:51.921008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:52.265875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae733a7b-6ec6-43b7-b94d-6f04885a42e7 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:52.269135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae733a7b-6ec6-43b7-b94d-6f04885a42e7 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '667aaec8b24d403b9026e72c938b4988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6335e3684543669c35f125e46f9b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae733a7b-6ec6-43b7-b94d-6f04885a42e7 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Request method failure captured: Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaCTEy1rg7mRJk3Ux9srvOEBEiwcjw8FRafMwSL7pmmejS8NeOSgXJ9NvJqYglKwlc9gCQO_EzRIqoRyAWkFqJn0T0sNpUpFyz84K_RYQMOJAZNg-db8m8wPVNz2A15c7Lw_tstxYOaJBLXyamSfBpfRtcSypjKAsX2hwy9LKZKTC8 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: af6335e3684543669c35f125e46f9b1f Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af6335e3684543669c35f125e46f9b1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: af6335e3684543669c35f125e46f9b1f Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 667aaec8b24d403b9026e72c938b4988 Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.284975 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 10:35:52.289202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.308869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae733a7b-6ec6-43b7-b94d-6f04885a42e7 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:52.311985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae733a7b-6ec6-43b7-b94d-6f04885a42e7 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.849120 Aug 29 10:35:52.314656 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 252/463] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 10:35:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 854 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:35:52.618021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:52.621489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:35:52.636211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:52.645671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:52.646976 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e98a5c8d-5780-4649-b172-94f7c474d099 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.768159 Aug 29 10:35:52.661729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 212/464] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:51 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:52.672801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa473a27-5386-48b5-af73-128dd7293e88 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:52.674849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa473a27-5386-48b5-af73-128dd7293e88 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '667aaec8b24d403b9026e72c938b4988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6335e3684543669c35f125e46f9b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa473a27-5386-48b5-af73-128dd7293e88 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Request method failure captured: Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2010:35:52 HTTP/1.1 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaCTEy1rg7mRJk3Ux9srvOEBEiwcjw8FRafMwSL7pmmejS8NeOSgXJ9NvJqYglKwlc9gCQO_EzRIqoRyAWkFqJn0T0sNpUpFyz84K_RYQMOJAZNg-db8m8wPVNz2A15c7Lw_tstxYOaJBLXyamSfBpfRtcSypjKAsX2hwy9LKZKTC8 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: af6335e3684543669c35f125e46f9b1f Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af6335e3684543669c35f125e46f9b1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af6335e3684543669c35f125e46f9b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: af6335e3684543669c35f125e46f9b1f Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 667aaec8b24d403b9026e72c938b4988 Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '2022-08-29 10:35:52'} Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.677129 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa473a27-5386-48b5-af73-128dd7293e88 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:35:52.680762 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa473a27-5386-48b5-af73-128dd7293e88 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127 tempest-InstanceUsageAuditLogNegativeTestJSON-822889127-project] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 10:35:52" status: 403 len: 128 microversion: 2.1 time: 0.027088 Aug 29 10:35:52.681243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 213/465] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:35:52 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2010%3A35%3A52 => generated 128 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:35:52.722191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-126558572", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:52.842881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:53.556253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-437647574", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "417933780", "adminPass": "***", "networks": [{"uuid": "29fc2090-58ba-4ab8-b730-1b56c4083b7a"}], "security_groups": [{"name": "tempest-securitygroup--1172162650"}], "key_name": "tempest-keypair-982429982", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:54.097407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:54.098433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:54.099641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:54.100329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:54.101354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:54.116337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:54.117086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:54.118426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:54.119928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:54.120560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:54.121494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:54.151129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Getting quotas for project 2624c2acf74e44be8efb3a1a6e0f149b. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:54.171705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Getting quotas for user 64f3d2458a8a410497a293dca10e88d3 and project 2624c2acf74e44be8efb3a1a6e0f149b. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:54.192139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:35:54.195801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:35:54.276578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] validate_networks() for [('29fc2090-58ba-4ab8-b730-1b56c4083b7a', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:54.298465 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d5b8a752-2d57-463b-9dc3-c6e331f97e7b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978814 Aug 29 10:35:54.303299 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 253/466] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:35:54.320195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:54.322551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:54.337693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:54.338216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:54.338655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:54.339373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:54.339827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:54.340254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:55.800506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:55.842713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:55.850047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:55.851384 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-233565c4-256f-4e9e-aaf4-6aa9653542d2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 1.546520 Aug 29 10:35:55.852352 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 254/467] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:54 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:55.904669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:55.905352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:55.906459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:55.907564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:55.908410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:55.975585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:55.979405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:55.989642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:55.999234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:56.000376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:56.006299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:56.127709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for project e59eae080bd748178fd926a03feebc21. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:56.133794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for user caca964aba784dfd9f250baad9e9ec19 and project e59eae080bd748178fd926a03feebc21. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:56.150868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:35:56.157140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:35:56.232791 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7756d3f1-f83c-410d-99ad-fbf3e4382238 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.693024 Aug 29 10:35:56.236006 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 214/468] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:35:56.248795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:56.250321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:56.265574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:56.267571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:56.268745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:56.271743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:56.273971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:56.274741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:56.576952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1387366895", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:56.691423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:56.795313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:56.810215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fcc03c09-927d-4eb0-9452-9033ce4ceaf3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1281 microversion: 2.1 time: 0.572787 Aug 29 10:35:56.818987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 215/469] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:56 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1281 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:56.823873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bad133aa-9090-4ea6-8db9-1b25b9b045eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:56.844477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bad133aa-9090-4ea6-8db9-1b25b9b045eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:57.176577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bad133aa-9090-4ea6-8db9-1b25b9b045eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:57.184974 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bad133aa-9090-4ea6-8db9-1b25b9b045eb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1261 microversion: 2.1 time: 0.364781 Aug 29 10:35:57.222238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 216/470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:56 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1261 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:57.227478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:57.232736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:57.250074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.251585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.252251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:57.253247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.254000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.254670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:57.682309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:35:57.683705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:35:57.687201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:35:57.691429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:35:57.694101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:35:57.732080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.733195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.734170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:57.735831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.736576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.737299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:57.768464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:35:57.771274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:57.776565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for user a9dbd3b826964971aa24d942a5c16440 and project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:35:57.784131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:57.787062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:57.789360 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ab261be-3cb1-42ad-9d1c-5194dbf8588f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1566 microversion: 2.25 time: 0.565413 Aug 29 10:35:57.796720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:35:57.799660 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 217/471] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:57 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1566 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:35:57.805557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:35:57.839866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:57.840484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:57.854112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.854625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.855070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:57.855793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:57.858613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:57.859203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:58.007396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a769fc58-b115-4ee9-ac17-c01649c96df0 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149199 Aug 29 10:35:58.017878 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 255/472] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:35:58.052428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:58.070682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d67db168-e0f3-4c09-aca5-467866d0e72b tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1279 microversion: 2.1 time: 0.233051 Aug 29 10:35:58.073559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 218/473] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:57 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:35:58.231616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:58.232588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:58.248692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:58.251795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:58.252696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:58.255141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:58.256101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:58.258436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:58.286654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2136710604", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:35:58.367631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:35:58.372463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:35:58.393934 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d63110e-f837-4948-b11a-3eade790b5b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1313 microversion: 2.1 time: 0.162230 Aug 29 10:35:58.394706 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 256/474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:35:58 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:35:58.827010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:35:58.828202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:35:58.845189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:58.845688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:58.854360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:35:58.855810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:35:58.857221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:35:58.859221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:00.511128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:00.511633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:00.512294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:00.512709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:00.513202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:00.559278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:00.559781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:00.560253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:00.566605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:00.567107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:00.576020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:00.597684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:00.614965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:00.628997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:00.633081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2b660bf-c25e-478c-b1e7-0dcee085bd2e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1556 microversion: 2.25 time: 1.810126 Aug 29 10:36:00.640164 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 257/475] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:35:58 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1556 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:00.663691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:00.674180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:00.686605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:00.687343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:00.691649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:00.692315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:00.693230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:00.693906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:00.694501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:00.697820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for user a9dbd3b826964971aa24d942a5c16440 and project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:00.737286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:00.743728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:00.910393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf2dcb96-7def-4997-81f1-58948426d3ac tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.622923 Aug 29 10:36:00.913126 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 219/476] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:00.993272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:00.996052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:01.007043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:01.008428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:01.009396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:01.010401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:01.011945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:01.012624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:01.332968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:01.342724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-71dfcfc5-518a-46e7-8b4e-029898a6b52f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1319 microversion: 2.1 time: 0.411182 Aug 29 10:36:01.342724 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 220/477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:00 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:01.375203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dfd38265-d6d4-48a2-816b-d8f4b1b56ad5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '.version_select at 0x7f66c74f03a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:01.379532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfd38265-d6d4-48a2-816b-d8f4b1b56ad5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:01.380025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfd38265-d6d4-48a2-816b-d8f4b1b56ad5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:01.380469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfd38265-d6d4-48a2-816b-d8f4b1b56ad5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:01.404829 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dfd38265-d6d4-48a2-816b-d8f4b1b56ad5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.048750 Aug 29 10:36:01.405883 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 221/478] 10.222.0.47 () {60 vars in 1184 bytes} [Mon Aug 29 10:36:01 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:36:01.419502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d30d8be6-fea4-4091-a238-d32a6fa12e08 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:01.433346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d30d8be6-fea4-4091-a238-d32a6fa12e08 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:01.613456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d30d8be6-fea4-4091-a238-d32a6fa12e08 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:01.624939 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d30d8be6-fea4-4091-a238-d32a6fa12e08 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1214 microversion: 2.1 time: 0.216964 Aug 29 10:36:01.640691 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 222/479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:01 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:01.647097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:01.650802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:01.651919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:01.659356 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9dd3ab8-c220-4667-9033-3f5430fd16cb tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 1.015764 Aug 29 10:36:01.661618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 258/480] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:00 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:01.663274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:01.665039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:01.667797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:01.668935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:01.669625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:01.670412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:01.983694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-436982477", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:02.138912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:02.989197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:02.990449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:02.990698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:02.991111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:02.991526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:03.000828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 13d08942-c152-4c43-a806-61ad692ed714 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:03.017884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.018386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.018826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.019564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.020021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.020445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.053112 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-834fa214-5fc4-43ae-90f5-00006fde525e tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 2049 microversion: 2.25 time: 1.408892 Aug 29 10:36:03.056710 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 223/481] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:01 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 2049 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:03.064812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:03.065683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:03.078192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.079401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.080246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.081149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.083474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.084088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Getting quotas for project b7de8c335e9e46258711b63a44ca8ddf. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:03.084405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.098890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Getting quotas for user 51a39e43f5134b4b8424600ee2563a0f and project b7de8c335e9e46258711b63a44ca8ddf. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:03.143638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:03.146402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:03.167626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=11,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:03.264050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27bab719-629e-4be4-aa2d-144aef52c665 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601247 Aug 29 10:36:03.265893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 259/482] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:03.291705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:03.292578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:03.319572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.320358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.321765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.323211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.323822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.324560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.361665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:03.376322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bc723f68-d551-4ccb-9563-91f26f16a33b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1319 microversion: 2.1 time: 0.313928 Aug 29 10:36:03.377311 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 224/483] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:03 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:03.394810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:03.395690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:03.409242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:03.414932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.418017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.418484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.419203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:03.420028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:03.420642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:03.579218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:03.589464 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f638b5fb-1f1c-4fd2-93f0-783efd979d23 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1284 microversion: 2.1 time: 0.321207 Aug 29 10:36:03.592859 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 260/484] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:03 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1284 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:03.602997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce87e65c-0d25-4eb2-8789-2f4a5369f092 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:03.606633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce87e65c-0d25-4eb2-8789-2f4a5369f092 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:03.925353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce87e65c-0d25-4eb2-8789-2f4a5369f092 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:03.932313 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce87e65c-0d25-4eb2-8789-2f4a5369f092 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1218 microversion: 2.1 time: 0.333883 Aug 29 10:36:03.945790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 261/485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:03 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:03.951314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-374468239", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "216ce7f7-153f-4fc4-88fa-0b56f8f31bc3"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:04.070718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] validate_networks() for [('216ce7f7-153f-4fc4-88fa-0b56f8f31bc3', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:04.832273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:04.855035 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53bd5abd-8682-402e-bbbe-a055f09f85d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 1.473820 Aug 29 10:36:04.857083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 225/486] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:03 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:04.865878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:04.869210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:04.877673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:04.878502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:04.879175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:04.880123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:04.881184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:04.881981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:05.480882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:05.496620 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bc46bcdf-2dd5-403e-865b-392d69ddd855 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.638103 Aug 29 10:36:05.506529 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 226/487] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:04 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:05.522110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:05.523120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:05.537176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:05.537986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:05.538598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:05.539494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:05.540108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:05.540691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:05.783814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:05.794577 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad02d3d1-e8bb-4ecf-9935-119a7b0925bb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1272 microversion: 2.1 time: 0.286761 Aug 29 10:36:05.796880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 227/488] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:05 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:05.804486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:05.806429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:05.818986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:05.820129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:05.820731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:05.821757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:05.822387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:05.824937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.089921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:06.102609 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d09ee851-b9f4-497e-85cd-b82a9e388641 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1276 microversion: 2.1 time: 0.303090 Aug 29 10:36:06.114405 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 228/489] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:05 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:06.127969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e6bb99-33e7-4392-b960-91061f49793a", "tag": "7d96b4b2-d7e6-4d95-a631-05c3b1cb463f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:06.153652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.154393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.159893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.192104 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] Creating event network-changed:7d96b4b2-d7e6-4d95-a631-05c3b1cb463f for instance 76e6bb99-33e7-4392-b960-91061f49793a on n-h2-854121-10 Aug 29 10:36:06.204358 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f2291b9a-cf03-4fc4-9d51-5ecafbee8428 req-cc933985-d7bc-4324-878e-623e2d8418e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087672 Aug 29 10:36:06.205164 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 229/490] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:06.217053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:06.218612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:06.226234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.226953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.229061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.229061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.229744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.230358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.691919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:06.705787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e56c32ff-e94d-4107-bc8a-5cb9bee6a419 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 0.498855 Aug 29 10:36:06.708247 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 230/491] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:06 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:06.715856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:06.716783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:06.736820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:06.739037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:06.740319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:06.741771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:06.742818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:06.751597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.753253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.754699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.757970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.772377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.772752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.780408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=61 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:06.782006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.782753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.793541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.794655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.795296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.795932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.833301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:06.842743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for user ad7622f1f2834d1e9171f6525f0e6481 and project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:06.872590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:06.877771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:06.970950 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9e9d35f-b1de-41b0-aa5b-bb964f906423 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.023442 Aug 29 10:36:06.971849 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 262/492] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:36:06.978471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:06.979246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:06.988541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:06.989190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:06.989751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:06.991309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:07.009025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:07.013217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:07.577027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.589881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eee8e561-b127-4bf7-b1b6-47f240228ab6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.613582 Aug 29 10:36:07.604304 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 263/493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:06 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:07.619349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:07.620265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:07.624485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.634086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7e2f945-cf1c-4c9a-85b5-2e2070ccde20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.924180 Aug 29 10:36:07.638388 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 231/494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:06 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:07.643947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:07.650218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:07.667929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:07.668632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:07.669172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:07.670034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:07.670599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:07.671134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:07.751222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.763713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.766951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.768354 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3fb895cc-a42d-43ff-8a10-26128fa2c76b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1261 microversion: 2.25 time: 0.154587 Aug 29 10:36:07.769077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 264/495] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:07 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:07.774121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:07.774904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:07.784204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:07.784997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:07.785744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:07.787080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:07.787360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:07.788046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:07.971473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:07.998824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2ec6164-ddae-4c24-861d-4b52a032cdc3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1276 microversion: 2.1 time: 0.355823 Aug 29 10:36:08.003327 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 232/496] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:07 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:08.214757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:08.228511 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adfea76d-1a48-430a-8c15-440cb0a98ece tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 0.458132 Aug 29 10:36:08.242025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 265/497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:07 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:08.622419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:08.624042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:08.640185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:08.641939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:08.646027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:08.646992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:08.650064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:08.650511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:08.659658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:08.660627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:08.691239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:08.691981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:08.692498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:08.697461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:08.707609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:08.708071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.094763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.111862 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c85ab14-1ed4-427c-a0f9-803146f2619e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.456529 Aug 29 10:36:09.113111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 266/498] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:08 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:09.122640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:09.129248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:09.145256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.152940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.153558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.154449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.155143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.155833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.261208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.269496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96e657dc-95b4-4f3e-ab9c-2b501a479e60 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.657279 Aug 29 10:36:09.283239 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 233/499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:08 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:09.312872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.325923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.328359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.335603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e46d71ee-121d-42ce-b1be-88a3ae9f4415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1313 microversion: 2.25 time: 0.216297 Aug 29 10:36:09.349776 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 267/500] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:09 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:09.370795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:09.371539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:09.380387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.382957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.383524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.385316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.387036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.388253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.448547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-829e437e-86e3-4425-b099-6db25b03aeeb tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Action: 'create', calling method: .version_select at 0x7f66c74fec10>, body: {"pool": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:09.620783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:09.630335 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f72fd545-bbf7-4438-9118-0628610604b8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1276 microversion: 2.1 time: 0.278477 Aug 29 10:36:09.639057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 268/501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:09 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:09.644280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:09.651686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:09.664293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.665188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.665904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:09.666866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:09.677549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:09.678429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:10.387186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:10.391322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:10.405369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41f8d08b-2999-4a3e-b02d-3b20c16b610f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 0.764811 Aug 29 10:36:10.406425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 269/502] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:09 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:10.415127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8566034-3f61-4670-87f9-c70f21528d2d", "tag": "60c5ce34-0b6b-4d39-b10e-b4f0a4b68587"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:10.430266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:10.431096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:10.431773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:10.446094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] Creating event network-changed:60c5ce34-0b6b-4d39-b10e-b4f0a4b68587 for instance b8566034-3f61-4670-87f9-c70f21528d2d on n-h1-854121-10 Aug 29 10:36:10.451718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f270dd7b-76d3-4529-b0ea-896c2ce98846 req-3c2e40c1-0cfb-4849-924d-9096e37dc73b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043727 Aug 29 10:36:10.453075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 270/503] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:10.460947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:10.462196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:10.469335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:10.470393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:10.471175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:10.472055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:10.472668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:10.473272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:10.628807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:11.252430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:11.269961 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fbe4cbd1-e691-4ea6-8c70-0d606ebd3eaa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.813325 Aug 29 10:36:11.270812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 271/504] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:10 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:11.275852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:11.276445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:11.283446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.286142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.288647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.290234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.290986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.291578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.624997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=22 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:11.675736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:11.684704 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c091eddc-adc4-48fe-9453-bf56eef4e740 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.412678 Aug 29 10:36:11.685834 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 272/505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:11 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:11.692682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:11.693506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:11.700753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.701684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.702364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.703893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.704629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.705231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.827456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:11.842332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:11.843774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:11.845144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a187260-3c55-43ba-86a7-8fd239e1276d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1319 microversion: 2.25 time: 0.158184 Aug 29 10:36:11.845897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 273/506] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:11 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:11.850686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76fc53bd-6602-41c8-8583-bb797d0b556d", "tag": "6fcd587d-a838-4e60-8dc0-19797f48f271"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:11.866240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.867451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.868230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.881179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] Creating event network-changed:6fcd587d-a838-4e60-8dc0-19797f48f271 for instance 76fc53bd-6602-41c8-8583-bb797d0b556d on n-h2-854121-10 Aug 29 10:36:11.886801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2403f222-942e-4104-a039-d7edc2efc626 req-130ad6c7-47a1-4aec-ae0c-533280fb6aea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038725 Aug 29 10:36:11.888474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 274/507] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:11.895108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:11.897060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:11.905148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.906577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.907191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:11.908503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:11.909301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:11.910527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:12.378026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:12.390131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f947e3a5-1d58-4e84-8205-b28e11aeefd3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.499901 Aug 29 10:36:12.404640 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 275/508] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:11 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:12.410941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:12.411744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:12.418684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:12.419424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:12.420019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:12.421502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:12.422290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:12.423215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:13.175094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:13.182868 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d898480f-89be-4a5a-8f7a-7ebd72227adf tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 0.776905 Aug 29 10:36:13.186452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 276/509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:12 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:13.203911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:13.207899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:13.221018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:13.222042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:13.222720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:13.224526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:13.226097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:13.226934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.016216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:14.023966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73ea630e-5c10-4cc3-82ee-71b664a043b7 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.834394 Aug 29 10:36:14.031627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 277/510] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:13 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:14.036978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:14.052707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.053200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.053795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.073651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] Creating event network-changed:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:36:14.079553 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-38c8f8bb-e167-408a-a7cf-314ae53ad15f req-47d80bf6-4589-4bb1-a195-ed3840205b3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046347 Aug 29 10:36:14.083731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 278/511] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:14.091717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:14.092440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:14.106847 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-829e437e-86e3-4425-b099-6db25b03aeeb tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.822543 Aug 29 10:36:14.107961 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 234/512] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:36:09 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:14.113974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:14.114982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:14.116883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.117399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.117899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.118670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.119134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.119555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.136650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.137150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.137596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.138350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.138803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.146401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.614743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:14.627495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2d13c41-864c-40eb-ac40-b77cf85eaf28 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.542329 Aug 29 10:36:14.629187 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 279/513] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:14 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:14.637229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:14.638130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:14.646946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.647581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.648258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.649039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.650025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.650852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.664706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:14.685654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:14.691696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:14.700023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:14.701622 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8610469e-e7ae-41a7-992b-4b4983747a1e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1361 microversion: 2.25 time: 0.592520 Aug 29 10:36:14.721792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 235/514] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:14 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1361 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:14.732800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e6bb99-33e7-4392-b960-91061f49793a", "name": "network-vif-plugged", "status": "completed", "tag": "7d96b4b2-d7e6-4d95-a631-05c3b1cb463f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:14.768890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:14.771821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:14.773077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:14.790855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] Creating event network-vif-plugged:7d96b4b2-d7e6-4d95-a631-05c3b1cb463f for instance 76e6bb99-33e7-4392-b960-91061f49793a on n-h2-854121-10 Aug 29 10:36:14.798370 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7f178b9a-517d-4ef0-9e9a-a9a99e86ad04 req-e1ae6069-779d-45a2-86cd-53f7214bfe30 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073447 Aug 29 10:36:14.799725 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 236/515] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:14.806176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5973cdb2-eafe-49cf-8c1b-f27d238a19f7 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Action: 'create', calling method: .version_select at 0x7f66c76a1d30>, body: {"pool": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:15.319102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:15.333982 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2115191e-dd4a-48a0-84a7-efc9b1d962f9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.703270 Aug 29 10:36:15.350103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 280/516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:14 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:15.355622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:15.356300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:15.365460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:15.366071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:15.366792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:15.370599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:15.371371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:15.372042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:15.934500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:15.948725 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef1967ed-5c6c-48e3-95e3-fb6f21bc50d3 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1321 microversion: 2.1 time: 0.596993 Aug 29 10:36:15.950391 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 281/517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:15 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:15.961018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:15.965132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:15.977062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:15.981168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:15.982001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:15.983191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:15.986069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:15.986786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:16.811978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:16.918380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:16.935668 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44adb58f-717a-4502-bfbc-370603f68ecf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.976526 Aug 29 10:36:16.947052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 282/518] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:15 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:16.957924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:16.959322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:16.978124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:16.978864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:16.979478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:16.980357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:16.980968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:16.981535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:17.467792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:17.478500 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09026011-bf56-4747-87d9-f0f2065caec9 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.529648 Aug 29 10:36:17.480216 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 283/519] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:16 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:17.487356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:17.488274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:17.503008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:17.503853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:17.505235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:17.506516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:17.507252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:17.507853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:17.762676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=7 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:17.948840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:18.000191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:18.005306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:18.007777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9bd775f4-a4a2-46d8-bce2-3d3f2aca6979 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1361 microversion: 2.25 time: 0.525566 Aug 29 10:36:18.009201 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 284/520] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:17 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1361 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:18.032505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f4a7d-8051-43bf-9939-a14a19e0f895", "tag": "4e1f978f-971b-41b8-9a23-fcc311e906e5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:18.054532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.055641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.056395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.074731 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] Creating event network-changed:4e1f978f-971b-41b8-9a23-fcc311e906e5 for instance 449f4a7d-8051-43bf-9939-a14a19e0f895 on n-h2-854121-10 Aug 29 10:36:18.086187 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ec2ac78b-877f-4dee-bad1-cfde0f746c04 req-b56e75da-7b3c-433f-bbe6-cfd149d0450a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068013 Aug 29 10:36:18.087664 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 285/521] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:18.097092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758d1aa2-5ace-4c5b-82d8-4b18216f0b80", "tag": "7827b09f-7162-447d-ad69-20d7a65affb4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:18.111082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.115287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.116016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.128983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] Creating event network-changed:7827b09f-7162-447d-ad69-20d7a65affb4 for instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 on n-h1-854121-10 Aug 29 10:36:18.143063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-35cabd47-1494-4162-971c-c7d9c00bc312 req-3b994c2c-7120-47ab-b9a9-10e25912c574 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053454 Aug 29 10:36:18.144712 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 286/522] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:18.151541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:18.152977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:18.164285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.165065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.165823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.166527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.166969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.167558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.753047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:18.761419 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-058b2ff6-e67b-4a4c-bf94-4a942316621e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.615288 Aug 29 10:36:18.775505 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 287/523] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:18 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:18.780583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:18.781796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:18.805506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.808080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.808863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.818697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:18.819738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:18.820426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:18.877494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5973cdb2-eafe-49cf-8c1b-f27d238a19f7 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.076206 Aug 29 10:36:18.878485 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 237/524] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:36:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:18.956308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1055446804", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a0ef28b9-57a1-4ef0-9645-ec05cf810a01"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:19.054975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] validate_networks() for [('a0ef28b9-57a1-4ef0-9645-ec05cf810a01', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:19.126801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:19.139933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4e093233-45f7-4edc-852b-ffd2bb28cd6c tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1471 microversion: 2.1 time: 0.362945 Aug 29 10:36:19.141289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 288/525] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:18 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:19.163012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fc53bd-6602-41c8-8583-bb797d0b556d", "name": "network-vif-plugged", "status": "completed", "tag": "6fcd587d-a838-4e60-8dc0-19797f48f271"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:19.174852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:19.175520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:19.176120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:19.190846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] Creating event network-vif-plugged:6fcd587d-a838-4e60-8dc0-19797f48f271 for instance 76fc53bd-6602-41c8-8583-bb797d0b556d on n-h2-854121-10 Aug 29 10:36:19.197233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-211039a4-61a2-4464-8237-9435438cc79c req-8f888533-b387-40da-9cc8-78c8cb3e27b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041494 Aug 29 10:36:19.197978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 289/526] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:19.209755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:19.213069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:19.236607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:19.237309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:19.237959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:19.238936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:19.239661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:19.240260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:19.278863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:19.612366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:19.620944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53fd3eb4-61ea-473e-8366-206666015f64 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.420631 Aug 29 10:36:19.621540 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 290/527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:19 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:19.626592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:19.627378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:19.633205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:19.633803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:19.634399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:19.635280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:19.635956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:19.636640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:20.192801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:20.201796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65649113-a244-4932-b455-c9dc13bdee66 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1314 microversion: 2.1 time: 0.579131 Aug 29 10:36:20.203171 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 291/528] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:19 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:20.208508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-414a1d0c-1fd6-464d-8041-77821c6a2075 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Action: 'create', calling method: .version_select at 0x7f66c73541f0>, body: {"pool": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:20.229730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:20.230206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:20.230614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:20.231020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:20.231654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:20.241352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:20.242060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:20.242497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:20.243221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:20.243677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:20.244101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:20.262291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:20.269202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for user 30e7715efc824e0d9dc68fc5eb4b398b and project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:20.282553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:20.285275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:20.335951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-831e3931-dee6-4349-a459-209c887869d2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456175 Aug 29 10:36:20.337443 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 238/529] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:20.414450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1715312879", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "8976f889-193c-40a8-aa66-50c6dc9942db"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:20.511104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] validate_networks() for [('8976f889-193c-40a8-aa66-50c6dc9942db', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:21.228862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:21.229288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:21.229997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:21.231156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:21.231729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:21.243457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:21.243949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:21.244384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:21.245113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:21.245569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:21.246042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:21.269598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Getting quotas for project cba30aa9ba3e4d0d889c78b095558c17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:21.279125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Getting quotas for user 5afec0f0a7684793b8bc192f18f824a2 and project cba30aa9ba3e4d0d889c78b095558c17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:21.295055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:21.298899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:21.354965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cb6b6f2-3c77-4bcf-8d13-3e82f602f9f0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015983 Aug 29 10:36:21.355862 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 239/530] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:21.362813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:21.363430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:21.371031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:21.371522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:21.371956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:21.372650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:21.373100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:21.373729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:21.661124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:21.670271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:21.672258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:21.673537 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1cf33f0d-35fe-4a82-8a68-8ba0c0ccddd3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1361 microversion: 2.25 time: 0.316534 Aug 29 10:36:21.714223 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 240/531] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:21 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:22.039276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:22.040051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] [instance: 9e02d689-9186-4a13-beae-d8ec153eeefa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.052230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] HTTP exception thrown: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Request method failure captured: Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/9e02d689-9186-4a13-beae-d8ec153eeefa/action HTTP/1.1 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGy64DtdFdURokYQUflUxLBPfHFgWi6vtohZBTKb8TQmxvguwYiHqkuuLKjLWUyOaB180g0JMAkby35MqAp0c2RChOiWDAcBq2rcDrzZIoT-CPgKiKT-bArEuAl7bJJDoM1IUgp80SyUSa5ghnxe8ZSyM1oth984rBxw52qDI9nhA Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5925f3b19f724a119605ab1d23d13271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2731346fb6a04e419b330ebf48416ccd Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: {"migrate": {}} Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9e02d689-9186-4a13-beae-d8ec153eeefa', 'body': {'migrate': {}}} Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:22.054190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Returning 404 to user: Instance 9e02d689-9186-4a13-beae-d8ec153eeefa could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:22.059746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-965e38e5-631b-40fb-839d-6ecd782d4f9e tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9e02d689-9186-4a13-beae-d8ec153eeefa/action" status: 404 len: 111 microversion: 2.1 time: 0.342173 Aug 29 10:36:22.062099 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 241/532] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:21 2022] POST /compute/v2.1/servers/9e02d689-9186-4a13-beae-d8ec153eeefa/action => generated 111 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:36:22.078499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:22.079117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.088661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.097434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.098024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.098963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.100574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.102897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.361909 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-414a1d0c-1fd6-464d-8041-77821c6a2075 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.157144 Aug 29 10:36:22.363089 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 292/533] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:36:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:22.367582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:22.368365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.382180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.383059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.383705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.384715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.385371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.386068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.473867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:22.484994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9830a0ab-b953-4ff6-9e57-0d1b991fc79a tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.420662 Aug 29 10:36:22.496397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:22.513544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 242/534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:22 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:22.513544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:22.514786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.521803 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bf12f3f-b445-429f-9aa5-72aadeec084e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1269 microversion: 2.1 time: 0.157113 Aug 29 10:36:22.535178 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 293/535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:22 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:22.540326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:22.541181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.548316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.548785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.549062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.549289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.549497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.549799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.550242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.550464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.550692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.550925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.551109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.551358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.845209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:22.845812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:22.855125 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ade388f7-4367-4afe-912a-8b269c7ce38b tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1387 microversion: 2.1 time: 0.352643 Aug 29 10:36:22.855682 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 243/536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:22 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1387 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:22.858946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ec75e62-ddad-40be-9644-60e753a5ab6f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1464 microversion: 2.1 time: 0.322023 Aug 29 10:36:22.860434 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 294/537] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:22 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:22.868096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8566034-3f61-4670-87f9-c70f21528d2d", "name": "network-vif-plugged", "status": "completed", "tag": "60c5ce34-0b6b-4d39-b10e-b4f0a4b68587"}, {"server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "name": "network-vif-plugged", "status": "completed", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:22.872339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:22.873127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:22.882216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.883197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.883845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.884449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.884941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:22.885069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.885561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.885886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:22.886476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:22.900852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Creating event network-vif-plugged:60c5ce34-0b6b-4d39-b10e-b4f0a4b68587 for instance b8566034-3f61-4670-87f9-c70f21528d2d on n-h1-854121-10 Aug 29 10:36:22.901320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] Creating event network-vif-plugged:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:36:22.913691 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0a4be459-f178-47c7-950c-3139d342d97e req-e712152f-7bd8-4afd-9ec5-fde4e5655911 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052523 Aug 29 10:36:22.915093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 244/538] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:22.922842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1575929234", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:22.990365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:23.007090 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4fb5fbf-3e61-41a8-8c69-56a4d7b2524f tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1277 microversion: 2.1 time: 0.145205 Aug 29 10:36:23.007880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 295/539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:22 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:23.028205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad0e8d0e-13bd-4988-b2c2-9c6eeefa0538 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Action: 'create', calling method: .version_select at 0x7f66c755f430>, body: {"pool": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:23.033765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:23.631109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:23.633064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:23.634653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:23.636944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:23.638836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:23.662749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:23.663864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:23.665046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:23.666246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:23.666866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:23.667741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:23.713144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Getting quotas for project 2624c2acf74e44be8efb3a1a6e0f149b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:23.728144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Getting quotas for user 64f3d2458a8a410497a293dca10e88d3 and project 2624c2acf74e44be8efb3a1a6e0f149b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:23.755195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:23.760235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:23.845126 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7d14ac1-c147-4ec5-beb5-c8f2fcc3a0d2 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928380 Aug 29 10:36:23.846509 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 245/540] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:23.853385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:23.854308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:23.866238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:23.870547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:23.871494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:23.872407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:23.873276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:23.873951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:24.215446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:24.223962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:24.235575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:24.236728 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b3bf9b1d-aa1d-4c76-b24b-9545aaf36acb tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1361 microversion: 2.25 time: 0.388897 Aug 29 10:36:24.237294 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 246/541] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:23 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:24.241772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:24.242406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:24.254716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:24.255881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:24.256326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:24.257039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:24.257603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:24.258061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:24.519282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:24.527980 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d23c7ea4-c43c-4802-a95f-c42109142406 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1314 microversion: 2.1 time: 0.289629 Aug 29 10:36:24.528784 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 247/542] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:24 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:24.548059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:24.548819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:24.555398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:24.555887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:24.556326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:24.557031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:24.557517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:24.557977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.111799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:25.120428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-182485e8-6b82-4608-978a-7195493609b6 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.590401 Aug 29 10:36:25.121621 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 248/543] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:24 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:25.127378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:25.128281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:25.135139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.136022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.136606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.137465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.138144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.138743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.625652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:25.633361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-79b6e3ae-da22-428d-a915-5bd5575295cb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1311 microversion: 2.1 time: 0.510566 Aug 29 10:36:25.633978 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 249/544] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:25 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1311 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:25.650850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:25.651453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:25.657361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.657883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.658319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.659005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.659455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.659873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.797262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:25.805004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9237f712-d500-41cc-be68-86e6f81d911f tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1280 microversion: 2.1 time: 0.158016 Aug 29 10:36:25.805586 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 250/545] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:25 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:25.817925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:25.817925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:25.823545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.824039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.824507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:25.825206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:25.825656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:25.826116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.319249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:26.327116 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10519e71-5334-4188-9187-b1b973b928b3 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1586 microversion: 2.1 time: 0.520468 Aug 29 10:36:26.327784 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 251/546] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:25 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1586 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:26.332568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:26.333167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:26.339237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.339955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.340387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.341286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.341763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.342186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.369634 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad0e8d0e-13bd-4988-b2c2-9c6eeefa0538 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.346916 Aug 29 10:36:26.371026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 296/547] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:36:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:26.377783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04c361b-6a45-4aa2-8151-d50603f0f59c", "tag": "faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:26.388722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.389204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.389639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.400747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] Creating event network-changed:faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074 for instance c04c361b-6a45-4aa2-8151-d50603f0f59c on n-h1-854121-10 Aug 29 10:36:26.405899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-226e0b13-66fd-44f0-ac56-771faf9a4dc0 req-7fe98de9-e9fe-425c-a6e5-bcc3a9794a01 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033325 Aug 29 10:36:26.406606 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 297/548] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:26.411636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f4a7d-8051-43bf-9939-a14a19e0f895", "name": "network-vif-plugged", "status": "completed", "tag": "4e1f978f-971b-41b8-9a23-fcc311e906e5"}, {"server_uuid": "758d1aa2-5ace-4c5b-82d8-4b18216f0b80", "name": "network-vif-plugged", "status": "completed", "tag": "7827b09f-7162-447d-ad69-20d7a65affb4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:26.423593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.424080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.424511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.439827 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Creating event network-vif-plugged:4e1f978f-971b-41b8-9a23-fcc311e906e5 for instance 449f4a7d-8051-43bf-9939-a14a19e0f895 on n-h2-854121-10 Aug 29 10:36:26.440341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] Creating event network-vif-plugged:7827b09f-7162-447d-ad69-20d7a65affb4 for instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 on n-h1-854121-10 Aug 29 10:36:26.451263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-632a8611-8f81-4b84-9084-7031d883b1d5 req-d91b3374-e2ba-4028-a45e-625f06333fc1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043238 Aug 29 10:36:26.453020 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 298/549] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:26.459146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:26.460364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:26.485022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.488723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.490297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.491217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.495378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.495862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.652400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:26.662701 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b123ca36-5763-4949-86ae-47bf1d015f69 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.333677 Aug 29 10:36:26.663291 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 252/550] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:26 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:26.669513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:26.670155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:26.677194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.677933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.678730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.679595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.680056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.680508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.914873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:26.923529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:26.925044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:26.926110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd8a568a-97b5-4bbc-bed0-aedd2c80610a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1361 microversion: 2.25 time: 0.471657 Aug 29 10:36:26.927282 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 299/551] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:26 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:26.931828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:26.932873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:26.942502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.943156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.944514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:26.945355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:26.945848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:26.946356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.071668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:27.079401 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c3fa12e-bbf5-427a-a70f-d8bfa66c5d3f tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1464 microversion: 2.1 time: 0.413934 Aug 29 10:36:27.080156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 253/552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:26 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1464 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:27.085041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:27.085773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:27.092144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.093435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.094085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.094947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.095546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.096137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.257090 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67c4faed-c076-40ac-becb-3eb6c3ac3a48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175707 Aug 29 10:36:27.257815 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 254/553] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:36:27 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:27.262759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed227278-2b28-4885-a68a-b86660901dcf tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c74b0430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:27.271402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:27.279408 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63240f11-6a1b-46cd-8b99-11ee2770c840 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1318 microversion: 2.1 time: 0.351280 Aug 29 10:36:27.280204 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 300/554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:26 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:27.285504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:27.286121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:27.291737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:27.293672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.294291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.294804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.295626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.296939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.297450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.933444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:27.954247 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca0e26eb-7b66-4b3b-8522-e6b6f6548dab tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1311 microversion: 2.1 time: 0.671846 Aug 29 10:36:27.975387 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 301/555] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:27 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1311 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:27.981467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:27.982460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:27.990576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.991302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.991911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:27.992810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:27.994026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:27.994635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.049656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed227278-2b28-4885-a68a-b86660901dcf tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/0c3b7926-8eb3-4ef8-98ec-3a0f9b0e1c1b" status: 200 len: 142 microversion: 2.1 time: 0.790772 Aug 29 10:36:28.051317 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 255/556] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:27 2022] GET /compute/v2.1/os-floating-ips/0c3b7926-8eb3-4ef8-98ec-3a0f9b0e1c1b => generated 142 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:28.069148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-38256113", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:28.159167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:28.385167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:28.398011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b08c98fd-0f5a-4796-a692-32dccc2aaf8e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.420948 Aug 29 10:36:28.399425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 302/557] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:27 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:28.404125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a83502-7a38-431b-8a73-da7f0c94f40f", "tag": "2269d1de-4fef-4763-8d15-5fefbc2a359f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:28.414846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.415649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.416182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.429236 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] Creating event network-changed:2269d1de-4fef-4763-8d15-5fefbc2a359f for instance d1a83502-7a38-431b-8a73-da7f0c94f40f on n-h1-854121-10 Aug 29 10:36:28.434840 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ef8f74e7-7167-4b7c-9bcc-d9f77fe2286a req-0ce1933f-61b3-41a2-83f0-8e0fad12b364 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034201 Aug 29 10:36:28.435795 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 303/558] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:28.441182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:28.441903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:28.448866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.449363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.449823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.450702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.451164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.451593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.843558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:28.843943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:28.844417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:28.844823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:28.845232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:28.848456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:28.862101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:28.865567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.866552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.867165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.868083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.868700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.869377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.872302 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de5cb9f3-1a17-45a9-9ab8-ea862a6fb317 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.435122 Aug 29 10:36:28.880169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 304/559] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:28 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:28.890532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:28.891477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:28.897480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.898433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.899036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.899742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:28.900192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:28.900613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:28.906944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:28.912749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Getting quotas for user a9dbd3b826964971aa24d942a5c16440 and project 49a739367574418c86f7414199fd9729. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:28.935000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:28.941090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:29.006918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75bce209-d6ae-4518-a012-0aa86e937895 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954290 Aug 29 10:36:29.007795 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 256/560] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:29.012561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fe6add1-3d64-4abc-b210-86769b102813 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c74b0ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:29.247756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:29.256787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:29.269521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:29.271006 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e98aa0e8-4c59-4843-bf21-43aa8b55b08c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1557 microversion: 2.25 time: 0.388871 Aug 29 10:36:29.272032 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 305/561] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:28 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1557 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:29.289326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:29.291097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:29.303905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:29.304479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:29.305239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:29.306068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:29.306598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:29.307305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:29.726755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:29.736109 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0635765-2dce-48e4-9333-6abb862079d3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1468 microversion: 2.1 time: 0.462902 Aug 29 10:36:29.753528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 306/562] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:29 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1468 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:29.759203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:29.760033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:29.768315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:29.769071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:29.770404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:29.771487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:29.772126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:29.773163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:30.500683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:30.509607 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49d28c7c-5dd8-403e-863a-8d09f3a50cf0 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 200 len: 1586 microversion: 2.1 time: 0.754653 Aug 29 10:36:30.510318 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 307/563] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:29 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 1586 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:30.517387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8566034-3f61-4670-87f9-c70f21528d2d", "tag": "60c5ce34-0b6b-4d39-b10e-b4f0a4b68587"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:30.527186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:30.528029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:30.528480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:30.541368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] Creating event network-changed:60c5ce34-0b6b-4d39-b10e-b4f0a4b68587 for instance b8566034-3f61-4670-87f9-c70f21528d2d on n-h1-854121-10 Aug 29 10:36:30.546942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-85195058-327f-4ba1-82c1-3801caa1a5f7 req-8360aeeb-5d48-4afd-ac26-4e34a48b21f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Aug 29 10:36:30.547543 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 308/564] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:30.554308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:30.555013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:30.562632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:30.562632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:30.563201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:30.563985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:30.564837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:30.565280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.004822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:31.013919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc0e5083-353e-426e-9eb4-2afa92b6581b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1311 microversion: 2.1 time: 0.464926 Aug 29 10:36:31.014698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 309/565] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:30 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1311 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:31.020637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.021519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.029813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.031137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.031645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.032450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.032983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.033483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.141369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:31.149215 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44fdf838-3f83-4c4c-a6f3-562685f3ebdd tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1270 microversion: 2.1 time: 0.132613 Aug 29 10:36:31.150310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 310/566] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:31.155055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.156019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.162432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.163194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.164009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.166138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.166818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.167453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.345176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fe6add1-3d64-4abc-b210-86769b102813 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/0c3b7926-8eb3-4ef8-98ec-3a0f9b0e1c1b" status: 202 len: 0 microversion: 2.1 time: 2.336491 Aug 29 10:36:31.347937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 257/567] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:36:29 2022] DELETE /compute/v2.1/os-floating-ips/0c3b7926-8eb3-4ef8-98ec-3a0f9b0e1c1b => generated 0 bytes in 2340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:31.355248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.356861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.368092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.368962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.371126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.372216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.373276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.374608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.516925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:31.522849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:31.573864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:31.582117 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eff1318e-cc4d-4793-895e-fc9be55b9b59 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.232642 Aug 29 10:36:31.582691 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 258/568] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:31.590718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b460e15-2ee1-4f80-9d12-46b2a0f88fc5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 2051 microversion: 2.25 time: 0.439050 Aug 29 10:36:31.591494 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 311/569] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 2051 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:31.597046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.597908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.604113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.604864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.605572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.606389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.606911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.607637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.647146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-767157212", "block_migration": true, "disk_over_commit": false}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:31.649804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.656674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.657170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.657614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.658350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.658806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.659234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.685928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lazy-loading 'flavor' on Instance uuid 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:31.699681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Going to try to live migrate instance to tempest-host-767157212 {{(pid=128682) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:36:31.707498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] HTTP exception thrown: Compute host tempest-host-767157212 could not be found. Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Request method failure captured: Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80/action HTTP/1.1 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 106 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaRolJNV4UVJoyojSeU3VyXw9SvAyHmLkGXDxvX-rVcNrxtyD393z4jP8LHikkEpf4nsp8Tm-lvyTi-Kg8WCNQpKO8aS_7Mp8Vmgyf4H9DJlXuxNscdFY62UhbP2pJFdSl89ZLS2ruVcu2jgafmqYcCm4lTI22AbEeEEnWeLUUstZw Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 56f67d28f8004e02904b836973975a68 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/56f67d28f8004e02904b836973975a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_56f67d28f8004e02904b836973975a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/56f67d28f8004e02904b836973975a68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/56f67d28f8004e02904b836973975a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 56f67d28f8004e02904b836973975a68 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationNegativeTest-1335695693-project-admin Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 83bc11a69bfe4d76b1c5bc5d84cccd00 Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationNegativeTest-1335695693-project-admin Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: {"os-migrateLive": {"host": "tempest-host-767157212", "block_migration": true, "disk_over_commit": false}} Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: exception: Compute host tempest-host-767157212 could not be found. Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '758d1aa2-5ace-4c5b-82d8-4b18216f0b80', 'body': {'os-migrateLive': {'host': 'tempest-host-767157212', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 29 10:36:31.712058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-767157212 could not be found. Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-767157212 could not be found. Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-767157212 could not be found. Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Returning 400 to user: Compute host tempest-host-767157212 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd917959-abb3-417a-ba8f-ce69ec29ae1b tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80/action" status: 400 len: 99 microversion: 2.1 time: 0.129717 Aug 29 10:36:31.717547 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 259/570] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Aug 29 10:36:31 2022] POST /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80/action => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:36:31.723330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b751e2f-2712-42e5-ad5f-10addabcbc7b", "tag": "16a48b1e-6410-4b24-856f-ac0dce3ebfd1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:31.735781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.736363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.736870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.750210 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] Creating event network-changed:16a48b1e-6410-4b24-856f-ac0dce3ebfd1 for instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b on n-h2-854121-10 Aug 29 10:36:31.755398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0e5766a9-2b4e-4258-bb62-9b35191c600d req-17c69bfb-b8b5-484b-818b-2f9b661d69e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Aug 29 10:36:31.756349 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 260/571] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:31.761529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04c361b-6a45-4aa2-8151-d50603f0f59c", "name": "network-vif-plugged", "status": "completed", "tag": "faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:31.766327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:31.772139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.773651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.774196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.776102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa4188af-f481-43db-820a-c4e23f935584 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.183395 Aug 29 10:36:31.776680 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 312/572] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:31.788156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:31.788156 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] Creating event network-vif-plugged:faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074 for instance c04c361b-6a45-4aa2-8151-d50603f0f59c on n-h1-854121-10 Aug 29 10:36:31.792440 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-84966308-1dfe-45d6-b48b-051bc7a11205 req-6b9c62dd-04d9-46bf-aa8e-0de73d098aff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034862 Aug 29 10:36:31.793488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 261/573] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:31.793613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04521cef-1ab2-49bd-b71c-3ade192dd824 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c74010d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.798814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:31.799525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:31.805839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.806332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.806774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:31.807479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:31.807935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:31.808364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.051072 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04521cef-1ab2-49bd-b71c-3ade192dd824 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.266029 Aug 29 10:36:32.052415 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 313/574] 10.222.0.47 () {58 vars in 1164 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:32.058176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.059094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:32.075136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.075782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.076288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.077182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.083662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.084293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.142878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:32.158528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c4eef2f-a629-40ed-bad6-b88c40f2873d tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 2051 microversion: 2.25 time: 0.363595 Aug 29 10:36:32.159372 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 262/575] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:31 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 2051 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:32.164619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.165419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:32.178112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.178628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.179077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.179800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.181890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.182875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.299452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:32.313764 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-36ecdbb1-ebbb-4fe2-b7ff-6540129f9851 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1468 microversion: 2.1 time: 0.259499 Aug 29 10:36:32.325739 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 314/576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:32.331351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7a834a5-7090-4f0a-89fa-03888522b860 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c7485d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.470863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:32.480848 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4bf8e3d-9982-4bd2-9f41-1eb72305ad56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1311 microversion: 2.1 time: 0.320051 Aug 29 10:36:32.481430 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 263/577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:32.488258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.489067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:32.498463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.499561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.500973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.502390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.503536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.504264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.721723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f7a834a5-7090-4f0a-89fa-03888522b860 tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.405828 Aug 29 10:36:32.730504 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 315/578] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:32.734890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.739114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.739701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.740196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.741304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.742182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.742727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.764686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:32.768414 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d06a8fb-5787-4284-b103-b698a0f9c873 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.044540 Aug 29 10:36:32.769530 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 316/579] 10.222.0.47 () {60 vars in 1217 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:36:32.772669 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5eb6f99b-5769-43f2-a502-eb6c2e5594d8 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.288146 Aug 29 10:36:32.785730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-825262282", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:32.786400 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 264/580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:32.792289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:32.793079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:32.800897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.801552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.802261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.803717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:32.804375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:32.805925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:32.852208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:33.193207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:33.208297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42fd6951-3832-4860-b585-b30cdcf36ecc tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.419261 Aug 29 10:36:33.228330 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 265/581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:32 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:33.250600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-999926c9-3c85-454f-a345-98c36b3aca3f tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c7625d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:33.642183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:33.642920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:33.643390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:33.643827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:33.644306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:33.654139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.654921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.656062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:33.656992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.657509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.658133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:33.676888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Getting quotas for project b7de8c335e9e46258711b63a44ca8ddf. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:33.682958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Getting quotas for user 51a39e43f5134b4b8424600ee2563a0f and project b7de8c335e9e46258711b63a44ca8ddf. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:33.695314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:33.697595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:33.744573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35a2e520-1b45-4379-99cf-734373a539c8 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973703 Aug 29 10:36:33.746961 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 317/582] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:36:33.763804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:33.764358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:33.772905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.773125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.773630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:33.774376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.774834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.775260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:33.854172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fe51221-0cf4-4af0-9518-214cd385b7b5 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895/action" status: 202 len: 0 microversion: 2.25 time: 0.105929 Aug 29 10:36:33.857994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 318/583] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:36:33 2022] POST /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:33.864138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:33.864939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:33.875377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.876625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.877073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:33.879410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:33.880337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:33.880777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.163199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:34.173041 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9bd2ed3d-9a9e-4239-986e-e0acd7e7f693 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.312787 Aug 29 10:36:34.175068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 319/584] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:33 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:34.180388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1453d401-aa53-4b60-8369-7c02c38da691", "tag": "371b8c35-ff2a-4824-8f4d-57d31fcbc18d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:34.191291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.191841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.192201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.205185 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] Creating event network-changed:371b8c35-ff2a-4824-8f4d-57d31fcbc18d for instance 1453d401-aa53-4b60-8369-7c02c38da691 on n-h1-854121-10 Aug 29 10:36:34.211651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0795e815-c94f-46ea-99c8-948fe7bd43fa req-98054bdc-e460-40ae-98a2-ccb223e3733d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034972 Aug 29 10:36:34.212256 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 320/585] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:34.218531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.219603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.227657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.228191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.228627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.229480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.229999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.230608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.443151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:34.452814 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9a6ea70-0862-4432-97db-779bd65ac387 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1494 microversion: 2.1 time: 0.238387 Aug 29 10:36:34.453441 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 321/586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:34.458183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.458988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.465364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.466117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.466788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.468365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.469030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.469887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.547557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:34.558075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-309f3a76-d2fd-428d-b5c5-77ae007713c3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1270 microversion: 2.1 time: 0.103300 Aug 29 10:36:34.570151 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 322/587] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:34.570151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.570151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.571501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.571997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.572437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.573140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.574834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.574834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.595328 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-999926c9-3c85-454f-a345-98c36b3aca3f tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/51690eac-c4bc-43d4-94e9-77b51475055f" status: 202 len: 0 microversion: 2.1 time: 1.364667 Aug 29 10:36:34.595911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 266/588] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:36:33 2022] DELETE /compute/v2.1/os-floating-ips/51690eac-c4bc-43d4-94e9-77b51475055f => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:34.604749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.605364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.612776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.613265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.613724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.614420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.614913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.615456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.757671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:34.768007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa6b416b-6108-4da4-93d9-25b986074ba1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.208328 Aug 29 10:36:34.768822 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 323/589] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:34.773106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.773737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.781132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.781566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.782112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.782706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.783170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.783596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.792200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:34.805544 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c9d03f0-b831-4b29-a7ca-8698c6be235c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 2036 microversion: 2.25 time: 0.208606 Aug 29 10:36:34.810317 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 267/590] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 2036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:34.867331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:34.868154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:34.876070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.876564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.877006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.877727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:34.878199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:34.878629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:34.975021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:34.984757 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9850929f-a474-4f15-9046-24e0c1246627 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.215109 Aug 29 10:36:34.985340 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 324/591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:34.995013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb11024d-241e-4a59-928e-202e02dd972a tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c73a6790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:35.288820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2796ead-6cac-48b5-8ff8-4ab412230929 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1647 microversion: 2.1 time: 0.480495 Aug 29 10:36:35.289745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 268/592] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:34 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1647 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:35.307299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": "auto"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:35.310361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:35.318015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:35.318469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:35.318903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:35.319920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:35.320373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:35.320957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:35.348810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'flavor' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:35.362053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Going to try to live migrate instance to n-h1-854121-10 {{(pid=128682) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:36:36.281364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb11024d-241e-4a59-928e-202e02dd972a tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/574da0b2-e10f-465f-9802-3c5f022202d3" status: 202 len: 0 microversion: 2.1 time: 1.291283 Aug 29 10:36:36.281995 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 325/593] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:36:34 2022] DELETE /compute/v2.1/os-floating-ips/574da0b2-e10f-465f-9802-3c5f022202d3 => generated 0 bytes in 1293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:36.286478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:36.287081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:36.294767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.295252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.296524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.297254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.297898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.298509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.380408 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96bce534-d36c-4854-803c-baed2f102fde tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895/action" status: 202 len: 0 microversion: 2.25 time: 1.088319 Aug 29 10:36:36.387685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 269/594] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:36:35 2022] POST /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895/action => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:36.396315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:36.399923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:36.415687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.416498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.416925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.418815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.419150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.419821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.573873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:36.584200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c72d1d3-581d-4428-b617-c3564709aec1 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.300951 Aug 29 10:36:36.597726 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 326/595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:36 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:36.599525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a83502-7a38-431b-8a73-da7f0c94f40f", "name": "network-vif-plugged", "status": "completed", "tag": "2269d1de-4fef-4763-8d15-5fefbc2a359f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:36.612683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.613645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.614258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.633173 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] Creating event network-vif-plugged:2269d1de-4fef-4763-8d15-5fefbc2a359f for instance d1a83502-7a38-431b-8a73-da7f0c94f40f on n-h1-854121-10 Aug 29 10:36:36.640427 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-eee0c4f8-44af-4df4-886e-54e78f27cc78 req-aef8746b-e169-4759-9e0b-05d71b2ce071 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051418 Aug 29 10:36:36.641522 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 327/596] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:36.650895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:36.652076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:36.669633 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f005738-5ac7-46cb-afd8-bb9aa94c59e9 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1647 microversion: 2.1 time: 0.279735 Aug 29 10:36:36.672168 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 270/597] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:36 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1647 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:36.680819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:36.681576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:36.688519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.689080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.689625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.690462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.691732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.692288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.696171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.697435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.698120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:36.699062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:36.699519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:36.699943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:37.431911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:37.439907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5da1c5c6-6613-473d-8990-f049767153e3 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.795293 Aug 29 10:36:37.450254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:37.454750 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 328/598] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:36 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:37.462445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:37.463303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:37.470083 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e96df87e-dae6-4342-9d6a-dc64627467fa tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.795640 Aug 29 10:36:37.470666 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 271/599] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:36 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:37.471256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:37.471751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:37.472185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:37.473047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:37.473509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:37.473970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:37.476256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58f45516-51cd-40c5-885e-582498eaf01c tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] Calling method '.version_select at 0x7f66c74fec10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:37.817694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:37.827688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0ee86cd7-1cba-416f-8cfc-3f1776455219 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.370848 Aug 29 10:36:37.828999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 329/600] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:37 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:37.835289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:37.836396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:37.845035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:37.845828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:37.846266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:37.846971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:37.847608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:37.848201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.229594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:38.239631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:38.241156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:38.242481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b6e28d11-3c82-4e0b-b233-4584d4db2da7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1567 microversion: 2.25 time: 0.412541 Aug 29 10:36:38.243041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 330/601] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:37 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1567 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:38.247519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:38.252781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.254009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.254816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.255972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.256598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.257176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.285124 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83329647-890a-4776-9df0-acec081be7d2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040557 Aug 29 10:36:38.285761 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 331/602] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:36:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:38.290409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:38.291224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:38.297996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.298482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.299190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.299805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.300261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.300681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.660837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:38.669340 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-555b9e2c-34d0-46c5-a11a-7e54d09ad9cf tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1325 microversion: 2.1 time: 0.382406 Aug 29 10:36:38.670233 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 332/603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:38 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:38.687362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be587bae-68da-41b6-93de-5d4246dcae45", "tag": "3e373a57-856c-4205-8064-914407ac10c2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:38.696363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.696850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.697261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.710579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] Creating event network-changed:3e373a57-856c-4205-8064-914407ac10c2 for instance be587bae-68da-41b6-93de-5d4246dcae45 on n-h2-854121-10 Aug 29 10:36:38.716944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e9e3d11a-acc9-48b1-9fe1-70f011a2001e req-7587667f-3f6e-457f-b92c-729d70aefea0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Aug 29 10:36:38.717908 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 333/604] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:38.724787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f4a7d-8051-43bf-9939-a14a19e0f895", "name": "network-vif-unplugged", "status": "completed", "tag": "4e1f978f-971b-41b8-9a23-fcc311e906e5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:38.735362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.736096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.736519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.740810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:38.749499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] Creating event network-vif-unplugged:4e1f978f-971b-41b8-9a23-fcc311e906e5 for instance 449f4a7d-8051-43bf-9939-a14a19e0f895 on n-h2-854121-10 Aug 29 10:36:38.754911 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-74362d13-7eee-4d99-b2ab-48105b38e0e0 req-6a8244d1-76b6-4fa2-be9a-31f794b209fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035538 Aug 29 10:36:38.755510 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 334/605] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:38.762266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:38.765588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:38.773503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.773940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.774371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.775067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.775522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.775941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.866355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lazy-loading 'flavor' on Instance uuid c04c361b-6a45-4aa2-8151-d50603f0f59c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:38.872577 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58f45516-51cd-40c5-885e-582498eaf01c tempest-FloatingIPDetailsTestJSON-188354331 tempest-FloatingIPDetailsTestJSON-188354331-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/f3de2916-f5e0-4c2b-8b2d-bd48b6413417" status: 202 len: 0 microversion: 2.1 time: 1.399847 Aug 29 10:36:38.873280 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 272/606] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:36:37 2022] DELETE /compute/v2.1/os-floating-ips/f3de2916-f5e0-4c2b-8b2d-bd48b6413417 => generated 0 bytes in 1401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:38.878228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:38.878913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:38.880953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:38.887433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.888007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.888503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.889811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:38.890469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:38.891079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:38.916331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Going to try to live migrate instance to n-h2-854121-10 {{(pid=128681) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:36:38.926962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:39.054537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.066647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f4f1177-ccb3-42ee-898a-089157138947 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.191889 Aug 29 10:36:39.084542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 273/607] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:38 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:39.084542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.084542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.085736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.086747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.087465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.088614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.089263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.090023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.264996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.273659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5675554-2848-4ccd-b45d-23e33da1d395 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.202593 Aug 29 10:36:39.274473 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 274/608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:39.280302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b751e2f-2712-42e5-ad5f-10addabcbc7b", "name": "network-vif-plugged", "status": "completed", "tag": "16a48b1e-6410-4b24-856f-ac0dce3ebfd1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:39.293926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.294938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.296144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.309938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] Creating event network-vif-plugged:16a48b1e-6410-4b24-856f-ac0dce3ebfd1 for instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b on n-h2-854121-10 Aug 29 10:36:39.315528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5c445c77-4025-42a6-aaee-f7fe169e297a req-10ab8c0c-298f-421c-be12-b7901de38f05 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039422 Aug 29 10:36:39.316891 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 275/609] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:39.323648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.324676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.332069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.333038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.333834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.335110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.336163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.336928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.518688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.529168 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-801dfb01-4c82-448a-b2f7-c69bb996f230 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.210688 Aug 29 10:36:39.529921 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 276/610] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:39.535247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.535850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.542161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.542849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.543478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.544415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.544820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.545245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.681271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.690702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.692137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.693292 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6c3bc3e-4ecd-41de-92f0-a3bd9361fb41 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1567 microversion: 2.25 time: 0.162242 Aug 29 10:36:39.693888 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 277/611] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:39.698219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.698822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.704727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.705204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.705637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.706352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.706805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.707227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.722338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:39.839946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:39.848330 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e80bc0dc-a9a7-45eb-8ae3-48a735ce19a3 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1522 microversion: 2.1 time: 0.153489 Aug 29 10:36:39.848979 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 278/612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:39.869406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.869953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.875831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.876395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.876720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.877406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.877889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.878307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.907452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] HTTP exception thrown: Action 999 not found Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Request method failure captured: Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f/os-instance-actions/999 HTTP/1.1 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaiCD2MdytR3mp9SM90O7Y3N700eI8571s-Nl2FGfTvs7kpfOZS3qQyU4XcVzohIK_OO6Bc9PBiAmlcaMYVEoR4UF_MVoG6dMRAdkkzbCzC1F8_D9oxv9_4IzMxYZrXzPT_GaHp3iAVcrSQPVfgdXRt-meHlN1oQO81nB7IAkU5dLY Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5afec0f0a7684793b8bc192f18f824a2 Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: exception: Action 999 not found Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': 'd1a83502-7a38-431b-8a73-da7f0c94f40f', 'id': '999'} Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 29 10:36:39.909157 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.912600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Returning 404 to user: Action 999 not found {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:39.912600 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16ef50b1-d292-4075-8b9f-7c434489a3d0 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.045145 Aug 29 10:36:39.912600 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 279/613] 10.222.0.47 () {58 vars in 1308 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f/os-instance-actions/999 => generated 66 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:36:39.920214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '.version_select at 0x7f66c7399040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.920895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: 314bae43-60fb-4aae-b66c-828a1e1a63c7] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.926573 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] HTTP exception thrown: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Request method failure captured: Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/314bae43-60fb-4aae-b66c-828a1e1a63c7/os-instance-actions HTTP/1.1 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaiCD2MdytR3mp9SM90O7Y3N700eI8571s-Nl2FGfTvs7kpfOZS3qQyU4XcVzohIK_OO6Bc9PBiAmlcaMYVEoR4UF_MVoG6dMRAdkkzbCzC1F8_D9oxv9_4IzMxYZrXzPT_GaHp3iAVcrSQPVfgdXRt-meHlN1oQO81nB7IAkU5dLY Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5afec0f0a7684793b8bc192f18f824a2 Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '314bae43-60fb-4aae-b66c-828a1e1a63c7'} Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:39.928139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Returning 404 to user: Instance 314bae43-60fb-4aae-b66c-828a1e1a63c7 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b0d0546e-2d7b-431c-acd4-0116a894e7e7 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/314bae43-60fb-4aae-b66c-828a1e1a63c7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013061 Aug 29 10:36:39.936675 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 280/614] 10.222.0.47 () {58 vars in 1296 bytes} [Mon Aug 29 10:36:39 2022] GET /compute/v2.1/servers/314bae43-60fb-4aae-b66c-828a1e1a63c7/os-instance-actions => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:36:39.940652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:39.941154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:39.948487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.948979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.949408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.950132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:39.950583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:39.951004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:39.976086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:36:40.052915 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fff967a1-9bd0-4515-8b18-0ae2448a2ce6 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 204 len: 0 microversion: 2.1 time: 0.117712 Aug 29 10:36:40.053577 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 281/615] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:36:39 2022] DELETE /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:36:40.062965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:40.063727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:40.069754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.070245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.070690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.071387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.071835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.072257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.334166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:40.344948 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eefbfeaf-2f6c-403a-8a63-2cec1158a9c5 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1528 microversion: 2.1 time: 0.286240 Aug 29 10:36:40.346666 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 282/616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:40 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1528 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:40.355704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:40.357876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:40.369138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.370503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.370961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.371687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.372148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.372662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.524286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:40.532769 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2ea3f13-8b7c-43fa-aae9-5241c4577f75 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.184935 Aug 29 10:36:40.533340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 283/617] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:40 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:40.538101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:40.538709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:40.545265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.546433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.546875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.547582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.548036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.548465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.749995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:40.760261 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4770d751-d8ab-49af-ac6c-4810f58f301b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.224332 Aug 29 10:36:40.772961 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 284/618] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:40 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:40.778469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:40.779091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:40.786653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.787146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.787587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.788297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.788758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.789190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.943571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:40.953093 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e27f6ccd-f8fb-4121-a679-a478f0c357b4 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1322 microversion: 2.1 time: 0.179127 Aug 29 10:36:40.954046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 285/619] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:40 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:40.958574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:40.959180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:40.972894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.973531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.974208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:40.975276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:40.975888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:40.976393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.120379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:41.130271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:41.131714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:41.133004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad4650b9-1ae5-42e5-acdb-375b3e321508 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1567 microversion: 2.25 time: 0.178238 Aug 29 10:36:41.133917 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 286/620] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:40 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:41.138378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f4a7d-8051-43bf-9939-a14a19e0f895", "tag": "4e1f978f-971b-41b8-9a23-fcc311e906e5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:41.148114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.148593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.149025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.161304 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] Creating event network-changed:4e1f978f-971b-41b8-9a23-fcc311e906e5 for instance 449f4a7d-8051-43bf-9939-a14a19e0f895 on n-h2-854121-10 Aug 29 10:36:41.166470 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0a8ca862-90fe-464f-94d1-6264a0718ee5 req-d969ce4a-cb69-4f0a-a58c-fe6cdb5c1302 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Aug 29 10:36:41.167418 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 287/621] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:41.331667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1453d401-aa53-4b60-8369-7c02c38da691", "name": "network-vif-plugged", "status": "completed", "tag": "371b8c35-ff2a-4824-8f4d-57d31fcbc18d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:41.341866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.343147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.343822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.356393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] Creating event network-vif-plugged:371b8c35-ff2a-4824-8f4d-57d31fcbc18d for instance 1453d401-aa53-4b60-8369-7c02c38da691 on n-h1-854121-10 Aug 29 10:36:41.363340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8ac218c2-92ef-438c-895c-b99b6f012a9c req-41bd7344-950d-4188-9ae6-accfe2747a9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035219 Aug 29 10:36:41.363340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 288/622] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:36:41.369476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:41.370371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:41.377149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.377633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.378091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.378821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.379284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.379703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.526355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:41.537164 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7bec4cd-a110-4cb5-ac6a-c498d430565c tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1528 microversion: 2.1 time: 0.171947 Aug 29 10:36:41.538084 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 289/623] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:41 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1528 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:41.560097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:41.560621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:41.567620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.568178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.568612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.569608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.570095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.570519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.749740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:41.759268 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0633fef5-1a5b-4831-8078-a6eac78b42cd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.208296 Aug 29 10:36:41.761039 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 290/624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:41 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:41.784606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:41.785328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:41.792134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.792770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.793285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:41.794313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:41.794840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:41.795918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:42.004781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:42.013677 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18893917-8ef5-4a5c-8efb-593c8306dd06 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.234697 Aug 29 10:36:42.027704 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 291/625] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:41 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:42.032800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:42.033881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:42.049621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:42.050234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:42.051088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:42.051841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:42.052685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:42.053125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:42.654587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:42.665105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3568be0-c471-426e-81f6-eb598022b4a1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1471 microversion: 2.1 time: 0.636343 Aug 29 10:36:42.666202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 292/626] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:42 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:42.672020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:42.672766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:42.679062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:42.679851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:42.680650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:42.681762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:42.682636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:42.683309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.022882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.036825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.039102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.040318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc5e4d26-95b6-4816-93c7-21d29135a97f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1567 microversion: 2.25 time: 0.372981 Aug 29 10:36:43.048776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 293/627] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:42 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:43.058466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:43.059324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.076057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.077798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.078476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.081477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.082171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.084206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.191799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8afc19e-d3f8-4942-b313-01f372649c7d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c/action" status: 202 len: 0 microversion: 2.1 time: 4.434965 Aug 29 10:36:43.192503 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 335/628] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:38 2022] POST /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c/action => generated 0 bytes in 4436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:43.199336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:43.200127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.211184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afec0f0a7684793b8bc192f18f824a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba30aa9ba3e4d0d889c78b095558c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.216101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.220294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.220922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.223816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.224524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.225200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.227335 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43548a03-9d1e-4ea1-9684-4cd4f4ada440 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 200 len: 1310 microversion: 2.1 time: 0.176429 Aug 29 10:36:43.229229 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 294/629] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:43 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 1310 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:43.238075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:43.238976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.259255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lazy-loading 'flavor' on Instance uuid 6b751e2f-2712-42e5-ad5f-10addabcbc7b {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:43.267339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.271624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.273207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.275596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.278600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.279550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.346328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9aa74984-15fc-4211-bb48-484a159498e6 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.152269 Aug 29 10:36:43.348179 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 336/630] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:43 2022] POST /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:43.355840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:43.356903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.365685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.366708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.367870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.369868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.370920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.372206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.690252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:43.795965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.802942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:43.829062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5f94e77-d588-4d23-b44b-f3c4ed441f80 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.597502 Aug 29 10:36:43.830857 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 295/631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:43 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:43.833730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:43.837135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:43.838643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.856704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.857599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.860002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53477991-b687-47f5-8732-04905c64251d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1312 microversion: 2.1 time: 0.500434 Aug 29 10:36:43.860579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.861603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 337/632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:43 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:43.861917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.862665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.863306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.872904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a83502-7a38-431b-8a73-da7f0c94f40f", "name": "network-vif-deleted", "tag": "2269d1de-4fef-4763-8d15-5fefbc2a359f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:43.901966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.902745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.904022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.923516 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] Creating event network-vif-deleted:2269d1de-4fef-4763-8d15-5fefbc2a359f for instance d1a83502-7a38-431b-8a73-da7f0c94f40f on n-h1-854121-10 Aug 29 10:36:43.929599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6a751849-2d56-4025-9d76-f33b4c676a58 req-8266a39d-db5e-41df-b9f7-c73d85cc0188 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066571 Aug 29 10:36:43.930447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 338/633] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:43.938195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:43.939012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:43.946986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.947610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.948301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:43.949280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:43.950025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:43.950671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.393549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:44.403966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55c24cc5-05f1-4b7c-b0f0-f89ed62cbf79 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.571802 Aug 29 10:36:44.404614 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 296/634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:43 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:44.410712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:44.411604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:44.418769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.419266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.419705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.420555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.421032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.421459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.823719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:44.829480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb2b4a52-032e-4f88-acd9-5a22aca9d91c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1615 microversion: 2.1 time: 0.897403 Aug 29 10:36:44.831226 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 339/635] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:43 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1615 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:44.838295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:44.839361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] [instance: d1a83502-7a38-431b-8a73-da7f0c94f40f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:44.846033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:44.849894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.851003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.851701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.853050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.853519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:44.854257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.854893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.855563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b795daa2-14a4-49bb-b8dc-d9effd8bd1e8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1567 microversion: 2.25 time: 0.448905 Aug 29 10:36:44.864798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 297/636] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:44 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:44.871149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] HTTP exception thrown: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Request method failure captured: Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f HTTP/1.1 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaiCD2MdytR3mp9SM90O7Y3N700eI8571s-Nl2FGfTvs7kpfOZS3qQyU4XcVzohIK_OO6Bc9PBiAmlcaMYVEoR4UF_MVoG6dMRAdkkzbCzC1F8_D9oxv9_4IzMxYZrXzPT_GaHp3iAVcrSQPVfgdXRt-meHlN1oQO81nB7IAkU5dLY Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cba30aa9ba3e4d0d889c78b095558c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: cba30aa9ba3e4d0d889c78b095558c17 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1893368861 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5afec0f0a7684793b8bc192f18f824a2 Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1893368861-project Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd1a83502-7a38-431b-8a73-da7f0c94f40f'} Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.873090 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. Aug 29 10:36:44.879194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.880462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:44.880462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:44.881733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] Returning 404 to user: Instance d1a83502-7a38-431b-8a73-da7f0c94f40f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:44.883240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dcbcd2b-1a74-489b-a718-6d0327c850f4 tempest-InstanceActionsNegativeTestJSON-1893368861 tempest-InstanceActionsNegativeTestJSON-1893368861-project] 10.222.0.47 "GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f" status: 404 len: 111 microversion: 2.1 time: 0.050890 Aug 29 10:36:44.884007 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 340/637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:44 2022] GET /compute/v2.1/servers/d1a83502-7a38-431b-8a73-da7f0c94f40f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:36:44.890817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.891460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.891914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.892735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.893438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.893557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:44.894152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:44.894433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.901987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.902477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.902915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.903937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:44.904516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:44.905828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:44.987204 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b while it is in vm_state suspended Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Request method failure captured: Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b/action HTTP/1.1 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGy64DtdFdURokYQUflUxLBPfHFgWi6vtohZBTKb8TQmxvguwYiHqkuuLKjLWUyOaB180g0JMAkby35MqAp0c2RChOiWDAcBq2rcDrzZIoT-CPgKiKT-bArEuAl7bJJDoM1IUgp80SyUSa5ghnxe8ZSyM1oth984rBxw52qDI9nhA Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5925f3b19f724a119605ab1d23d13271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2731346fb6a04e419b330ebf48416ccd Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: {"migrate": {}} Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'migrate' instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b while it is in vm_state suspended Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6b751e2f-2712-42e5-ad5f-10addabcbc7b', 'body': {'migrate': {}}} Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b in vm_state suspended. Cannot resize while the instance is in this state. Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:44.990706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b while it is in vm_state suspended Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b while it is in vm_state suspended Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Returning 409 to user: Cannot 'migrate' instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b while it is in vm_state suspended {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:44.995492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2d35093-f8e8-4214-9893-59dddfa3abb3 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b/action" status: 409 len: 148 microversion: 2.1 time: 0.129221 Aug 29 10:36:44.996927 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 298/638] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:44 2022] POST /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b/action => generated 148 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:36:45.003253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:45.003995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:45.007053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:45.010766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.011413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.011894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.012595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.013183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.013613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.470395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:45.482182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fb2b698-fbca-4325-b15c-0a3a2aff6652 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.596830 Aug 29 10:36:45.487869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:45.507103 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c6483f7-4930-45fe-81c7-3db507ea4508 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1462 microversion: 2.1 time: 0.509654 Aug 29 10:36:45.508354 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 299/639] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:44 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1462 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:45.511296 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 341/640] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:44 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:45.514665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4812b03a-f2ab-4c28-8fae-dd93c4e9935c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4812b03a-f2ab-4c28-8fae-dd93c4e9935c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Request method failure captured: Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action HTTP/1.1 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 39 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGy64DtdFdURokYQUflUxLBPfHFgWi6vtohZBTKb8TQmxvguwYiHqkuuLKjLWUyOaB180g0JMAkby35MqAp0c2RChOiWDAcBq2rcDrzZIoT-CPgKiKT-bArEuAl7bJJDoM1IUgp80SyUSa5ghnxe8ZSyM1oth984rBxw52qDI9nhA Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5925f3b19f724a119605ab1d23d13271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2731346fb6a04e419b330ebf48416ccd Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: {"os-resetState": {"state": "invalid"}} Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '76e6bb99-33e7-4392-b960-91061f49793a', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:45.519664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 10:36:45.523580 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.526420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4812b03a-f2ab-4c28-8fae-dd93c4e9935c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:45.527648 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4812b03a-f2ab-4c28-8fae-dd93c4e9935c tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action" status: 400 len: 144 microversion: 2.1 time: 0.018128 Aug 29 10:36:45.528551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 300/641] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:45 2022] POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:36:45.531056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be587bae-68da-41b6-93de-5d4246dcae45", "name": "network-vif-plugged", "status": "completed", "tag": "3e373a57-856c-4205-8064-914407ac10c2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:45.535416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:45.536998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:45.545783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.547835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.549120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.550964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.551798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.552447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.555190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.555681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.556143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.575826 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] Creating event network-vif-plugged:3e373a57-856c-4205-8064-914407ac10c2 for instance be587bae-68da-41b6-93de-5d4246dcae45 on n-h2-854121-10 Aug 29 10:36:45.588708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1699a565-942f-45ab-a078-0a298b77f16d req-dd150757-ca9a-45ad-90d6-1c6f8502a3b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075794 Aug 29 10:36:45.591156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 342/642] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:45.919523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:45.930788 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38c5b44c-0823-4436-a46c-4b9c8ce23327 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.400975 Aug 29 10:36:45.931738 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 301/643] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:45 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:45.937136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fea8fb74-c5e2-4270-9199-bf9182833651 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fea8fb74-c5e2-4270-9199-bf9182833651 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Request method failure captured: Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action HTTP/1.1 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 31 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGy64DtdFdURokYQUflUxLBPfHFgWi6vtohZBTKb8TQmxvguwYiHqkuuLKjLWUyOaB180g0JMAkby35MqAp0c2RChOiWDAcBq2rcDrzZIoT-CPgKiKT-bArEuAl7bJJDoM1IUgp80SyUSa5ghnxe8ZSyM1oth984rBxw52qDI9nhA Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5925f3b19f724a119605ab1d23d13271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2731346fb6a04e419b330ebf48416ccd Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: {"os-resetState": {"state": 1}} Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '76e6bb99-33e7-4392-b960-91061f49793a', 'body': {'os-resetState': {'state': 1}}} Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 1 Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 10:36:45.941687 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 10:36:45.946292 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:45.948346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fea8fb74-c5e2-4270-9199-bf9182833651 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:45.949712 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fea8fb74-c5e2-4270-9199-bf9182833651 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action" status: 400 len: 120 microversion: 2.1 time: 0.016585 Aug 29 10:36:45.952392 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 302/644] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:45 2022] POST /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:36:45.958533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:45.959328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:45.969012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.969499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.970220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.971806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:45.972302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:45.973266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:45.975527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:45.993569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'deleted': False, 'project_id': 'ab2998f4d6d84aa8bc78039aa624a885'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:46.007161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.009304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.010074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.011016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.011662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.012252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.109816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:46.113581 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54b51f0c-ffde-49b7-9030-30073668035d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.520509 Aug 29 10:36:46.114588 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 343/645] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:36:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:46.126390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:46.129068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Failed to fetch instance by id 999 {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:36:46.129942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Request method failure captured: Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 37 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaGy64DtdFdURokYQUflUxLBPfHFgWi6vtohZBTKb8TQmxvguwYiHqkuuLKjLWUyOaB180g0JMAkby35MqAp0c2RChOiWDAcBq2rcDrzZIoT-CPgKiKT-bArEuAl7bJJDoM1IUgp80SyUSa5ghnxe8ZSyM1oth984rBxw52qDI9nhA Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5925f3b19f724a119605ab1d23d13271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5925f3b19f724a119605ab1d23d13271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5925f3b19f724a119605ab1d23d13271 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-811538650 Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2731346fb6a04e419b330ebf48416ccd Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdminNegativeTestJSON-811538650-project-admin Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: {"os-resetState": {"state": "error"}} Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 999 could not be found. Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:46.132390 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89b438e5-92fc-439c-9c3b-b3be789b3d83 tempest-ServersAdminNegativeTestJSON-811538650 tempest-ServersAdminNegativeTestJSON-811538650-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018013 Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 344/646] 10.222.0.47 () {60 vars in 1179 bytes} [Mon Aug 29 10:36:46 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:36:46.141496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:46.146983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'deleted': False} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:46.152722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.153925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.154367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.155949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.156414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.156853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.272028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:36:46.417854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.418339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.418771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.664340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:46.674753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:46.676441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:46.677684 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-05ef6e70-1db5-45cf-9987-b59f747a96f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1542 microversion: 2.25 time: 0.724007 Aug 29 10:36:46.678356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 303/647] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:45 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1542 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:46.683281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:46.683797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:46.689868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.690649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.691410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.691939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.692556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.693161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.721505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:36:46.809404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10e77d9d-f71e-4df0-87bd-03c18f53b96a tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 204 len: 0 microversion: 2.1 time: 0.129365 Aug 29 10:36:46.810114 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 304/648] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:36:46 2022] DELETE /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:46.816884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:46.817931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:46.824006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.824602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.824910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:46.825834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:46.826603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:46.827464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.212254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:47.221207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5de82013-551e-4a64-8757-ba60a16f475f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1318 microversion: 2.1 time: 0.409461 Aug 29 10:36:47.221717 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 305/649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:46 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:47.226117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb7e03aa-88cc-4837-8153-aaa1b80b02a0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '.version_select at 0x7f66c74fe1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.229552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb7e03aa-88cc-4837-8153-aaa1b80b02a0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.230130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb7e03aa-88cc-4837-8153-aaa1b80b02a0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.230576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb7e03aa-88cc-4837-8153-aaa1b80b02a0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.239589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb7e03aa-88cc-4837-8153-aaa1b80b02a0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1778 microversion: 2.25 time: 0.016865 Aug 29 10:36:47.240173 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 306/650] 10.222.0.47 () {60 vars in 1184 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/os-migrations => generated 1778 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:47.244635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04c361b-6a45-4aa2-8151-d50603f0f59c", "name": "network-vif-unplugged", "status": "completed", "tag": "faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:47.265101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.265566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.266024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.277450 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] Creating event network-vif-unplugged:faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074 for instance c04c361b-6a45-4aa2-8151-d50603f0f59c on n-h1-854121-10 Aug 29 10:36:47.283049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f40a98eb-9366-40e4-a5a3-7172a10b0eda req-8a63260d-7151-48c1-bfb4-e24920353285 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041636 Aug 29 10:36:47.283731 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 307/651] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:47.288717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.289408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:47.295783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.296378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.296784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.297485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.297971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.298414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.391070 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a00f0564-7068-4b23-adb9-0ed59b895514 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17926 microversion: 2.1 time: 1.255039 Aug 29 10:36:47.391917 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 345/652] 10.222.0.47 () {58 vars in 1171 bytes} [Mon Aug 29 10:36:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17926 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:36:47.396812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c9c02f6-d38b-41c1-b89b-7dd76d02f1a7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c72b8700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.441775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c9c02f6-d38b-41c1-b89b-7dd76d02f1a7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4" status: 200 len: 637 microversion: 2.1 time: 0.048727 Aug 29 10:36:47.442339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 346/653] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4 => generated 637 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:47.446944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.447839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:47.454873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.455355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.455788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.456481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.456928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.457348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.668011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:47.678432 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95ec1706-c232-4c11-9ad4-d7c495e272f9 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1468 microversion: 2.1 time: 0.393456 Aug 29 10:36:47.685806 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 308/654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1468 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:47.692785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.693435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:47.701169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.702834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.703453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.704244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.704709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.705282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.727398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:47.737012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-231be200-4de3-4d9a-bb2b-9fc658acd981 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.293607 Aug 29 10:36:47.737891 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 347/655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:47.742460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:47.748114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'deleted': False, 'project_id': 'ab2998f4d6d84aa8bc78039aa624a885'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:47.754102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.754883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.755537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.756596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:47.757234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:47.757875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:47.936903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:47.956069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1d545b2-5c2c-44c1-890e-0153fb026b44 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 2036 microversion: 2.25 time: 0.268931 Aug 29 10:36:47.956996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 309/656] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 2036 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:47.968747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02e9700b-52e1-4506-abe3-e3c042cf6b29 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?tenant_id=49a739367574418c86f7414199fd9729" status: 200 len: 15 microversion: 2.1 time: 0.229598 Aug 29 10:36:47.970475 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 348/657] 10.222.0.47 () {58 vars in 1231 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/servers/detail?tenant_id=49a739367574418c86f7414199fd9729 => generated 15 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:47.972858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7de39546-c809-4465-b2fa-ff0cbe0ba6f1 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c7508280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:48.008499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.021163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'tenant_id': '49a739367574418c86f7414199fd9729', 'deleted': False} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:48.027664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.029571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.047360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.048436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.049094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.049724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.063541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7de39546-c809-4465-b2fa-ff0cbe0ba6f1 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:48.071626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7de39546-c809-4465-b2fa-ff0cbe0ba6f1 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:48.083291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:36:48.188018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.188622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.189233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.400046 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f90c652-d354-43f9-b887-db2a021e73a0 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=49a739367574418c86f7414199fd9729" status: 200 len: 4832 microversion: 2.1 time: 0.412797 Aug 29 10:36:48.401304 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 349/658] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 10:36:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=49a739367574418c86f7414199fd9729 => generated 4832 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:48.406912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-62fb0254-be92-492a-8bf5-c0bcb07d2e49 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: .version_select at 0x7f66c7166790>, body: {"keypair": {"name": "tempest-keypair-1418215228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvCqqqBTSQ6CwYcBWAInZQNqTDe7mQvRh8GzhW/L9406hqAha0Mn3WrbvabmkQuzESro6Mcxa/q0FD9u4SWmg2zA5VLw8ZYS5XnYFIegAwWoVT1/1HglXjsyryOIrPehQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:48.425069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-62fb0254-be92-492a-8bf5-c0bcb07d2e49 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:48.446122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-62fb0254-be92-492a-8bf5-c0bcb07d2e49 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for user ad7622f1f2834d1e9171f6525f0e6481 and project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:48.458873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7de39546-c809-4465-b2fa-ff0cbe0ba6f1 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.500465 Aug 29 10:36:48.460163 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 310/659] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:47 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:48.465718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.466585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:48.475586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.476426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.476932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.477719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.478277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.478875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.483803 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-62fb0254-be92-492a-8bf5-c0bcb07d2e49 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.081242 Aug 29 10:36:48.485775 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 350/660] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:36:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:36:48.501068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.510765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'tenant_id': 'ab2998f4d6d84aa8bc78039aa624a885', 'deleted': False} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:48.520612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.522556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.523147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.523928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.524525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.524962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.555069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72200cf2-1e66-4237-b16a-7cf5ecaac6f6 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ab2998f4d6d84aa8bc78039aa624a885" status: 200 len: 15 microversion: 2.1 time: 0.069398 Aug 29 10:36:48.555558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 351/661] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 10:36:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ab2998f4d6d84aa8bc78039aa624a885 => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:48.575530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b77afda-1ff7-42cb-bb84-cf3564f931bc tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c7266f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.955720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b77afda-1ff7-42cb-bb84-cf3564f931bc tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "DELETE /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.384536 Aug 29 10:36:48.957132 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 352/662] 10.222.0.47 () {58 vars in 1296 bytes} [Mon Aug 29 10:36:48 2022] DELETE /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_version => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:48.964124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90a1e7cd-012d-4cfb-8e8c-3e01e9ee71dd tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.971777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90a1e7cd-012d-4cfb-8e8c-3e01e9ee71dd tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.013309 Aug 29 10:36:48.981737 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 353/663] 10.222.0.47 () {58 vars in 1189 bytes} [Mon Aug 29 10:36:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:48.981737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:48.981737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:48.986162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.987418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.988135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:48.989674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:48.990664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:48.991351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.133833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:49.182303 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-529cfca9-f60b-4cfa-8e8b-e5c646becb5b tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1468 microversion: 2.1 time: 0.720157 Aug 29 10:36:49.198033 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 311/664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:48 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1468 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:49.204769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:49.205769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:49.212830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.213421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.214098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.215016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.215681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.216317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.364156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:49.372212 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30c545f2-0b37-46a6-b4d8-84e1b259586e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1468 microversion: 2.1 time: 0.398309 Aug 29 10:36:49.386063 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 354/665] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:48 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1468 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:49.392271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-18739b28-feae-452d-b112-85c88b1f4d2f tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c71f5670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:49.434491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-18739b28-feae-452d-b112-85c88b1f4d2f tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 37 microversion: 2.1 time: 0.047040 Aug 29 10:36:49.437080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 355/666] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:49 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 37 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:49.448966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:49.451602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:49.475515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.476247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.476694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.477420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.477961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.478587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.493892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:49.573682 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-761bdc06-6e12-46ed-9d3e-a74994a9f024 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.134344 Aug 29 10:36:49.574429 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 356/667] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:49 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:49.579561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:49.580342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:49.587030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.587867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.588481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.589378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.590034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.590630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.619035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lazy-loading 'flavor' on Instance uuid be587bae-68da-41b6-93de-5d4246dcae45 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:49.707027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12414b7f-917b-4062-a6ee-759c469ad772 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45/action" status: 202 len: 0 microversion: 2.1 time: 0.131073 Aug 29 10:36:49.708690 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 357/668] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:49 2022] POST /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:49.715160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04c361b-6a45-4aa2-8151-d50603f0f59c", "tag": "faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:49.725635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:49.726557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:49.727061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:49.740186 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] Creating event network-changed:faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074 for instance c04c361b-6a45-4aa2-8151-d50603f0f59c on n-h1-854121-10 Aug 29 10:36:49.745184 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-76105b61-506b-4896-b273-a46ba9e4d013 req-6de553af-d32c-456d-8623-1b5704a85209 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034826 Aug 29 10:36:49.746138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 358/669] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:49.752225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d692ba8f-0852-4386-b53b-67039f0576c7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c71f5280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:49.813042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d692ba8f-0852-4386-b53b-67039f0576c7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:49.820313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d692ba8f-0852-4386-b53b-67039f0576c7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:49.974380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:49.985937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77399c9a-e9b4-43d8-8fbc-7807a83bf583 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.786398 Aug 29 10:36:49.987362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 312/670] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:49 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:50.013045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:50.028487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:50.029312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '49a739367574418c86f7414199fd9729'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:50.036820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.037417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.038211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.039672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.040329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.040979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.152077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:36:50.420468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5224d46c-a547-433a-8e2d-42e6daa086c3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.414863 Aug 29 10:36:50.423856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d692ba8f-0852-4386-b53b-67039f0576c7 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.676116 Aug 29 10:36:50.431650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 359/671] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:49 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:50.433671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 313/672] 10.222.0.47 () {58 vars in 1150 bytes} [Mon Aug 29 10:36:50 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:50.437764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:50.438522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:50.442258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:50.443142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:50.452463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.453215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.453910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.454810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.455727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.470638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.470928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.471156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.471792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.472546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.473011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.473446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.699010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:50.701916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:50.715331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b5ab08dd-69da-46b0-b0cb-45ad4b5d4a9e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 200 len: 1298 microversion: 2.1 time: 0.280106 Aug 29 10:36:50.715924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 314/673] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:50 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:50.733244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:50.743514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:50.750871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.751742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.752775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.754349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.755271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.756049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.855901 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-25860241-5a13-48b6-8192-8310ceb4b7d2 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.136082 Aug 29 10:36:50.860197 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 315/674] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:50 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:50.863037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-190a4c7a-12bf-48d6-b414-b230b61ee733 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c74feee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:50.906558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:50.909172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-190a4c7a-12bf-48d6-b414-b230b61ee733 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.050745 Aug 29 10:36:50.909797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 316/675] 10.222.0.47 () {58 vars in 1290 bytes} [Mon Aug 29 10:36:50 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_distro => generated 33 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:50.915409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-286712940", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "216ce7f7-153f-4fc4-88fa-0b56f8f31bc3"}], "security_groups": [{"name": "tempest-securitygroup--193942517"}], "key_name": "tempest-keypair-1418215228", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:50.917364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd3322cd-359c-4224-b20c-1ad53b9790b7 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1459 microversion: 2.1 time: 0.484408 Aug 29 10:36:50.917967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 360/676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:50 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1459 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:50.928953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:50.929864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:50.942152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.942944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.943510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:50.944318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:50.944994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:50.945508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.092925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] validate_networks() for [('216ce7f7-153f-4fc4-88fa-0b56f8f31bc3', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:36:51.198605 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83785f08-8a87-4b53-843e-b073b5eaa99f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1617 microversion: 2.1 time: 0.279442 Aug 29 10:36:51.202855 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 361/677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:50 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1617 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:51.210886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-201ed5fc-f446-4236-8579-d3f7b39bbbb9 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c7385310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:51.327849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-201ed5fc-f446-4236-8579-d3f7b39bbbb9 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:51.335041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-201ed5fc-f446-4236-8579-d3f7b39bbbb9 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:51.579439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-201ed5fc-f446-4236-8579-d3f7b39bbbb9 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.374580 Aug 29 10:36:51.580740 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 362/678] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:51 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:51.586177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:51.587213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:51.598657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.599437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.600301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.601468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.602148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.602728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.650181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:51.650764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:51.651231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:51.651790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:51.652224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:51.664971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.665753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.666488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.667404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.668081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.668510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.690339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:51.696901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for user ad7622f1f2834d1e9171f6525f0e6481 and project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:51.712399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:36:51.715432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:36:51.776746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f924544b-a83b-47de-a6a2-ca04cd4c1b14 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.864996 Aug 29 10:36:51.778391 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 317/679] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:36:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:36:51.783728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:51.784984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:51.791889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.792638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.793288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.794333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:51.795871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:51.796463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:51.996580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6cd59ebe-67fa-4aef-b0a3-b67b11834a0f tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1612 microversion: 2.1 time: 0.414187 Aug 29 10:36:52.010528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 363/680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:51 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1612 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:52.018706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.019959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.028538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.029152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.029728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.031516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.032212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.033384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.048815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:52.058186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d19dc4b-90c8-43d6-bdc7-6b814a1ba54a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.278255 Aug 29 10:36:52.058973 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 318/681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:51 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:52.064814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb38489d-71c7-4907-b2e7-09be821dad25 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c74fe700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.124294 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb38489d-71c7-4907-b2e7-09be821dad25 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.063953 Aug 29 10:36:52.130149 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 319/682] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:52.136230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.136846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 6b751e2f-2712-42e5-ad5f-10addabcbc7b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.144413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.144904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.145902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.146610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.147067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.147488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.171842 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] HTTP exception thrown: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Request method failure captured: Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b HTTP/1.1 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaEZjuWbtNuAOKuQ3nA088y4kT0P-9dpe_hZFt-HGy6Eh2Yw_FhPWB79cXlAk_m5XeI_20AkANMpoiEJw_75aQkonOD48lgxSpvOBNkhWn2lzA3rAcqjwrYQgkv9NpqQf0BX4EF5BKT9lPZRMb6lyEKT7GBBlpqOHDVWabWscHPwXs Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2624c2acf74e44be8efb3a1a6e0f149b Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2624c2acf74e44be8efb3a1a6e0f149b Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-900557272-project Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 64f3d2458a8a410497a293dca10e88d3 Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-900557272-project Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6b751e2f-2712-42e5-ad5f-10addabcbc7b'} Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.173932 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Returning 404 to user: Instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:52.177639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d02dc79-a866-467c-8d36-d1b13d85d55d tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b" status: 404 len: 111 microversion: 2.1 time: 0.044184 Aug 29 10:36:52.179199 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 320/683] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/servers/6b751e2f-2712-42e5-ad5f-10addabcbc7b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:36:52.184170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.184783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.288070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:52.299882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3896e4a7-ccc6-44bd-9e40-89e371b1da2f tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1617 microversion: 2.1 time: 0.287634 Aug 29 10:36:52.301106 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 364/684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1617 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:52.302907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:52.304530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:52.305685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b751e2f-2712-42e5-ad5f-10addabcbc7b", "name": "network-vif-deleted", "tag": "16a48b1e-6410-4b24-856f-ac0dce3ebfd1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:52.307374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7816ae06-c325-462c-bb4f-4b7dc91cd7b8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1285 microversion: 2.25 time: 0.127133 Aug 29 10:36:52.309187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 321/685] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:52.320641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.329954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.331108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.333284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.336336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.336786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.337024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.337565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.340045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.340498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.370840 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] Creating event network-vif-deleted:16a48b1e-6410-4b24-856f-ac0dce3ebfd1 for instance 6b751e2f-2712-42e5-ad5f-10addabcbc7b on n-h2-854121-10 Aug 29 10:36:52.382785 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6c683ba1-f078-4f2c-aee7-f2f4bd8d5d9e req-a0c01677-517a-450d-a86e-1453c6b07ca6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078301 Aug 29 10:36:52.385757 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 365/686] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:52.396652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bd21f83-be2c-4025-8d76-3076d9387477 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c7195c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:52.407116 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5cf8b335-5d29-44c8-a987-cd97938182a0 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.093419 Aug 29 10:36:52.408496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 322/687] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:52.414261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.415186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.424017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.424658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.425460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.426821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.427902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.428686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.487056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-4bd21f83-be2c-4025-8d76-3076d9387477 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:52.488721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:36:52.493647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-4bd21f83-be2c-4025-8d76-3076d9387477 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:52.621332 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5c5a38e-59e4-415e-bbdc-2a61e620bf83 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 204 len: 0 microversion: 2.1 time: 0.211283 Aug 29 10:36:52.622125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 323/688] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:36:52 2022] DELETE /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:52.640710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.658016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'host': 'n-h1-854121-10', 'deleted': False} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:52.664230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.665074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.665896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.667712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.668178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.668639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.711831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bd21f83-be2c-4025-8d76-3076d9387477 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.324230 Aug 29 10:36:52.712892 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 366/689] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:52 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:52.722522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:52.725307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.731909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.733432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.734098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.735144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.735779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.736395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.769825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Lazy-loading 'flavor' on Instance uuid be587bae-68da-41b6-93de-5d4246dcae45 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:52.786571 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance be587bae-68da-41b6-93de-5d4246dcae45 while it is in vm_state suspended Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Request method failure captured: Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45/action HTTP/1.1 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 98 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaRolJNV4UVJoyojSeU3VyXw9SvAyHmLkGXDxvX-rVcNrxtyD393z4jP8LHikkEpf4nsp8Tm-lvyTi-Kg8WCNQpKO8aS_7Mp8Vmgyf4H9DJlXuxNscdFY62UhbP2pJFdSl89ZLS2ruVcu2jgafmqYcCm4lTI22AbEeEEnWeLUUstZw Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 56f67d28f8004e02904b836973975a68 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/56f67d28f8004e02904b836973975a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_56f67d28f8004e02904b836973975a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/56f67d28f8004e02904b836973975a68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/56f67d28f8004e02904b836973975a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 56f67d28f8004e02904b836973975a68 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1335695693 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-LiveMigrationNegativeTest-1335695693-project-admin Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 83bc11a69bfe4d76b1c5bc5d84cccd00 Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-LiveMigrationNegativeTest-1335695693-project-admin Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": true, "disk_over_commit": false}} Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot 'os-migrateLive' instance be587bae-68da-41b6-93de-5d4246dcae45 while it is in vm_state suspended Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'be587bae-68da-41b6-93de-5d4246dcae45', 'body': {'os-migrateLive': {'host': 'n-h1-854121-10', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be587bae-68da-41b6-93de-5d4246dcae45 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.788656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance be587bae-68da-41b6-93de-5d4246dcae45 while it is in vm_state suspended Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance be587bae-68da-41b6-93de-5d4246dcae45 while it is in vm_state suspended Aug 29 10:36:52.797368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:52.799434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:36:52.799539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance be587bae-68da-41b6-93de-5d4246dcae45 while it is in vm_state suspended {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:52.799539 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e03c3253-2b19-4627-9426-9051f5dfe771 tempest-LiveMigrationNegativeTest-1335695693 tempest-LiveMigrationNegativeTest-1335695693-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45/action" status: 409 len: 155 microversion: 2.1 time: 0.075805 Aug 29 10:36:52.799539 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 367/690] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:52 2022] POST /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45/action => generated 155 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:36:52.799539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.799539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.805386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.805919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.806364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.807075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.807531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.808142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.852334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46da4d99-13dd-45ce-ade6-5f297a8ee2dc tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers?host=n-h1-854121-10&all_tenants=1" status: 200 len: 1989 microversion: 2.1 time: 0.228350 Aug 29 10:36:52.853035 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 324/691] 10.222.0.47 () {58 vars in 1192 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/servers?host=n-h1-854121-10&all_tenants=1 => generated 1989 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:52.864982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5818016b-9376-484d-8dc0-7319b2b2acb3 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c75083a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:52.926193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5818016b-9376-484d-8dc0-7319b2b2acb3 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:52.932821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5818016b-9376-484d-8dc0-7319b2b2acb3 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:52.963766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:52.973203 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5aeca522-6c86-4c80-83be-449b385b4259 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1477 microversion: 2.1 time: 0.181332 Aug 29 10:36:52.973832 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 368/692] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:52 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:52.978803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:52.980352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:52.987863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.988819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.988819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:52.989603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:52.989998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:52.990430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.032005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:36:53.131483 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a6a2498-18d9-407d-ad4b-976608a956d9 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 204 len: 0 microversion: 2.1 time: 0.156335 Aug 29 10:36:53.132283 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 369/693] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:36:52 2022] DELETE /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:53.138907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.147938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:36:53.154668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.155181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.157000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.158594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.159487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.160131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.251866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fe121f4-e30f-47f3-a7de-bb52372c67f8 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.118132 Aug 29 10:36:53.252631 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 370/694] 10.222.0.47 () {58 vars in 1196 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:53.257690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.259539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.268638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.269387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.269911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.273395 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5818016b-9376-484d-8dc0-7319b2b2acb3 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.419005 Aug 29 10:36:53.278639 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 325/695] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:52 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 64 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:53.278777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.278777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.278777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.279016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.279898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.285924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.286415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.286853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.287556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.288011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.289749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.487213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:53.494342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:53.503224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-864eb341-c54a-433b-890c-6497ac5089e0 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1465 microversion: 2.1 time: 0.228127 Aug 29 10:36:53.503429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2003f019-b56a-4399-b0ec-3cabd135aa93 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.249257 Aug 29 10:36:53.504331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 371/696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:53.505119 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 326/697] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1465 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:53.509965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:53.510117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-741d7e66-a4bb-4f3f-9976-6e60f704126a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c71d5310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.512172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.520434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.520929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.521530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.522530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.523175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.523581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.556337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-741d7e66-a4bb-4f3f-9976-6e60f704126a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.049839 Aug 29 10:36:53.557198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 327/698] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 64 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:53.562255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.562867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.566228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:53.570070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.570626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.571306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.572185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.572795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.573379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.614469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0356ec19-1c86-40a9-9900-6621efcb0bf3 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.108409 Aug 29 10:36:53.615096 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 372/699] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:53 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:36:53.626159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa1189ff-ac3a-4422-8a8b-f0a3b15bf0a8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c71954c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:53.646268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:53.655656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:53.656825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:53.657984 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56a404b2-a0b7-4c20-bcc4-ea45630586c8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1281 microversion: 2.25 time: 0.099301 Aug 29 10:36:53.658528 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 328/700] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:53.674700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:53.677485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.683717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.684385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.684986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.686402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.686620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-aa1189ff-ac3a-4422-8a8b-f0a3b15bf0a8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:53.687051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.687481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.692874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-aa1189ff-ac3a-4422-8a8b-f0a3b15bf0a8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:53.780850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:36:53.781468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:36:53.782137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:36:53.782726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:36:53.783312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:36:53.888463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.895608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.896109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.896787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.897642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.898149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.898579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.928759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9664983e-b461-4c71-a08b-fca4d05d33a7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 1068 microversion: 2.1 time: 0.267961 Aug 29 10:36:53.929729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 329/701] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:36:53 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 1068 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 10:36:53.949773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:53.950390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:53.957151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.957944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.958255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:53.958959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:53.959410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:53.959833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.042225 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa1189ff-ac3a-4422-8a8b-f0a3b15bf0a8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.425727 Aug 29 10:36:54.043023 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 373/702] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:53 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:54.111712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:54.120912 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd66aea9-fc2f-46fa-811d-28e519f2abe6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.175066 Aug 29 10:36:54.121474 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 330/703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:53 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:54.126240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:54.126838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:54.132516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:54.136535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.136811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.137240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.137976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.138438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.138873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.168797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dea7afb5-3e68-4169-9004-199eaddf770b tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1307789756", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.173014 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-dea7afb5-3e68-4169-9004-199eaddf770b tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] HTTP exception thrown: min_count must be <= max_count Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dea7afb5-3e68-4169-9004-199eaddf770b tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Request method failure captured: Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 184 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbF9Tc12r49Ye4ReA62fARotU3OF4HHbun1r8pmJZhUQWOLRmjCFaYMOENx47JaODt-E6FJ00_hyNsrULe0GwPeaq4XGegl8HF9WSBm9XXzJV0X1Jh8hONezTMqTnBoLqomamxi2_tcXmn4IvkV-YIDFVRq45eoHDCH6TCHhl00PFw Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 0020a29d4b6246e5874d914de3a2c469 Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1307789756", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: exception: min_count must be <= max_count Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1307789756', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 29 10:36:54.174641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.186065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dea7afb5-3e68-4169-9004-199eaddf770b tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Returning 400 to user: min_count must be <= max_count {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:54.186065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dea7afb5-3e68-4169-9004-199eaddf770b tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.133185 Aug 29 10:36:54.186065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 374/704] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:54 2022] POST /compute/v2.1/servers => generated 74 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:36:54.186065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a356f04a-9617-4caa-8c75-a01229c747b8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update', calling method: .version_select at 0x7f66c75cce50>, body: {"meta": {"os_version": "alt"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.240114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:54.248977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a356f04a-9617-4caa-8c75-a01229c747b8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:54.256242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a356f04a-9617-4caa-8c75-a01229c747b8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:54.285593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:54.293915 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e94108a9-3ccc-46f1-b5ca-3be6a48daadd tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1477 microversion: 2.1 time: 0.171388 Aug 29 10:36:54.294489 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 331/705] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:54 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:54.299928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee16c745-94bf-4423-bff7-6abf5fb58d65 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-448204578", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "max_count": 0}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee16c745-94bf-4423-bff7-6abf5fb58d65 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Request method failure captured: Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 167 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbF9Tc12r49Ye4ReA62fARotU3OF4HHbun1r8pmJZhUQWOLRmjCFaYMOENx47JaODt-E6FJ00_hyNsrULe0GwPeaq4XGegl8HF9WSBm9XXzJV0X1Jh8hONezTMqTnBoLqomamxi2_tcXmn4IvkV-YIDFVRq45eoHDCH6TCHhl00PFw Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 0020a29d4b6246e5874d914de3a2c469 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-448204578", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "max_count": 0}} Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-448204578', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'max_count': 0}}} Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 0 Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:54.304808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.308949 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.311568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee16c745-94bf-4423-bff7-6abf5fb58d65 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:54.312592 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee16c745-94bf-4423-bff7-6abf5fb58d65 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016415 Aug 29 10:36:54.313336 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 332/706] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:36:54.368070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88ee5f7f-fe70-4ac2-9d33-b6fae22d9a51 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1263444527", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "max_count": 2.5}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88ee5f7f-fe70-4ac2-9d33-b6fae22d9a51 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Request method failure captured: Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 170 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbF9Tc12r49Ye4ReA62fARotU3OF4HHbun1r8pmJZhUQWOLRmjCFaYMOENx47JaODt-E6FJ00_hyNsrULe0GwPeaq4XGegl8HF9WSBm9XXzJV0X1Jh8hONezTMqTnBoLqomamxi2_tcXmn4IvkV-YIDFVRq45eoHDCH6TCHhl00PFw Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 0020a29d4b6246e5874d914de3a2c469 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1263444527", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "max_count": 2.5}} Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1263444527', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'max_count': 2.5}}} Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:54.371908 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88ee5f7f-fe70-4ac2-9d33-b6fae22d9a51 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88ee5f7f-fe70-4ac2-9d33-b6fae22d9a51 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009126 Aug 29 10:36:54.376676 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 333/707] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:36:54.423517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7cd5d313-5dce-4ce2-9d14-056c489e8541 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-200718114", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 0}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7cd5d313-5dce-4ce2-9d14-056c489e8541 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Request method failure captured: Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 167 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbF9Tc12r49Ye4ReA62fARotU3OF4HHbun1r8pmJZhUQWOLRmjCFaYMOENx47JaODt-E6FJ00_hyNsrULe0GwPeaq4XGegl8HF9WSBm9XXzJV0X1Jh8hONezTMqTnBoLqomamxi2_tcXmn4IvkV-YIDFVRq45eoHDCH6TCHhl00PFw Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 0020a29d4b6246e5874d914de3a2c469 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-200718114", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 0}} Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-200718114', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'min_count': 0}}} Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 0 Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:54.427367 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7cd5d313-5dce-4ce2-9d14-056c489e8541 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7cd5d313-5dce-4ce2-9d14-056c489e8541 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009381 Aug 29 10:36:54.437128 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 334/708] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:36:54.483297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d75aa0da-a33e-4a6e-a9fc-ca23803705d7 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-946487106", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 2.5}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d75aa0da-a33e-4a6e-a9fc-ca23803705d7 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Request method failure captured: Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 169 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbF9Tc12r49Ye4ReA62fARotU3OF4HHbun1r8pmJZhUQWOLRmjCFaYMOENx47JaODt-E6FJ00_hyNsrULe0GwPeaq4XGegl8HF9WSBm9XXzJV0X1Jh8hONezTMqTnBoLqomamxi2_tcXmn4IvkV-YIDFVRq45eoHDCH6TCHhl00PFw Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b3e36d3350f48748cd1e3b030144bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2b3e36d3350f48748cd1e3b030144bd1 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1520001418 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 0020a29d4b6246e5874d914de3a2c469 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1520001418-project Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-946487106", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 2.5}} Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-946487106', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'min_count': 2.5}}} Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:36:54.486976 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d75aa0da-a33e-4a6e-a9fc-ca23803705d7 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d75aa0da-a33e-4a6e-a9fc-ca23803705d7 tempest-MultipleCreateNegativeTestJSON-1520001418 tempest-MultipleCreateNegativeTestJSON-1520001418-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009757 Aug 29 10:36:54.491844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 335/709] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:36:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:36:54.522591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a356f04a-9617-4caa-8c75-a01229c747b8 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.342300 Aug 29 10:36:54.523201 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 375/710] 10.222.0.47 () {60 vars in 1313 bytes} [Mon Aug 29 10:36:54 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata/os_version => generated 31 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:54.533326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7bc49127-cf13-47d0-af16-6c9145e9ab33 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c72d9790>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:54.538838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:54.539455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:54.547069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.547747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.548252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.549784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.550257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.550694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.575318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7bc49127-cf13-47d0-af16-6c9145e9ab33 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046570 Aug 29 10:36:54.576008 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 336/711] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:54 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 58 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:54.581330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:54.582472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:54.589139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.589732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.590098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.590800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.591259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.591723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.756647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:54.767924 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24240187-f34f-4ee4-8015-9fab0ae15654 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1465 microversion: 2.1 time: 0.232878 Aug 29 10:36:54.769018 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 376/712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:54 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1465 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:54.787167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-281f1985-605b-4e58-839f-8df84d9bd22a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'update_all', calling method: .version_select at 0x7f66c74a60d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:54.802176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:54.806200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:36:54.811368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-216c01f5-67a5-45c6-bee0-01d12524a4a3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.233632 Aug 29 10:36:54.812288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 337/713] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:54 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:54.817046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:54.817944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:54.837027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.837658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.838144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.839482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:54.839949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:54.840380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:54.850649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-281f1985-605b-4e58-839f-8df84d9bd22a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:54.856463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-281f1985-605b-4e58-839f-8df84d9bd22a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:55.115836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:55.134419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:55.139649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:55.143521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2472d2ff-2a49-4773-abc5-f4bab369229e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1281 microversion: 2.25 time: 0.328839 Aug 29 10:36:55.144296 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 338/714] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:54 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:55.164598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:55.165637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:55.172354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.172742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.173178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.174464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.174962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.175389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.261846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-281f1985-605b-4e58-839f-8df84d9bd22a tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.491212 Aug 29 10:36:55.263264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 377/715] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:36:54 2022] PUT /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 61 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:55.272881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf658a2e-e453-4c1b-87cb-196e2bebab28 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Action: 'create', calling method: .version_select at 0x7f66c750a820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:55.343231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-bf658a2e-e453-4c1b-87cb-196e2bebab28 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:36:55.351723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-bf658a2e-e453-4c1b-87cb-196e2bebab28 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Getting quotas for user 98068a1e5d6d471797daeabe3e6047aa and project 71441ffa4a26466b90c15d0664d47dc5. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:36:55.386815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:55.396482 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2296f33c-0cf5-4671-8ddf-46f3f8da0967 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.235897 Aug 29 10:36:55.397834 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 339/716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:55 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:55.402739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:55.403542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:55.411353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.412111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.412766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.413742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.414519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.415006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.801620 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf658a2e-e453-4c1b-87cb-196e2bebab28 tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "POST /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.532618 Aug 29 10:36:55.807496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 378/717] 10.222.0.47 () {60 vars in 1281 bytes} [Mon Aug 29 10:36:55 2022] POST /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 85 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:55.814260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:55.816452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:55.828826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.829621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.830433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.831373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.832073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.833323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.850981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:55.867575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5b374d7-d180-4cbd-82d8-556aeb81dac1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1477 microversion: 2.1 time: 0.468480 Aug 29 10:36:55.868208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 340/718] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:55 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:55.887256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d1ec34b-37bc-4516-8584-4ba408b6ad9b tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] Calling method '.version_select at 0x7f66c70d7e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:55.945975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d1ec34b-37bc-4516-8584-4ba408b6ad9b tempest-ImagesMetadataTestJSON-1137623263 tempest-ImagesMetadataTestJSON-1137623263-project] 10.222.0.47 "GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.076072 Aug 29 10:36:55.946775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 341/719] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:36:55 2022] GET /compute/v2.1/images/c957b5f9-1248-4a0f-bcce-c1e1cef960c4/metadata => generated 85 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:36:55.961602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:55.963623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:55.982022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.983229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.983860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:55.984587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:55.994287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:55.995491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.257851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:56.275058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8204f508-8b26-4e97-89e8-a2e4ac6fda0c tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1465 microversion: 2.1 time: 0.464633 Aug 29 10:36:56.276868 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 379/720] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:55 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1465 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:56.284682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:56.285754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:56.312147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.316229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.318038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.320036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.324443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.325079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.574775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:56.592232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:56.596893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:56.607502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48e77803-5665-4974-be46-4ec7cb4249cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1355 microversion: 2.25 time: 0.329173 Aug 29 10:36:56.608144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 380/721] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:56 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1355 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:56.621974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be587bae-68da-41b6-93de-5d4246dcae45", "name": "network-vif-deleted", "tag": "3e373a57-856c-4205-8064-914407ac10c2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:56.654426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.657321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.659889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.682542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:56.688412 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] Creating event network-vif-deleted:3e373a57-856c-4205-8064-914407ac10c2 for instance be587bae-68da-41b6-93de-5d4246dcae45 on n-h2-854121-10 Aug 29 10:36:56.693436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-532dae39-0ec9-4861-854d-473b1cd20f52 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.745332 Aug 29 10:36:56.694243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 342/722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:55 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:56.713349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-bc3ef5cf-c339-46ca-aa1b-33bc430ffcbe req-8460b334-4a27-4ea5-8b74-55f0f36d36fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101919 Aug 29 10:36:56.715769 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 381/723] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:56.735503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:56.736394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:56.774402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.775548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.777581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.780772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.781690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.782276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.892340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:56.893986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:56.903310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.904359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.905523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:56.907559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:56.909578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:56.910883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.569009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.583741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cacb4632-d909-4102-b520-08e33c93bce6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.887600 Aug 29 10:36:57.585260 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 343/724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:56 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:57.601307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:57.604552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:57.614681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.615381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.615913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.617034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.617790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.618487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.642855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f3d2458a8a410497a293dca10e88d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2624c2acf74e44be8efb3a1a6e0f149b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.651863 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ebfb9cb5-8f89-4e9f-8513-c3fc2e0ef7d1 tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 200 len: 1477 microversion: 2.1 time: 0.765444 Aug 29 10:36:57.653121 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 382/725] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:56 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 1477 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:57.658176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:57.659919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:57.664279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.664963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.665654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.666294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lazy-loading 'fault' on Instance uuid be587bae-68da-41b6-93de-5d4246dcae45 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:36:57.677114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.677877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.678441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.679250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.679950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.680598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.899857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.907671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.913222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.915383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:57.918530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58d850ee-9c08-4d3c-bec1-e05838e0379e tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 200 len: 1308 microversion: 2.1 time: 0.330921 Aug 29 10:36:57.920903 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 344/726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:57 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:57.921889 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7737a96b-174e-4794-adac-8aebda1636f5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1343 microversion: 2.25 time: 0.265131 Aug 29 10:36:57.922875 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 383/727] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:57 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1343 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:57.940768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e6bb99-33e7-4392-b960-91061f49793a", "name": "network-vif-deleted", "tag": "7d96b4b2-d7e6-4d95-a631-05c3b1cb463f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:36:57.954366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:57.955246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:57.971833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.972515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.973263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.974233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.975559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.978659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:57.979554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:57.980402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:57.987034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.028084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] Creating event network-vif-deleted:7d96b4b2-d7e6-4d95-a631-05c3b1cb463f for instance 76e6bb99-33e7-4392-b960-91061f49793a on n-h2-854121-10 Aug 29 10:36:58.038262 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-55201755-2280-4869-a101-0c8970ef05a6 req-0740602b-1632-4bf1-91a1-3b6d89843d4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114014 Aug 29 10:36:58.039338 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 384/728] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:36:58.301030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:58.311741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32d0a9c5-7807-4e81-802d-f3101917c590 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1504 microversion: 2.1 time: 0.388806 Aug 29 10:36:58.312341 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 345/729] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:57 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:36:58.611428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:58.612615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:58.623039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:58.627400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:58.629231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.630356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:58.633845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:58.634522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.673618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:58.674919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] [instance: 76e6bb99-33e7-4392-b960-91061f49793a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:58.689879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:58.695816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:58.702999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.704134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:58.704795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:58.709347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.749406 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] HTTP exception thrown: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Request method failure captured: Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a HTTP/1.1 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaEZjuWbtNuAOKuQ3nA088y4kT0P-9dpe_hZFt-HGy6Eh2Yw_FhPWB79cXlAk_m5XeI_20AkANMpoiEJw_75aQkonOD48lgxSpvOBNkhWn2lzA3rAcqjwrYQgkv9NpqQf0BX4EF5BKT9lPZRMb6lyEKT7GBBlpqOHDVWabWscHPwXs Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 2624c2acf74e44be8efb3a1a6e0f149b Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2624c2acf74e44be8efb3a1a6e0f149b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 2624c2acf74e44be8efb3a1a6e0f149b Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-900557272 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-900557272-project Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 64f3d2458a8a410497a293dca10e88d3 Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-900557272-project Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '76e6bb99-33e7-4392-b960-91061f49793a'} Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:58.751041 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] Returning 404 to user: Instance 76e6bb99-33e7-4392-b960-91061f49793a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:58.755519 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86051f50-1828-42a4-8f4e-a13940f8777e tempest-ServersAdminNegativeTestJSON-900557272 tempest-ServersAdminNegativeTestJSON-900557272-project] 10.222.0.47 "GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a" status: 404 len: 111 microversion: 2.1 time: 0.083940 Aug 29 10:36:58.756135 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 346/730] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:58 2022] GET /compute/v2.1/servers/76e6bb99-33e7-4392-b960-91061f49793a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:36:58.952612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:58.953596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: be587bae-68da-41b6-93de-5d4246dcae45] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:58.964976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:58.967070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:58.981489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:58.999776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.000929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.002661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.031502 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] HTTP exception thrown: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Request method failure captured: Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 HTTP/1.1 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaPWPvaej3AjmAQVRwftp3bpEZT6Apf9prkMq8jhy7ZhYVzU8lcCRztbNUBNwGv-kVVhVHwKroxw51eyzQYBAIKT7gNuUdCYzpwutGqSV4XnCpYiyGjlEOU_3vAtBcYmRdghSHuj4yB_z7No1K67-1Tljmg6KfuxNxDOm0VtyFqG7s Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b7de8c335e9e46258711b63a44ca8ddf Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b7de8c335e9e46258711b63a44ca8ddf Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationNegativeTest-225246450-project Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51a39e43f5134b4b8424600ee2563a0f Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationNegativeTest-225246450-project Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'be587bae-68da-41b6-93de-5d4246dcae45'} Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:36:59.035010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. Aug 29 10:36:59.039202 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:36:59.043683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Returning 404 to user: Instance be587bae-68da-41b6-93de-5d4246dcae45 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:36:59.046604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deabf116-a6c0-405d-b49f-b12270dda361 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45" status: 404 len: 111 microversion: 2.1 time: 0.101399 Aug 29 10:36:59.048840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 347/731] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:58 2022] GET /compute/v2.1/servers/be587bae-68da-41b6-93de-5d4246dcae45 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:36:59.063651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:59.064926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:59.077670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.078860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.079884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.081508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.082746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.085107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.219464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:59.234499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b6400562-2203-43b0-988b-c5e5317b4658 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.629617 Aug 29 10:36:59.238681 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 385/732] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:58 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:36:59.254148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:59.255075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:59.278045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.282660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.283566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.284485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.285167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.285828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.319436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:36:59.466531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:59.523719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:59.529480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:36:59.537939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9659aa1d-e349-4d08-aaeb-1f466b887a8f tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "DELETE /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 204 len: 0 microversion: 2.1 time: 0.295041 Aug 29 10:36:59.539956 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3cd95811-b533-4189-8962-857bbf584827 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1343 microversion: 2.25 time: 0.489139 Aug 29 10:36:59.540396 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 386/733] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:36:59 2022] DELETE /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:36:59.554709 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 348/734] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:36:59 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1343 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:36:59.555468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:59.556897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:59.563013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:36:59.564953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:36:59.571716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.572458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.574197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.575122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.577153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.578231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.600707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.604175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.604911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:36:59.612568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:36:59.613779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:36:59.614665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.189307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:00.202207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-935e402f-8a32-4d14-971e-6f96d0c7f8c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1474 microversion: 2.1 time: 0.645284 Aug 29 10:37:00.205803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 349/735] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:59 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1474 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:00.265918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:00.267901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:00.297298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.297858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.298319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.299117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.299505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.299939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.379341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:00.393221 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fb79b94-ebef-4fbb-ac6a-4377c4fd3ea1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1494 microversion: 2.1 time: 0.849270 Aug 29 10:37:00.394477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 387/736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:36:59 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1494 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:00.420325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-beba627d-a082-4a7d-bd3a-d0a4786300cf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '.version_select at 0x7f66c71954c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:00.427172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-beba627d-a082-4a7d-bd3a-d0a4786300cf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.429947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-beba627d-a082-4a7d-bd3a-d0a4786300cf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.430421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-beba627d-a082-4a7d-bd3a-d0a4786300cf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.474503 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-beba627d-a082-4a7d-bd3a-d0a4786300cf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.060798 Aug 29 10:37:00.489682 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 388/737] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:37:00 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:00.495884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:00.497381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:00.506014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.507129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.508402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.510186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.510915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.511609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.850948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:00.887756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdfae395-8119-4ce6-8da8-cfeb02eb2d78 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.625692 Aug 29 10:37:00.892209 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 350/738] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:00 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:00.918586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:00.924420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:00.955449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.957281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.958389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:00.960171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:00.962321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:00.964576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:01.057376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6032991-fceb-456d-8b96-01fbff1f699c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1647 microversion: 2.1 time: 0.558794 Aug 29 10:37:01.059876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 389/739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:00 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1647 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:01.228353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:01.229099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:01.241096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:01.241360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:01.269744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:01.270665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:01.271153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:01.271588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:01.298864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:01.315855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:01.317395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:01.319740 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33e1f573-cf96-4c27-9445-0b2fd057ce2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.426212 Aug 29 10:37:01.323263 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 351/740] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:00 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:01.475522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-295773176", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a0ef28b9-57a1-4ef0-9645-ec05cf810a01"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:01.579194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] validate_networks() for [('a0ef28b9-57a1-4ef0-9645-ec05cf810a01', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:01.652182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:01.663200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c24be8c1-b0c7-4024-8149-72ac5f7b96dd tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1474 microversion: 2.1 time: 0.438571 Aug 29 10:37:01.664682 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 390/741] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:01 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1474 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:01.921000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:01.923611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:01.958819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:01.960700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:01.961205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:01.963007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:01.963531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:01.964086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:02.626247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:02.642671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4c32b17-ea4c-425e-b349-bea8d55d4d38 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.729988 Aug 29 10:37:02.643597 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 391/742] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:01 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:02.660957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:02.680180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:02.681567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:02.681567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:02.704798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:02.708312 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] Creating event network-changed:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h2-854121-10 Aug 29 10:37:02.718700 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-76a17364-04d9-40e5-9a52-5f6e7a5104f1 req-727e6a41-2efc-4642-8ad7-e7ea12c8b4bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073585 Aug 29 10:37:02.722538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 392/743] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:02.738439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:02.739059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:02.750098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:02.750595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:02.751035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:02.762636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:02.763050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:02.763570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:02.946077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:03.156277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:03.156707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:03.157178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:03.157585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:03.158023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:03.167481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.167964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.168415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.173495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.173953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.174288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.190280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:03.202683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:03.209517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for user 30e7715efc824e0d9dc68fc5eb4b398b and project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:03.226294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:03.228905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:03.302261 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7f44d31-12da-43ad-a91c-28d32dd5e73f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831875 Aug 29 10:37:03.313288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 352/744] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:37:03.318733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:03.322457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:03.347019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.351141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.352664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.353641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.355717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.357531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.362530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.376887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.385137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.389254 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-945901b6-84b3-4b96-856b-945dc954d400 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.655144 Aug 29 10:37:03.410166 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 393/745] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:02 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:03.419134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758d1aa2-5ace-4c5b-82d8-4b18216f0b80", "name": "network-vif-deleted", "tag": "7827b09f-7162-447d-ad69-20d7a65affb4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:03.459039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.461305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.472992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.505431 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] Creating event network-vif-deleted:7827b09f-7162-447d-ad69-20d7a65affb4 for instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 on n-h1-854121-10 Aug 29 10:37:03.515776 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e98b061a-1180-4174-9104-09230c582147 req-7aff3494-99a1-401f-8f9a-f2c446f04817 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107270 Aug 29 10:37:03.518870 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 394/746] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:03.524319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acf6ffdb-c460-40b7-8736-3e43ac67b95b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:03.528162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acf6ffdb-c460-40b7-8736-3e43ac67b95b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:03.613575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a39e43f5134b4b8424600ee2563a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de8c335e9e46258711b63a44ca8ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.624699 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f5c894c-df1d-40b7-bc42-61d4e805dbdc tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 200 len: 1303 microversion: 2.1 time: 0.309651 Aug 29 10:37:03.625134 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 353/747] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:03 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 1303 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:03.665381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:03.667147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:03.673802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acf6ffdb-c460-40b7-8736-3e43ac67b95b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.685392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acf6ffdb-c460-40b7-8736-3e43ac67b95b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1210 microversion: 2.1 time: 0.163319 Aug 29 10:37:03.686377 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 395/748] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:03 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:03.698179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.705987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.706616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.711618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:03.715070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:03.716008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:03.980851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:03.995625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af9d3ac1-5850-4ccc-98a9-e58bb2a19088 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.332247 Aug 29 10:37:03.996797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 354/749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:03 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:04.418052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:04.418670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:04.429533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.435599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.436631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:04.438737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.440911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.441610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:04.449592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:04.647172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:04.648074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] [instance: 758d1aa2-5ace-4c5b-82d8-4b18216f0b80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:04.656418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.661325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.662188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:04.680630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.681531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.683472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:04.741575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] HTTP exception thrown: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Request method failure captured: Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 HTTP/1.1 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaPWPvaej3AjmAQVRwftp3bpEZT6Apf9prkMq8jhy7ZhYVzU8lcCRztbNUBNwGv-kVVhVHwKroxw51eyzQYBAIKT7gNuUdCYzpwutGqSV4XnCpYiyGjlEOU_3vAtBcYmRdghSHuj4yB_z7No1K67-1Tljmg6KfuxNxDOm0VtyFqG7s Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b7de8c335e9e46258711b63a44ca8ddf Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b7de8c335e9e46258711b63a44ca8ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b7de8c335e9e46258711b63a44ca8ddf Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-225246450 Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationNegativeTest-225246450-project Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51a39e43f5134b4b8424600ee2563a0f Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationNegativeTest-225246450-project Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '758d1aa2-5ace-4c5b-82d8-4b18216f0b80'} Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:04.751931 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] Returning 404 to user: Instance 758d1aa2-5ace-4c5b-82d8-4b18216f0b80 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:04.755782 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9b4bda9-fb26-4885-8e41-1baf547773c5 tempest-LiveMigrationNegativeTest-225246450 tempest-LiveMigrationNegativeTest-225246450-project] 10.222.0.47 "GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80" status: 404 len: 111 microversion: 2.1 time: 0.113165 Aug 29 10:37:04.760846 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 355/750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:04 2022] GET /compute/v2.1/servers/758d1aa2-5ace-4c5b-82d8-4b18216f0b80 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:37:04.773028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:04.773847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:04.791796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.793592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.795374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:04.797687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:04.800222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:04.800828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:05.113941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:05.119130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:05.127160 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8be3f292-7bff-49af-9175-36f1072414a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1214 microversion: 2.1 time: 0.365170 Aug 29 10:37:05.143515 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 356/751] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:04 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:05.146602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:05.148423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:05.149882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-027a7bfb-5024-45d9-bdd9-fb12c671cafa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.735629 Aug 29 10:37:05.150272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:05.151546 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 396/752] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:04 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:05.163435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:05.174421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:05.175230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:05.175936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:05.177121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:05.177820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:05.178529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:05.707065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b168d856-646f-4fd5-afa3-ebf1f0e5fa59 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T10%3A37%3A05.060783&end=2022-08-30T10%3A37%3A05.060783" status: 404 len: 112 microversion: - time: 0.554194 Aug 29 10:37:05.707717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 397/753] 10.222.0.47 () {58 vars in 1316 bytes} [Mon Aug 29 10:37:05 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T10%3A37%3A05.060783&end=2022-08-30T10%3A37%3A05.060783 => generated 112 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 10:37:05.726685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d7766a1-b573-4396-99df-db60eb15c300 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] Calling method '.version_select at 0x7f66c75178b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:05.731307 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6d7766a1-b573-4396-99df-db60eb15c300 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d7766a1-b573-4396-99df-db60eb15c300 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] Request method failure captured: Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-simple-tenant-usage/4b794a3d0c75458c9588746b9e8055f1?start=2022-08-30T10%3A37%3A05.060783&end=2022-08-28T10%3A37%3A05.060783 HTTP/1.1 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbQhq5r8Id_8INvVf6i_guLbTuWk939zpZIW15zvLaxU2bbfDk5XdT4_5IXLLyZsuU8LyNAVrqEZoGbr24qy9bp1Vd8oKlb9b-YXVrVIuzATO63U7BdONw5TYjXTE-_S3GvfsEhzJmOD5FKylKE7WzoSun22ofdui9KZriuhYWsb1A Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: daa407eebe7a47df9e0ecf1c687d658b Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1164059538 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/daa407eebe7a47df9e0ecf1c687d658b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_daa407eebe7a47df9e0ecf1c687d658b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/daa407eebe7a47df9e0ecf1c687d658b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/daa407eebe7a47df9e0ecf1c687d658b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1164059538 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: daa407eebe7a47df9e0ecf1c687d658b Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1164059538 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2126fcad666e47b7a1c03421a1c2db18 Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid start time. The start time cannot occur after the end time. Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '4b794a3d0c75458c9588746b9e8055f1'} Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 29 10:37:05.735589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:05.739458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d7766a1-b573-4396-99df-db60eb15c300 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:05.739458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6d7766a1-b573-4396-99df-db60eb15c300 tempest-TenantUsagesNegativeTestJSON-1164059538 tempest-TenantUsagesNegativeTestJSON-1164059538-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/4b794a3d0c75458c9588746b9e8055f1?start=2022-08-30T10%3A37%3A05.060783&end=2022-08-28T10%3A37%3A05.060783" status: 400 len: 111 microversion: 2.1 time: 0.021415 Aug 29 10:37:05.739458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 398/754] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Aug 29 10:37:05 2022] GET /compute/v2.1/os-simple-tenant-usage/4b794a3d0c75458c9588746b9e8055f1?start=2022-08-30T10%3A37%3A05.060783&end=2022-08-28T10%3A37%3A05.060783 => generated 111 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:37:05.843249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:05.847246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:05.858389 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1c62ba6-2168-4f58-94f6-b330a49132ed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1472 microversion: 2.1 time: 0.713481 Aug 29 10:37:05.860081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 357/755] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:05 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1472 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:06.110146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-545196d0-a7af-4c14-a03d-3f164b41af8b tempest-TenantUsagesNegativeTestJSON-631490979 tempest-TenantUsagesNegativeTestJSON-631490979-project] Calling method '.version_select at 0x7f66c750a670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:06.114255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-545196d0-a7af-4c14-a03d-3f164b41af8b tempest-TenantUsagesNegativeTestJSON-631490979 tempest-TenantUsagesNegativeTestJSON-631490979-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7d850a83d8bd4910ad1702de47f485c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b794a3d0c75458c9588746b9e8055f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-545196d0-a7af-4c14-a03d-3f164b41af8b tempest-TenantUsagesNegativeTestJSON-631490979 tempest-TenantUsagesNegativeTestJSON-631490979-project] Request method failure captured: Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T10%3A37%3A05.060783&end=2022-08-30T10%3A37%3A05.060783&detailed=1 HTTP/1.1 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbPJaaBUWVRCUswoXTPoJ6cHE4_th8P_aoBfS1OaeaTT28Q1uQTjD7wKCiYhFZW-uiXHcMAmsPp--3NSiyzEncfo7HkO286NIae9kDtMq2_bRyHTnYZ_KCfN2eQTBmTbSY1CIhPEwVvnMk-NVUxLbYpqc_hLjf3KP2IFfwb00qPb-k Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4b794a3d0c75458c9588746b9e8055f1 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-631490979 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b794a3d0c75458c9588746b9e8055f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4b794a3d0c75458c9588746b9e8055f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4b794a3d0c75458c9588746b9e8055f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b794a3d0c75458c9588746b9e8055f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-631490979 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4b794a3d0c75458c9588746b9e8055f1 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-631490979 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TenantUsagesNegativeTestJSON-631490979-project Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7d850a83d8bd4910ad1702de47f485c4 Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-631490979-project Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:37:06.121807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 10:37:06.126904 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:06.129296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-545196d0-a7af-4c14-a03d-3f164b41af8b tempest-TenantUsagesNegativeTestJSON-631490979 tempest-TenantUsagesNegativeTestJSON-631490979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:06.132116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-545196d0-a7af-4c14-a03d-3f164b41af8b tempest-TenantUsagesNegativeTestJSON-631490979 tempest-TenantUsagesNegativeTestJSON-631490979-project] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T10%3A37%3A05.060783&end=2022-08-30T10%3A37%3A05.060783&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.377084 Aug 29 10:37:06.134914 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 399/756] 10.222.0.47 () {58 vars in 1335 bytes} [Mon Aug 29 10:37:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T10%3A37%3A05.060783&end=2022-08-30T10%3A37%3A05.060783&detailed=1 => generated 123 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:37:06.148656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:06.149267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:06.167102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.176742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:06.177607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:06.185981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.187739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:06.190047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.192122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.193867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:06.202120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.203200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.205448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:06.206885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.207936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.208368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:06.587461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:06.600055 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e626bfc0-c18f-4fb1-aa68-20f58f7cb9e0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1268 microversion: 2.1 time: 0.455104 Aug 29 10:37:06.600637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 358/757] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:06 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1268 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:06.887140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:06.888727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:06.909065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.909791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.910313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:06.911216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:06.911746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:06.912248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:07.034327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:07.066050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:07.070368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:07.078998 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b460c0a6-ac57-40ba-826c-1fcad8c351cc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.903127 Aug 29 10:37:07.081109 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 400/758] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:06 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:37:07.434252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:07.459187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0996d996-899c-46a8-b4c6-2119d772b993 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1478 microversion: 2.1 time: 0.576308 Aug 29 10:37:07.469879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 359/759] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:06 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1478 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:07.621600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:07.622653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:07.638888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:07.639584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:07.640124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:07.641150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:07.643261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:07.643970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:07.842603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:07.875337 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4847ccae-46d5-4b48-a93f-26309f4a7ed2 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1268 microversion: 2.1 time: 0.257723 Aug 29 10:37:07.878083 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 401/760] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:07 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:08.109251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:08.109814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:08.129423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:08.136950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:08.137516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:08.140709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:08.141203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:08.141646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:08.481440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:08.483628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:08.517870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:08.518751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:08.519603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:08.520525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:08.521144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:08.522228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:09.030906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:09.040763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:09.049418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:09.051192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-796e8835-3e99-40a5-8013-08885329be1c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.948197 Aug 29 10:37:09.052202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 360/761] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:08 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:09.061981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:09.069403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:09.078470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:09.083900 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9572c194-2d40-490f-b916-48790a5aaa32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1478 microversion: 2.1 time: 0.606899 Aug 29 10:37:09.084479 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 402/762] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:08 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1478 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:09.104672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:09.105517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:09.106547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:09.108410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:09.109105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:09.109958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:09.639162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:09.649983 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54a3cedc-a699-4488-b822-51bfdcd19d5d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 0.594530 Aug 29 10:37:09.650581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 361/763] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:09 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:09.992273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "name": "network-vif-plugged", "status": "completed", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:10.019291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.019782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.020209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.074368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] Creating event network-vif-plugged:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h2-854121-10 Aug 29 10:37:10.077564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:10.078201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:10.087065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cfd789fd-6aa4-4156-bcdb-920ff5ab61c3 req-2d66831c-090e-4faf-be61-c8509fdd7c1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096429 Aug 29 10:37:10.088565 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 403/764] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:37:10.098307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.100122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.100696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.104386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.106256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.107374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.109322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:10.110072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:10.121938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.124198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.124838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.128881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.129798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.130984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.513801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:10.535412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:10.536990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:10.542622 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1ab3bbd-a937-4176-b89f-fc8b8ed5178e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.469712 Aug 29 10:37:10.543220 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 362/765] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:10 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:10.694723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:10.708159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2842797b-13bf-4fc8-b54f-5027ce8cdfdb tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1478 microversion: 2.1 time: 0.603837 Aug 29 10:37:10.732891 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 404/766] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:10 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1478 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:10.742504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:10.743116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:10.768226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.768723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.769165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:10.777577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:10.782136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:10.782614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:11.291960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:11.309656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47b3d7a2-8f1a-4337-a3f3-f91f0cf63aff tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 0.574602 Aug 29 10:37:11.312278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 405/767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:10 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:11.320436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660f8d07-1d21-44ca-a221-6846d139878e", "tag": "39e1e053-2d0d-46aa-826d-dd550c63c13d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:11.363972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:11.365311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:11.366734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:11.406203 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] Creating event network-changed:39e1e053-2d0d-46aa-826d-dd550c63c13d for instance 660f8d07-1d21-44ca-a221-6846d139878e on n-h2-854121-10 Aug 29 10:37:11.407147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1702387586", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:11.424017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e86ee952-1fa5-40ef-be8d-ac7f89f475fb req-b1dfc266-8d42-4404-8423-bde9bc968140 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109792 Aug 29 10:37:11.427237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 406/768] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:11.532123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] validate_networks() for [('091704cf-acbc-40d5-9973-35e52136f451', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:11.568849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:11.570155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:11.583742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:11.584432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:11.586574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:11.587549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:11.590360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:11.592683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.029349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:12.039237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:12.040694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:12.041864 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-379561cd-95ef-445f-a227-ffe6a0a89415 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1410 microversion: 2.25 time: 0.479624 Aug 29 10:37:12.042432 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 407/769] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:11 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1410 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:12.069398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:12.070112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:12.096669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:12.100935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:12.107889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.109113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:12.110634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:12.111439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.523264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:12.548176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-22814a97-28dd-44df-bc8e-0efc5014b083 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1478 microversion: 2.1 time: 0.502660 Aug 29 10:37:12.549353 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 408/770] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:12 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1478 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:12.554434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "name": "network-vif-unplugged", "status": "completed", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:12.581916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:12.582631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:12.583263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.620663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] Creating event network-vif-unplugged:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:37:12.627156 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-746517a6-40b4-4261-91ea-7d3efb4976c5 req-ae0bafd0-af16-4dc5-92e1-6793872ed238 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076314 Aug 29 10:37:12.628364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 409/771] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:12.857274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:12.859548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:12.860293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:12.860881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:12.861459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:12.879078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:12.879874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:12.880744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.882917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:12.883837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:12.886084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:12.933086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:12.941906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for user 78cba28ccfd244dba6e46f23d7ef35f4 and project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:12.956686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:12.959179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:13.038794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1090621235", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:13.045993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9aad7728-5888-47e5-92b9-14b137d28c62 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.496348 Aug 29 10:37:13.050831 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 363/772] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:37:13.074912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:13.076175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:13.086945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.087769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.088415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:13.089341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.089848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.090288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:13.143720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:13.684437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=38 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:13.800650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:13.801100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:13.801560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:13.802199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:13.802878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:13.818818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.830556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.831026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:13.831865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.832331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.832765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:13.884440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:13.887545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:13.895764 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6db2e769-76a1-42c6-ba3d-bb5864d43506 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 0.843518 Aug 29 10:37:13.902570 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 364/773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:13 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:13.907342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:13.915015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:13.935811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:13.970854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:13.972975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.978185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:13.998594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.998594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:13.998594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:13.998594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:13.999293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:14.085605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:14.204433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-545ffbc5-a783-436b-9562-435d8f821be1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574546 Aug 29 10:37:14.207759 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 410/774] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:37:14.224012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:14.224958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:14.265038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:14.266736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:14.270937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:14.280532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:14.285604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:14.288688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:14.332866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:14.350836 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-07037dde-78fb-4be4-aa8f-741b09ae2bb7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1226 microversion: 2.1 time: 0.445312 Aug 29 10:37:14.360001 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 365/775] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:13 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1226 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:14.395001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:14.417060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:14.443575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:14.448645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:14.451067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:14.453972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:14.454767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:14.456350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:15.459227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:15.472731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:15.476004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:15.479388 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37805463-6dcb-4805-a5c1-108375a1c014 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1606 microversion: 2.25 time: 1.270446 Aug 29 10:37:15.487692 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 411/776] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:14 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1606 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:15.501953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:15.502461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:15.534434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:15.535986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:15.538657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:15.541959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:15.543106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:15.545588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:15.559297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:15.586663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27f9691b-51da-41a6-a979-f8d67c4b850e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1478 microversion: 2.1 time: 1.207868 Aug 29 10:37:15.588353 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 366/777] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:14 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1478 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:15.608763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:15.613307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:15.632062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:15.635190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:37:15.644254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:15.646508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:15.649018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:15.655579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:15.655579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:15.830352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec31b6ae-5ac4-49bf-b5ef-28b8e12939ad tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 204 len: 0 microversion: 2.1 time: 0.340295 Aug 29 10:37:15.831263 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 412/778] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:37:15 2022] DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:37:15.865066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1767047067", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:15.897674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:15.919451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deef8668-fa2b-4cfe-8f50-05eaa0e13931 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1209 microversion: 2.1 time: 0.325388 Aug 29 10:37:15.921016 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 367/779] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:15 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1209 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:15.948228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "name": "network-vif-plugged", "status": "completed", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:15.962354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] validate_networks() for [('091704cf-acbc-40d5-9973-35e52136f451', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:15.972415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:15.973175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:15.973760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.006140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] Creating event network-vif-plugged:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:37:16.013327 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-74df94a3-ce51-4934-85d2-22f7e48d707d req-39e97e56-78ea-4357-861f-1909997a1309 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090082 Aug 29 10:37:16.014491 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 368/780] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:16.020958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:16.022091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:16.037829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.039462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.040592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.044816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.047931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.050091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.477454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:16.495698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e9e7754-432a-4120-9f91-00b7e41c7a89 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 0.477275 Aug 29 10:37:16.497096 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 369/781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:16 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:16.516800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:16.517319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:16.532697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.535257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.535969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.538245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.538864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.539405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.655629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:16.656498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:16.657128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:16.658131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:16.658663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:16.678089 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b3e1147-a96f-4a42-b4d4-6efd924c9f6c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.179518 Aug 29 10:37:16.679007 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 370/782] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:37:16 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:37:16.689100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.690148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.690825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.691810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:16.693539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:16.695153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:16.726369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:16.734789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for user 78cba28ccfd244dba6e46f23d7ef35f4 and project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:16.751896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:16.754751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:16.792455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1906473014", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "5448ad7b-c0bc-4881-99bf-045f093f2719"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:16.839919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d25ae64-c69c-48e1-8b6f-5c3212902d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.006228 Aug 29 10:37:16.847591 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 413/783] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:37:16.853300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2096193850", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "411152838", "adminPass": "***", "networks": [{"uuid": "29fc2090-58ba-4ab8-b730-1b56c4083b7a"}], "security_groups": [{"name": "tempest-securitygroup--1172162650"}], "key_name": "tempest-keypair-982429982", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:16.919764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] validate_networks() for [('5448ad7b-c0bc-4881-99bf-045f093f2719', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:17.379413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] validate_networks() for [('29fc2090-58ba-4ab8-b730-1b56c4083b7a', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:19.654211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:19.655531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:19.658622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:19.659282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:19.659874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:19.679486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:19.680020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:19.680425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:19.680735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:19.681163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:19.686319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:19.686955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.687455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.687893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.688858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.689494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.690347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.703315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.703810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.704260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.705001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.705553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.705924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.736684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for project e59eae080bd748178fd926a03feebc21. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:19.759838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Getting quotas for user caca964aba784dfd9f250baad9e9ec19 and project e59eae080bd748178fd926a03feebc21. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:19.771971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:19.793784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for user 8b5f92e4798240c3a3c95041dde29e60 and project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:19.805937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:19.808368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:19.822559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:19.833449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:19.928115 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51bb3304-f807-4522-a1e5-e029775aaead tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.247701 Aug 29 10:37:19.929316 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 371/784] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:37:19.936186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:19.937403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:19.947762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.948687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.949382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.951467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:19.952428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:19.953109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:19.957094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-faf08411-428f-4ee1-bfcb-a09fe0951736 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.108042 Aug 29 10:37:19.964536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 414/785] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 3116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:37:19.969473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:19.980279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:20.001388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.010493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.011208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:20.013737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.014674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.015387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:20.189857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:20.199179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-14cccd42-6d1d-4674-8303-d6e5bfc4807d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1292 microversion: 2.1 time: 0.233634 Aug 29 10:37:20.203189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 415/786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:19 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1292 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:20.215607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:20.216245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:20.228244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.230775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.232145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:20.234456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.240671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.241291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:20.644564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:20.657085 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c53c2ca4-88c0-4e8f-8e9a-06c97f6cf81e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1271 microversion: 2.1 time: 0.446090 Aug 29 10:37:20.658140 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 416/787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:20 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1271 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:20.663306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:20.664016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:20.683871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.685465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.686001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:20.687313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:20.689115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:20.690639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.050815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:21.061314 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c4e27b2e-fc72-4d33-adeb-f2d4b914eb9d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1464 microversion: 2.1 time: 1.130315 Aug 29 10:37:21.069190 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 372/788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:19 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1464 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:21.075529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:21.086781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:21.098249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.099093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.099752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.100696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.102060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.102716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.312361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:21.327007 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7bb41af7-b732-4ab9-9f1c-92c12634455b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1229 microversion: 2.1 time: 0.255925 Aug 29 10:37:21.327610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 373/789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:21 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1229 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:21.337764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:21.343400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:21.354742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.362270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.363117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.364054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.364688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.365654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.571669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:21.587943 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce85ddc1-d65d-448c-8f43-ae7f68926ed4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 0.928200 Aug 29 10:37:21.593460 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 417/790] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:20 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:21.602431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660f8d07-1d21-44ca-a221-6846d139878e", "name": "network-vif-plugged", "status": "completed", "tag": "39e1e053-2d0d-46aa-826d-dd550c63c13d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:21.631455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.632429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.633117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.650322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:21.661574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:21.677241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51425e22-b6d2-4dde-bc95-c4327d0840b4 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1314 microversion: 2.1 time: 0.348531 Aug 29 10:37:21.684080 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 374/791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:21 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:21.698406 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] Creating event network-vif-plugged:39e1e053-2d0d-46aa-826d-dd550c63c13d for instance 660f8d07-1d21-44ca-a221-6846d139878e on n-h2-854121-10 Aug 29 10:37:21.710631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d50327c-ed07-477a-aec6-424b7178f0b4", "tag": "75155c6a-0909-4a71-b9ab-a56eef4cd231"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:21.728368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-73382b39-9d38-42c9-9ab9-d7d1945a947f req-a1ed1889-9def-45b7-877e-356b62a34526 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133007 Aug 29 10:37:21.733559 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 418/792] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:21.750723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.755169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:21.756422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.757001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.758284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:21.801015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.804671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.805829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.808887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.815477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.816943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.826912 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] Creating event network-changed:75155c6a-0909-4a71-b9ab-a56eef4cd231 for instance 3d50327c-ed07-477a-aec6-424b7178f0b4 on n-h1-854121-10 Aug 29 10:37:21.848720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-17dedfff-9f43-4374-b47f-4d79076e0b90 req-773799f5-ba90-4f9b-8241-78eef0626fe0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160378 Aug 29 10:37:21.855173 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 375/793] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:21.861594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:21.866084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:21.879855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.880357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.880801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:21.881520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:21.882000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:21.882440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.044760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:22.058057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53e7a919-e469-4601-b1a9-62ddcff3b80c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1280 microversion: 2.1 time: 0.199473 Aug 29 10:37:22.067110 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 376/794] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:21 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:22.082881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:22.086528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:22.103314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.105302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.107072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.122132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.132305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.142945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.214738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:22.259008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:22.270610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ddc60571-4a70-46dd-893d-4d3bd547850d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1464 microversion: 2.1 time: 0.535281 Aug 29 10:37:22.278526 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 419/795] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:21 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1464 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:22.284101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:22.319779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.320270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.320704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.337875 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] Creating event network-changed:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h2-854121-10 Aug 29 10:37:22.359632 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cdd73ebe-3af8-4ca0-b51d-00ba4c9e84f9 req-906210a0-54c1-4f7d-a3d4-2d046cc1f894 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079037 Aug 29 10:37:22.360612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 420/796] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:22.366096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:22.369009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:22.369796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:22.382850 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12ab3c5d-25d1-4f42-a6c5-d7d6b72bb414 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1271 microversion: 2.1 time: 0.311929 Aug 29 10:37:22.386228 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 377/797] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:22 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:22.395986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.396799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.397413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.398342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.398994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.399587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.425570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:22.432911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:22.453461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.454295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.456464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.457485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.460331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.461001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.560639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:22.561457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:22.562211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:22.562858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:22.563490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:22.641637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:22.649107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.649791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.650358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.651209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.651916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.652602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.693563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2ccc01f-6a35-48df-91ca-1c3c0eea58b3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 1068 microversion: 2.1 time: 0.330671 Aug 29 10:37:22.694579 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 421/798] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:22 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 1068 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 10:37:22.702950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:22.704521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:22.718572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.719799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.720886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:22.722124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:22.722740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:22.723259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:23.246232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:23.259698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11735443-7e96-4563-bef1-7838063941bb tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1277 microversion: 2.1 time: 0.872021 Aug 29 10:37:23.280311 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 378/799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:22 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1277 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:23.280311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:23.280311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:23.287676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:23.290762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:23.291264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:23.292019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:23.297633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:23.298437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:23.587808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:23.598776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-662f53c4-de34-477f-8856-20945e0ab6a1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1320 microversion: 2.1 time: 0.329625 Aug 29 10:37:23.607683 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 379/800] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:23 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:23.621833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:23.622857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:23.629396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:23.634545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:23.635275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:23.636241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:23.636895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:23.639260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:24.011866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:24.019839 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-051353bb-2681-49f6-bc61-8966a73648f0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1310 microversion: 2.1 time: 1.323337 Aug 29 10:37:24.032219 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 422/801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:22 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1310 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:24.047644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:24.049652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:24.076524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:24.077306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:24.078061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:24.080936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:24.081669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:24.082750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:24.379777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:24.391157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ef1c0042-1bf1-48d1-95c4-11d780f9aac3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.781936 Aug 29 10:37:24.392696 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 380/802] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:23 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:24.400744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:24.401361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:24.415592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:24.421960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:24.422749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:24.423662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:24.424334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:24.424958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.426920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:25.439844 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1beba1e1-3f2d-45cc-8b30-dedf141081f8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 1.405386 Aug 29 10:37:25.443515 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 423/803] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:24 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:25.456396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:25.457467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:25.458139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:25.475425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16470dd1-80cc-4838-b560-e4ab4b168447 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 1.081455 Aug 29 10:37:25.476677 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 381/804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:24 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:25.484955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8566034-3f61-4670-87f9-c70f21528d2d", "name": "network-vif-deleted", "tag": "60c5ce34-0b6b-4d39-b10e-b4f0a4b68587"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:25.492480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.493196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.493408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.494171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.495045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.495530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.499422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.500253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.500923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.521214 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] Creating event network-vif-deleted:60c5ce34-0b6b-4d39-b10e-b4f0a4b68587 for instance b8566034-3f61-4670-87f9-c70f21528d2d on n-h1-854121-10 Aug 29 10:37:25.538654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-352bbfc2-49ae-4aeb-b8e5-1e3de1d3ff1b req-7bc2e1ce-0c6a-469a-a134-c345b6f48b42 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056221 Aug 29 10:37:25.539439 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 382/805] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:25.553454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:25.554271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:25.570169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.572784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.573486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.577931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.578882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.579581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.768767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:25.782206 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53b78463-1965-4836-89ad-aad4dc03dcb0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1283 microversion: 2.1 time: 0.333995 Aug 29 10:37:25.782798 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 424/806] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:25 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:25.788139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:25.788755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:25.799493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.799992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.800434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.801206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.801946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.802833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.818860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:25.836281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-093cf065-2ea9-4b48-80fc-0b58c6dd9e48 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1320 microversion: 2.1 time: 0.295030 Aug 29 10:37:25.839698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 383/807] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:25 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:25.847353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:25.848185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:25.858119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.859201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.860433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:25.862297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:25.862964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:25.863556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:26.737146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:26.749545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:26.769005 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c91cb17-37c3-47ed-9d8f-70adc6b58201 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.925476 Aug 29 10:37:26.772417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a643027e-3fd8-4106-b26d-53841b70fe4c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1493 microversion: 2.1 time: 0.988290 Aug 29 10:37:26.773979 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 425/808] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:25 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1493 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:26.786454 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 384/809] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:25 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:26.786454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:26.786454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:26.798969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:26.802517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:26.818837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:26.820317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:26.821054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:26.822083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:26.827923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:26.828380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:26.837924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:26.838545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:26.839210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:26.840957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:26.841430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:26.841937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:27.281297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:27.294720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2deba39-ce4c-4265-9bfa-5d7621558875 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.515514 Aug 29 10:37:27.295648 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 385/810] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:26 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:27.300446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:27.301360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:27.308409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:27.309257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:27.309987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:27.310944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:27.311477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:27.312023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:27.325517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:27.365538 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-541be809-01d6-45fe-9536-b76c94c379ea tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.582201 Aug 29 10:37:27.386634 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 426/811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:26 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:27.394765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:27.402690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:27.418836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:27.419854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:27.420605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:27.421612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:27.422860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:27.423546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:27.966786 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba8fe8ac-914c-4d44-9146-fee0cb38353d tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1646 microversion: 2.1 time: 0.665024 Aug 29 10:37:27.967888 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 386/812] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:27 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1646 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:27.988566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:27.989946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:28.011376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.015037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.015465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:28.016367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.017595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.018458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.019114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.026167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-641f8086-5436-483c-80b0-82d1d005b59c tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.637294 Aug 29 10:37:28.029562 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 427/813] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:27 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:28.035728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:28.060720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.061222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.062638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.083940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] Creating event network-changed:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h1-854121-10 Aug 29 10:37:28.095135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7464fff9-4314-4448-80a4-818a0c1c76a2 req-69901a57-6570-4bad-9d0d-ebfaa096a570 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063063 Aug 29 10:37:28.095993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 428/814] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:28.104018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:28.104795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:28.111931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.112527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.113052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.114339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.115019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.115646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.742035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:28.743409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:28.762753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37fbb9b1-31e8-4f17-ba3c-ccb836a9b9d5 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.664397 Aug 29 10:37:28.770227 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dbb368d4-c591-4490-a4ed-0c03c96e2d73 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.782545 Aug 29 10:37:28.782694 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 387/815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:27 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:28.786274 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 429/816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:28 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:28.788040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d50327c-ed07-477a-aec6-424b7178f0b4", "name": "network-vif-plugged", "status": "completed", "tag": "75155c6a-0909-4a71-b9ab-a56eef4cd231"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:28.793312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:28.795414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:28.806172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.806847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.807292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.808012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.808476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.809458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.825476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.829317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.830762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.872902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] Creating event network-vif-plugged:75155c6a-0909-4a71-b9ab-a56eef4cd231 for instance 3d50327c-ed07-477a-aec6-424b7178f0b4 on n-h1-854121-10 Aug 29 10:37:28.887671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b24eb638-ceaa-42bf-9a60-d6a509359ee9 req-d6ae07b4-a7f2-4f3d-8d0a-6ec087cc07f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107317 Aug 29 10:37:28.888862 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 388/817] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:28.902383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:28.906097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:28.914584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.915609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.916879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:28.917903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:28.919916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:28.921043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.606858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:29.622267 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80fe7cde-2ff3-4199-abea-96b4293602f2 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1646 microversion: 2.1 time: 0.828745 Aug 29 10:37:29.635450 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1fb6afd7-4e1f-4f8d-9843-a6b17189054a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.745309 Aug 29 10:37:29.636096 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 430/818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:28 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1646 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:29.638531 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 389/819] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:28 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:29.651876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a330a56-f2f3-4471-91b5-86c3e850bc85", "tag": "e772144e-bb4b-4a8d-849f-bbcf151239c4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:29.659177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:29.660504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:29.674764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:29.677791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:29.678506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.681255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:29.683599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:29.687430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.688551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:29.689848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:29.690303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.713133 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] Creating event network-changed:e772144e-bb4b-4a8d-849f-bbcf151239c4 for instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 on n-h1-854121-10 Aug 29 10:37:29.722847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:29.724260 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3a69bc42-a684-49f2-a726-0b53af2f532c req-63ed4a1c-c2e7-44e7-80af-fcb29daf87a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084152 Aug 29 10:37:29.728061 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 390/820] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:29.742326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:29.743975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:29.756793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:29.761748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:29.762579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:29.763153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.763877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:29.765376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:29.765856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:29.782981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:29.814907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=18 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:30.264335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:30.275305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ae6a1b6-d138-432f-ac24-e219842819ad tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.637913 Aug 29 10:37:30.278907 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 431/821] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:29 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:30.289844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:30.298835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.299436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.299941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:30.300852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.301314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.301846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:30.339221 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6fbaf6cc-6a13-414f-8817-c77419cf8f3f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.058192 Aug 29 10:37:30.349256 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 432/822] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:37:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:30.354258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:30.354875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:30.362515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.363016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.363452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:30.364158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.364963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.365102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:30.412209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:30.422747 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-039c110e-3df2-44c3-bc2a-c071f42bcc55 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.693180 Aug 29 10:37:30.428437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 391/823] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:29 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:30.433483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:30.438643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:30.450624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.451491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.452145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:30.465969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:30.468674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:30.471232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.125134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:31.134908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1465f4ff-d4fb-4ea8-90a6-7ba3ecc40c59 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.784434 Aug 29 10:37:31.140391 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 433/824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:30 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:31.142347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:31.145176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:31.145777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:31.158476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38405666-0e40-456e-adfc-d25c67fd79b1 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.727666 Aug 29 10:37:31.162404 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 392/825] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:30 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:31.178692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:31.180021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:31.180761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.181448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.182078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.182990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.184788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.190179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.198916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.202957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.203700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.204866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.205508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.206151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.292100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:31.341399 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-62dbccc3-eca9-47e8-b74f-ed4c3d516315 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e/action" status: 202 len: 0 microversion: 2.1 time: 0.199060 Aug 29 10:37:31.345112 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 434/826] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:31 2022] POST /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:37:31.353427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:31.362835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:31.377595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.378479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.379120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.380311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.380943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.381534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.698837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:31.721487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1bef6d7-5af6-41a2-b804-9330183cff66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.557576 Aug 29 10:37:31.724594 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 393/827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:31 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:31.744406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:31.746009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:31.757860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.758684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.759306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.760712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:31.761332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:31.762254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:31.957151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:32.003030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-087a76dd-a372-46aa-945e-07a1f194c5f2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.653596 Aug 29 10:37:32.004836 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 435/828] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:31 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:32.024012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:32.028241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:32.074338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:32.075254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:32.076039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:32.076951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:32.077620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:32.078401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:32.386269 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d68c7984-b649-482e-a459-2081275f402f tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1631 microversion: 2.1 time: 0.646027 Aug 29 10:37:32.390670 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 394/829] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:31 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1631 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:32.398183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2e6676-1451-4d4d-88f2-3500238949f4", "tag": "00e19c65-a267-438e-8a26-ff2f7827f601"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:32.424599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:32.425751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:32.426201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:32.446171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] Creating event network-changed:00e19c65-a267-438e-8a26-ff2f7827f601 for instance 7e2e6676-1451-4d4d-88f2-3500238949f4 on n-h2-854121-10 Aug 29 10:37:32.452511 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a1fd58a6-0d87-4b87-84cb-0abea0164217 req-c7992390-d8a1-4525-a9dc-e802c1acf73d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060084 Aug 29 10:37:32.453754 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 395/830] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:32.461118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:32.462061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:32.468873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:32.469870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:32.470316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:32.471035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:32.471496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:32.471925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.113366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:33.128023 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f248b92-4656-423e-af08-df771ee17c09 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 1.121181 Aug 29 10:37:33.128620 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 436/831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:32 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:33.145652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:33.146554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:33.153283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.158529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.158989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.159744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.160208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.160643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.285488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:33.289955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:33.300992 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d419c14b-7cc9-4c39-9818-a2486ba13a72 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.844034 Aug 29 10:37:33.303459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 396/832] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:32 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:33.321089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:33.323919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:33.334762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.335288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.335721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.336431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.341561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.342245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.413800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lazy-loading 'flavor' on Instance uuid 660f8d07-1d21-44ca-a221-6846d139878e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:37:33.472255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Going to try to live migrate instance to n-h1-854121-10 {{(pid=128682) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:37:33.626079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:33.636090 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e3e842d-096d-4f44-a86d-499853e6668e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.505675 Aug 29 10:37:33.644420 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 437/833] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:33 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:33.649557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:33.655217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:33.665884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:33.673360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.674325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.674981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:33.675914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:33.678956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:33.679667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:34.007520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:34.035530 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1febc932-121f-4414-8f2a-0ea76f8bbfd1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.389580 Aug 29 10:37:34.053933 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 438/834] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:33 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:34.059854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:34.060897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:34.067680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:34.068445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:34.069090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:34.070659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:34.071343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:34.072209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:34.740419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:34.772035 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ed8347f-1ae7-4dbb-95fd-edf6ef4ff165 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.716649 Aug 29 10:37:34.772831 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 439/835] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:34 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:34.806891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:34.807525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:34.822978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:34.823533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:34.827118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:34.828134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:34.832266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:34.832737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.451986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:35.461680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf8d1f5f-cbea-4827-b22c-ade3b4b8f7b2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.670747 Aug 29 10:37:35.470222 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 440/836] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:34 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:35.475203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:35.478494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:35.488371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.491450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.492121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.494283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.497360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.497998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.769484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b41df44-9423-45f9-a7bf-edf9166ae6bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e/action" status: 202 len: 0 microversion: 2.1 time: 2.464576 Aug 29 10:37:35.772987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 397/837] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:33 2022] POST /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e/action => generated 0 bytes in 2466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:37:35.775414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d093296-fa58-46c9-9265-f99c9c0cb097", "tag": "3245372e-9f1b-48f4-ab6a-f9035e26187c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:35.789418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.790192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.790836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.805929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] Creating event network-changed:3245372e-9f1b-48f4-ab6a-f9035e26187c for instance 9d093296-fa58-46c9-9265-f99c9c0cb097 on n-h2-854121-10 Aug 29 10:37:35.812678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-71f084e7-a449-4d1e-b8aa-b579cab2babb req-9607ab49-d909-4580-b569-ddc8610b5a93 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040973 Aug 29 10:37:35.813970 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 398/838] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:35.821652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:35.827440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:35.838004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.838703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.838842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:35.846993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.848099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.848768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.849354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.857498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d052a548-45c2-47ba-85c8-6b179b837514 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.382324 Aug 29 10:37:35.860181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 441/839] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:35 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:35.867750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "name": "network-vif-plugged", "status": "completed", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:35.893002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.895664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.897682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:35.924728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] Creating event network-vif-plugged:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h1-854121-10 Aug 29 10:37:35.943483 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fcf253cc-04ac-4fef-a725-2b8693f2a785 req-161f07f7-5735-4895-8fdd-9789340406b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080698 Aug 29 10:37:35.944768 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 442/840] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:35.950792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:35.964841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:35.995736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:35.997258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:35.999361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.000279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.003305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.003973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.193598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:36.202831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebf3a136-a9fb-438d-8411-241d1bf48a1a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.387156 Aug 29 10:37:36.219880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 399/841] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:35 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:36.235161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:36.236384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:36.249679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.250496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.251093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.254548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.254966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.257325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.519745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:36.547188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45f9bc12-fd6b-4c95-b9dc-72d61e5b06a2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.600977 Aug 29 10:37:36.563310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 443/842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:35 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:36.569083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:36.570206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:36.570923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:36.578177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.578858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.579303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.581567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b512944f-43b5-4784-8111-62e23c1c8836 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.360277 Aug 29 10:37:36.582838 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 400/843] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:36 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:36.588387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:36.589281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:36.593446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.594242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.594593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.602187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.602915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.604927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.607796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.608453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.609050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.882258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:36.892080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:36.902883 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1845dde1-2ede-4415-a11a-df29543c0f9b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.316287 Aug 29 10:37:36.914133 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 401/844] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:36 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:36.925170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:36.926330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:36.933408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.934308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.934980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.936186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:36.936852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:36.937531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:36.938200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e7fba8bb-d3a0-4778-8cfa-a46f0ba3673d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.373027 Aug 29 10:37:36.938993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 444/845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:36 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:37.200996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:37.213442 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b9a0a26-f7e9-4b56-852b-d197bcaf65bb tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.297630 Aug 29 10:37:37.214784 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 402/846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:36 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:37.235553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:37.237033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:37.257732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.260793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.262575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:37.263546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.265490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.266165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:37.572290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:37.573154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:37.581369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.582183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.583421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:37.584932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.585570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.586213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:37.737888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:37.756325 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b028d53b-66e0-48a9-8e52-f1bf0235e79e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.526273 Aug 29 10:37:37.774725 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 445/847] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:37 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:37.785732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:37.793832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:37.821988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.824677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.825566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:37.828884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:37.829686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:37.831700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.364833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:38.380660 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-746e248d-562b-4876-8cf6-00c462aa72ac tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1313 microversion: 2.1 time: 0.812062 Aug 29 10:37:38.381573 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 403/848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:37 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1313 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:38.391018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:38.398956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:38.415459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.416195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.416798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.418978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.419890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.423040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.628294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:38.659697 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3acc27e6-f4d3-4a96-8fc6-a9de1cc72714 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.883289 Aug 29 10:37:38.662565 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 446/849] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:37 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:38.668416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:38.669629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:38.679533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.680518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.681196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.682706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.683952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.685046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.861001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:38.872723 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a1658f2-ba4b-49c4-846b-86c4936d94b5 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.489815 Aug 29 10:37:38.897726 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 404/850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:38 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:38.907103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:38.911661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:38.924593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.925513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.932470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:38.934204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:38.935364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:38.936029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.047296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:39.057554 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35fc7113-9b48-45d8-84b6-dc4c0e166933 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.393411 Aug 29 10:37:39.059450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 447/851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:38 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:39.065263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a330a56-f2f3-4471-91b5-86c3e850bc85", "name": "network-vif-plugged", "status": "completed", "tag": "e772144e-bb4b-4a8d-849f-bbcf151239c4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:39.077833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.078672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.079414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.102840 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] Creating event network-vif-plugged:e772144e-bb4b-4a8d-849f-bbcf151239c4 for instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 on n-h1-854121-10 Aug 29 10:37:39.110461 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5e65f773-babb-46b9-ba53-fd4bf8f5b286 req-80010b63-1a98-4876-9878-273f5d92502a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049037 Aug 29 10:37:39.111428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 448/852] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:39.116954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:39.117741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:39.124761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.125263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.125728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.126643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.127115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.127600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.161671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:39.174458 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bbbd1bfd-dd06-4af1-94ce-cf41a4cbe2ec tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.272424 Aug 29 10:37:39.183159 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 405/853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:38 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:39.407892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:39.409370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:39.416594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.417393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.418139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.419065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.419825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.420487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.459736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:39.471627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-113a2623-d754-4142-b62b-0a5d1e83fd04 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.358945 Aug 29 10:37:39.472566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 449/854] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:39 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:39.671511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:39.686517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:39.687839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:39.706462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.708751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.710599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.712146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.716742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5523e6d-c2c3-4e30-bcc0-21ccd758742a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1463 microversion: 2.1 time: 0.312742 Aug 29 10:37:39.717234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.718427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.731959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 406/855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:39 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1463 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:39.746342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660f8d07-1d21-44ca-a221-6846d139878e", "name": "network-vif-unplugged", "status": "completed", "tag": "39e1e053-2d0d-46aa-826d-dd550c63c13d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:39.787731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:39.789343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:39.790056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:39.806160 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] Creating event network-vif-unplugged:39e1e053-2d0d-46aa-826d-dd550c63c13d for instance 660f8d07-1d21-44ca-a221-6846d139878e on n-h2-854121-10 Aug 29 10:37:39.812488 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8441d135-257b-4730-b379-8573573ecb7e req-66c0466c-630e-492c-a2fa-8077c03f40db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077789 Aug 29 10:37:39.814898 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 407/856] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:40.084595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:40.096429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a349fee-8c5e-4660-8482-31c4512799a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.414749 Aug 29 10:37:40.098664 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 450/857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:39 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:40.104344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:40.105217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.114598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.115291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.115872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.116760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.117216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.117659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.263413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:40.264244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.275118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.278195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.278781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.279622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.283051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.283717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.316611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:40.508877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:40.564669 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8b45b48f-66d9-40cb-9f01-1a5ce5c67b25 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.441434 Aug 29 10:37:40.568046 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 451/858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:40 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:40.602416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:40.617105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.630785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.631686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.632310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.633650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.634325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.634936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.665509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:40.740243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9176c58a-ac03-4f39-97e4-54e19775126f tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1616 microversion: 2.1 time: 0.923748 Aug 29 10:37:40.741361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 408/859] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:39 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1616 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:40.746616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:40.747400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.754006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.754711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.755299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.756168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.756617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.757035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.876959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:40.884834 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9585207d-4954-415b-ae47-cb4926766bf9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1322 microversion: 2.1 time: 0.315738 Aug 29 10:37:40.894407 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 452/860] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:40 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:40.903395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:40.904082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.910073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.910559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.911306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.911688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.912139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.912561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.930454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:40.938477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cecfea15-468e-448c-8bdb-2fc58491a73e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.195899 Aug 29 10:37:40.946087 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 409/861] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:40 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:40.956779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:40.957356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:40.967722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.967722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.967722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:40.967722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:40.968128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:40.968414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.022386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6b36bc0577ae4eeb83f37e1498dd1026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3a732e4c7409888a4b49a119ef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:41.022993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] flavor_id is None. Assuming migration. {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 10:37:41.023436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 10:37:41.066219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:41.075256 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b694369-6b03-4feb-b9ba-d964d13c8900 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.180010 Aug 29 10:37:41.076137 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 453/862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:40 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:41.122397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:41.123252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:41.129602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.130320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.130918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.131788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.132415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.133033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.277429 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4b5a1e7-4548-4714-8195-65d613f17a55 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2/action" status: 202 len: 0 microversion: 2.1 time: 0.324224 Aug 29 10:37:41.282288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 410/863] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:40 2022] POST /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:37:41.288194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2e6676-1451-4d4d-88f2-3500238949f4", "name": "network-vif-plugged", "status": "completed", "tag": "00e19c65-a267-438e-8a26-ff2f7827f601"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:41.304523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.305488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.306838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.320569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:41.325499 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] Creating event network-vif-plugged:00e19c65-a267-438e-8a26-ff2f7827f601 for instance 7e2e6676-1451-4d4d-88f2-3500238949f4 on n-h2-854121-10 Aug 29 10:37:41.332094 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5afbb534-5b02-4136-a748-9ea5bbccdb66 req-b31e39aa-ac18-4916-a26d-bbebed67f1b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047182 Aug 29 10:37:41.333808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 411/864] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:41.340249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:41.355916 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8381be0-3070-4850-8bf5-7d1aa71837d8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.236799 Aug 29 10:37:41.366687 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 454/865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:41 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:41.368678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:41.370240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:41.384519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.385257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.386065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.402988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.405602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.406347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.593746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:41.594740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:41.611717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.612506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.615205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.616203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.616888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.617533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.778114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:41.795923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-440f7b6f-f649-4be3-8e42-56b9fefae0f1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1472 microversion: 2.1 time: 0.455872 Aug 29 10:37:41.809369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 412/866] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:41 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:41.852316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660f8d07-1d21-44ca-a221-6846d139878e", "tag": "39e1e053-2d0d-46aa-826d-dd550c63c13d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:41.866525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:41.875696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.879207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.879810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.911118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:41.916435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] Creating event network-changed:39e1e053-2d0d-46aa-826d-dd550c63c13d for instance 660f8d07-1d21-44ca-a221-6846d139878e on n-h2-854121-10 Aug 29 10:37:41.926274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f0e962f-1170-466d-ac52-edd32f1927f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1325 microversion: 2.1 time: 0.335119 Aug 29 10:37:41.928065 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-18cb47a1-673e-4739-bb15-00015a11a068 req-27f4a3d3-d836-457d-98fc-fe1dc79b8086 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080752 Aug 29 10:37:41.934225 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 413/867] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:41.943283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:41.943998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:41.947581 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 455/868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:41 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:41.961511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:41.962377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.962868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:41.965185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.965651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.968598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.969133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.969577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.972215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.972949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.993435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:41.994617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:41.995254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:41.996488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.446000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:42.452757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:42.461677 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2225f25-9274-4ed9-a3f0-d5e24a6971bf tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.504797 Aug 29 10:37:42.462949 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b3e6e33c-8243-4059-8283-877135321b59 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1516 microversion: 2.1 time: 0.526724 Aug 29 10:37:42.463774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 414/869] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:41 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:42.470030 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 456/870] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:41 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:42.491769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:42.492589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:42.500259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.501308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.501450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:42.502886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.503965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.504598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.505186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.506448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:42.529932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.530749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.533189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.534280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.536412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.538264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.845268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:42.854329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-969cc369-839b-4f74-af69-16c34f17b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.382743 Aug 29 10:37:42.856159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 457/871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:42 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:42.864684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:42.881325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:42.891489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:42.896341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc30c235-0de6-4da9-bb27-34664dad717c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.413806 Aug 29 10:37:42.904427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.905754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.907129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.908582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.909227 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 415/872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:42 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:42.912408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.913511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.922045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:42.924713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:42.940768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.942634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.944071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.945485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:42.946906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:42.950529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:42.988034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'flavor' on Instance uuid 8a330a56-f2f3-4471-91b5-86c3e850bc85 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:37:43.270651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:43.279646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b08007e-cf61-4539-8053-df6496b4ebca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1472 microversion: 2.1 time: 0.369261 Aug 29 10:37:43.295811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 416/873] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:42 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:43.299273 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08e08c78-a166-4a46-9867-2b019f5e51ca tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action" status: 200 len: 32 microversion: 2.1 time: 0.440678 Aug 29 10:37:43.299894 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 458/874] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:42 2022] POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:37:43.313150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:43.314202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:43.327695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.330538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.331791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:43.332426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.332567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:43.333668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.349366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.351398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.352943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.354336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.357195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.357918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.358657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.360319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.796066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:43.805348 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f070324-1346-43a6-8703-06a60d5ef498 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.492374 Aug 29 10:37:43.807185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:43.816644 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 459/875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:43 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:43.819306 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2df0e815-6ca2-48b7-94d7-aeb503979070 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.521874 Aug 29 10:37:43.820357 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 417/876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:43 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:43.822044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d093296-fa58-46c9-9265-f99c9c0cb097", "name": "network-vif-plugged", "status": "completed", "tag": "3245372e-9f1b-48f4-ab6a-f9035e26187c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:43.827191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:43.827984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:43.835431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.836412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.837761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.838807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.839511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.840175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.848317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.850798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.851425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.884616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] Creating event network-vif-plugged:3245372e-9f1b-48f4-ab6a-f9035e26187c for instance 9d093296-fa58-46c9-9265-f99c9c0cb097 on n-h2-854121-10 Aug 29 10:37:43.920332 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d22bf5e2-eebd-435b-a984-42366b5b22bf req-b107f202-e008-4578-98ce-1660700415f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102230 Aug 29 10:37:43.926089 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 460/877] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:43.931743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:43.933898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:43.940773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.941624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.942275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:43.943153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:43.943768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:43.944361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:44.347787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:44.356345 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff25aa69-7414-4e1d-b506-ef7bf84d2bc9 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.534630 Aug 29 10:37:44.356919 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 418/878] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:43 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:44.363434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:44.377481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3128852-500e-416b-ae8b-ae0154ad2cee tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.449901 Aug 29 10:37:44.386095 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 461/879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:43 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:44.394978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:44.400103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:44.402767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:44.406480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:44.413633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:44.416135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:44.416760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:44.417980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:44.420440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:44.421137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:44.421761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:44.422401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:44.427647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:44.428842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:44.430208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:44.430835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.154772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:45.166035 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b37974f8-4688-49f1-9ea4-59795fab1a6c tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.769306 Aug 29 10:37:45.176182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 462/880] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:44 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:45.195863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:45.204123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:45.205001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:45.211712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.212438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.213050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.213949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.214587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.214764 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36a9ea71-6e9b-441a-b585-85442457e45f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.841657 Aug 29 10:37:45.215484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.225779 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 419/881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:44 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:45.235288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd00af99-9080-4176-a40b-a93528ea9546 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-958479367", "metadata": {"": ""}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd00af99-9080-4176-a40b-a93528ea9546 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action HTTP/1.1 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 106 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-958479367", "metadata": {"": ""}}} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-958479367', 'metadata': {'': ''}}}} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'': ''} Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:45.248795 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:45.253227 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:45.255164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd00af99-9080-4176-a40b-a93528ea9546 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:45.257015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd00af99-9080-4176-a40b-a93528ea9546 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action" status: 400 len: 170 microversion: 2.1 time: 0.039073 Aug 29 10:37:45.261818 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 420/882] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Aug 29 10:37:45 2022] POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action => generated 170 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:37:45.268932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:45.269630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:45.279217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.279707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.280143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.280848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.281301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.281877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.602325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:45.608948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:45.619675 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cbcc25f-ac54-42e8-92ab-ecabc35d690b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.360982 Aug 29 10:37:45.625213 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a1f3684-7211-41d6-9f68-876e0651529f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.447009 Aug 29 10:37:45.632481 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 421/883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:45 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:45.632481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:45.632481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:45.633087 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 463/884] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:45 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:45.638305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:45.639954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:45.647806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.650393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.650842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.651901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.653606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.654042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.654467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.655286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.655861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.660468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:45.660978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:45.661418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:45.954110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:45.959330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.000049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30efb725-f250-489e-b8da-a095db8fdc52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.372874 Aug 29 10:37:46.008004 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eaf1c272-83ca-436d-beef-b6fce5083497 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1388 microversion: 2.1 time: 0.367567 Aug 29 10:37:46.008211 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 422/885] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:45 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.008306 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 464/886] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:45 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1388 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.031966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.032585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.039143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.039626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.040277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.041161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.041803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.042420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.203150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.204768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.211955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.212837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.213443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.215672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.216314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.216912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.242402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.261022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad3039b8-e79c-4a71-9a93-067d92b0deca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.233021 Aug 29 10:37:46.273257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 423/887] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.279965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.281538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.297016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.297537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.298008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.298782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.299247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.299677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.567910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.575209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.575386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3524b95b-408a-407c-952c-c97ccd378d42 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.378369 Aug 29 10:37:46.576331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 465/888] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:46.584988 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bcd570c2-9362-421a-a0fd-0d3a337328a4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.317073 Aug 29 10:37:46.586263 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 424/889] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.598179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89c06d55-4bd3-4a3f-b523-5cea11684e01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1801833571", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89c06d55-4bd3-4a3f-b523-5cea11684e01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action HTTP/1.1 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 619 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1801833571", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1801833571', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:37:46.603325 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:37:46.606066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:46.610589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89c06d55-4bd3-4a3f-b523-5cea11684e01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:46.611913 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89c06d55-4bd3-4a3f-b523-5cea11684e01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action" status: 400 len: 938 microversion: 2.1 time: 0.028412 Aug 29 10:37:46.612953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 466/890] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Aug 29 10:37:46 2022] POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action => generated 938 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:37:46.622299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.623687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.629897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.630391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.630824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.631524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.632004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.632426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.648152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.648760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.659416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.660211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.660817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.662357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.663083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.665290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.919189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.932005 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b2f01540-0244-4c17-b240-c53fcc50bec0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.314761 Aug 29 10:37:46.938407 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 425/891] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.956872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.957948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:46.963181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:46.974338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39f75258-dd0a-4dd0-bbe4-88b9cb8181c5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.329674 Aug 29 10:37:46.981111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 467/892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:46.988336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.989169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.989934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.993254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:46.994082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:46.994765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:46.997369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:46.998614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.007366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.010265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.010980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.013565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.014227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.014838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.315320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:47.318000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:47.324570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:47.327084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-653b3e3b-4944-4bd5-9ee8-9bd09b5f06cc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.343349 Aug 29 10:37:47.327671 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 468/893] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:47.332626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:47.333231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.341314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.341987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.342448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.343147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.343777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.344203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.352340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6b7ecb46-36e8-4670-9251-0504728ae17c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.411705 Aug 29 10:37:47.353852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 426/894] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:46 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:47.383608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:47.384553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.392143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.392943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.393564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.394449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.395107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.395685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.626108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:47.634933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-540c8ea2-b252-4bf4-a0f3-8f17bffb4b4e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1588 microversion: 2.1 time: 0.305994 Aug 29 10:37:47.635627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 469/895] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1588 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:47.641470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8e213b9-8d35-44e9-bd1a-1c8097b75963 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:47.641960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8e213b9-8d35-44e9-bd1a-1c8097b75963 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action HTTP/1.1 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 285 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:47.646161 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8e213b9-8d35-44e9-bd1a-1c8097b75963 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:47.650030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8e213b9-8d35-44e9-bd1a-1c8097b75963 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action" status: 400 len: 619 microversion: 2.1 time: 0.011444 Aug 29 10:37:47.653203 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 470/896] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Aug 29 10:37:47 2022] POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:37:47.658672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:47.659295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.665828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65e96e0d-0228-4d72-b28a-fb5e9317c910 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 2345 microversion: 2.25 time: 0.302689 Aug 29 10:37:47.666765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 427/897] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 2345 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:37:47.666902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.667351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.668474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.669301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.670206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.670649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.696565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:47.697641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.705393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.706014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.706594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.707562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.708086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.708575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.922780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:47.931232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12c4fcad-aa71-4eeb-9579-3c5dfb1ac854 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.276820 Aug 29 10:37:47.932386 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 471/898] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:47.937160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:47.937733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:47.944592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.945469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.945665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.946468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:47.947476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:47.947979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:47.974334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:47.983370 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a417dcb-5614-4eaf-bcbd-1d309494c00d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1503 microversion: 2.1 time: 0.315516 Aug 29 10:37:48.004804 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 428/899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:48.004804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.004804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.009478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.010006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.010472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.011781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.012341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.012908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.084317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb773b98-a6c6-4c70-bf07-697ebc1c13aa tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150440 Aug 29 10:37:48.084937 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 472/900] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:48.096523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.107628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.108128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.108575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.109318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.109808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.110241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.146096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17146b00-e2ea-4d83-bdba-fa3158d02f45 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.060059 Aug 29 10:37:48.147135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 473/901] 10.222.0.47 () {60 vars in 1217 bytes} [Mon Aug 29 10:37:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:37:48.152554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.153228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.161880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.162444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.162891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.163632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.164096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.164574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.358476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:48.364212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:48.376983 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a9ae877-3582-4c4f-bf92-7423959ed09e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.381403 Aug 29 10:37:48.378202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 429/902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:47 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:48.387967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:48.393352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.394322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.399018 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e6a626e-51f4-440c-a4c2-f8e6fc2629f0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.248395 Aug 29 10:37:48.402408 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 474/903] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:48 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:48.412719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.413644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.424064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.424977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.425866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.426775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.427247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.427674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.427799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.428231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.428642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.428939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.429398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.429851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.716012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:48.729087 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96b0ab43-e62b-47c4-a59d-4e570c71d984 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.325161 Aug 29 10:37:48.731900 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 475/904] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:48 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:48.751805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-92436852"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:48.754734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.767934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.768450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.768885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.769601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.770095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.770521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.801051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:48.809387 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8215d3e1-2643-4f28-9be9-702f60f19bf4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.428715 Aug 29 10:37:48.842702 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 430/905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:48 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:48.953600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:48.954427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:48.961989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.962486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.962926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:48.963636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:48.965787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:48.965787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.299065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-deb3e237-19bf-407c-bc34-0ee1039f522a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action" status: 202 len: 0 microversion: 2.1 time: 0.551497 Aug 29 10:37:49.299724 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 476/906] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:48 2022] POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 10:37:49.302731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:49.315920 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68ffe3a3-1a69-40c5-adc3-e57e76794557 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1473 microversion: 2.1 time: 0.366642 Aug 29 10:37:49.317132 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 431/907] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:48 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:49.322964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-895578941"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:49.326627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:49.333530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.334792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.335760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.336469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.337382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.340477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.349469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:49.352811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:49.371546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.374709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.375397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.377017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.378722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.381183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.440266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Cannot 'createImage' instance 7e2e6676-1451-4d4d-88f2-3500238949f4 while it is in task_state image_snapshot_pending Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action HTTP/1.1 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 84 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-895578941"}} Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'createImage' instance 7e2e6676-1451-4d4d-88f2-3500238949f4 while it is in task_state image_snapshot_pending Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-895578941'}}} Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:37:49.441880 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 7e2e6676-1451-4d4d-88f2-3500238949f4 while it is in task_state image_snapshot_pending Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 7e2e6676-1451-4d4d-88f2-3500238949f4 while it is in task_state image_snapshot_pending Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 409 to user: Cannot 'createImage' instance 7e2e6676-1451-4d4d-88f2-3500238949f4 while it is in task_state image_snapshot_pending {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:37:49.445784 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b76a11d-b55e-40e9-af1d-bf7ccd6d7f94 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action" status: 409 len: 167 microversion: 2.1 time: 0.124885 Aug 29 10:37:49.452216 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 432/908] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:49 2022] POST /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4/action => generated 167 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:37:49.468716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:49.469588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:49.486913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.490296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.493042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.494070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.499386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.500219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.676139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:49.707138 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-efab07bd-8d96-441d-a87e-f1de09ea269a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1478 microversion: 2.1 time: 0.389959 Aug 29 10:37:49.710955 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 477/909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:49 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:49.720448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2db80872-063a-49ab-b307-087bcbf0ae71 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c7c94c10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:49.962702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:49.968473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2db80872-063a-49ab-b307-087bcbf0ae71 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/images/df41fb77-f06e-4027-8b18-f2c24c0b51fb" status: 204 len: 0 microversion: 2.1 time: 0.255934 Aug 29 10:37:49.969428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 478/910] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:49 2022] DELETE /compute/v2.1/images/df41fb77-f06e-4027-8b18-f2c24c0b51fb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:37:49.975284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-472761e6-1325-4ca6-8d95-97d39871db3c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '.version_select at 0x7f66c75ccc10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:49.975739 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1c8ae03-72bf-4039-bf8b-5f941ad69d14 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.518837 Aug 29 10:37:49.976448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 433/911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:49 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:49.982148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-472761e6-1325-4ca6-8d95-97d39871db3c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:49.982848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-472761e6-1325-4ca6-8d95-97d39871db3c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:49.983457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-472761e6-1325-4ca6-8d95-97d39871db3c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:49.990960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:49.992749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:49.997917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-472761e6-1325-4ca6-8d95-97d39871db3c tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1965 microversion: 2.1 time: 0.026824 Aug 29 10:37:49.999341 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 479/912] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:37:49 2022] GET /compute/v2.1/os-migrations => generated 1965 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:50.005270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d093296-fa58-46c9-9265-f99c9c0cb097", "tag": "3245372e-9f1b-48f4-ab6a-f9035e26187c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:50.017988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.018682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.019518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.030482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.045425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.045922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.046687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.051984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.052544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.058795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] Creating event network-changed:3245372e-9f1b-48f4-ab6a-f9035e26187c for instance 9d093296-fa58-46c9-9265-f99c9c0cb097 on n-h2-854121-10 Aug 29 10:37:50.066237 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-206870e5-660d-4750-a8e0-cf8f308db3d3 req-d1b7d5bd-5c8e-47f7-85f9-a7669e4792ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065090 Aug 29 10:37:50.067215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 480/913] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:50.073309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:50.074390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:50.094635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.095417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.095807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.096778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.097297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.097762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.904395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:50.916628 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d69b91a-89ca-4eb6-a88f-697dfdfce07f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1588 microversion: 2.1 time: 0.937668 Aug 29 10:37:50.922321 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 434/914] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:49 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1588 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:50.927129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:50.930407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:50.940509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:50.942883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.944716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.946309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:50.947224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:50.948976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:50.949576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.002390 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5afbd07a-2291-45f6-bcaf-25ebef6434e4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.933795 Aug 29 10:37:51.002986 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 481/915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:50 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:51.019552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:51.020970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:51.029789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.030283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.030721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.031419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.031876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.033137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.298844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:51.326914 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bc5a7347-66c3-4adc-9200-5e26021383ac tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1540 microversion: 2.1 time: 0.403285 Aug 29 10:37:51.327702 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 435/916] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:50 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1540 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:51.351020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:51.351906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:51.367140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.369360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.375727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.378067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.379787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.383405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.587043 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e30de7f8-5157-4fef-b3dd-7b079d5216bb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1631 microversion: 2.1 time: 0.576540 Aug 29 10:37:51.602578 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 482/917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:51 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1631 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:51.610955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:51.614232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:51.625266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.625780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.626221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.626928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:51.627382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:51.627815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:51.857218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:51.866962 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1738b0d3-1152-4a79-bb23-69d46821b0f4 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1479 microversion: 2.1 time: 0.538397 Aug 29 10:37:51.883091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 436/918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:51 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1479 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:51.891677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8b69f9d-3978-4b97-970c-d3ab5dfc568f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: .version_select at 0x7f66c735adc0>, body: {"keypair": {"name": "tempest-keypair-281157705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwuwj9vnS8D1K/tMCpuv1i00Hd1c4JBxccbHFwIDNxt1GtYOyJfjyjL656qd5AnZ7HZQkt4pfkLgyEjwVNlxAWAQwZ1fjeXuILlVcXQ2TINybG7c/q2tZKopfCIPnYndQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:51.910926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b8b69f9d-3978-4b97-970c-d3ab5dfc568f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for project af9408db02324de389c1364747169f4e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:51.916803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b8b69f9d-3978-4b97-970c-d3ab5dfc568f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for user 30e7715efc824e0d9dc68fc5eb4b398b and project af9408db02324de389c1364747169f4e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:51.946216 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8b69f9d-3978-4b97-970c-d3ab5dfc568f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061444 Aug 29 10:37:51.954311 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 437/919] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:37:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:51.991424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:52.002874 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02d728a9-2f43-4530-abb5-dd909f9ee2b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.398760 Aug 29 10:37:52.003738 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 483/920] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:51 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:52.023812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:52.024469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:52.032891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.033400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.033886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.034612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.035213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.035704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.196896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:52.208931 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9a08654-740b-4948-b6d9-e990f42a4be3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.189309 Aug 29 10:37:52.223054 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 438/921] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:52 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:52.351017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:52.352009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:52.360443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.361102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.361637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.363836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.364554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.365219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.542989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:52.550451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6b83881-75b1-41e1-8a20-1b9763b45a44", "device": "/dev/xvdb"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:52.553310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:52.554481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-158bac6d-ef76-475d-960a-efb7914af01a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1535 microversion: 2.1 time: 0.208101 Aug 29 10:37:52.560157 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 484/922] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:52 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1535 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:52.563733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.564433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.565310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.566045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.566686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.567442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.899753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:52.900664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:52.910820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.911631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.912232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:52.913125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:52.913831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:52.914581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.064950 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75e62cf9-d283-4645-9b76-f0fa14304daa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.518953 Aug 29 10:37:53.066187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 439/923] 10.222.0.47 () {62 vars in 1364 bytes} [Mon Aug 29 10:37:52 2022] POST /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 194 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:37:53.103417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:53.104144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:53.111674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.112397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.113027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.113956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.114556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.117437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.173293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:53.187994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-387f70a0-3f72-4d32-8cdf-35575690e850 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1479 microversion: 2.1 time: 0.300328 Aug 29 10:37:53.188893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 485/924] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:52 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1479 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:53.235521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:53.236228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:53.262214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.262737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.263187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.265775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.266606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.267229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.404157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:53.457207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e875f28-df76-4488-92ae-7d6583c7be86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.388795 Aug 29 10:37:53.458226 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 440/925] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:53 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:53.617601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:53.619025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:53.629059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.630415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.631652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.632872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:53.633852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:53.634601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:53.788302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:53.808843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b6eff4a-6f64-48e9-805a-fe27cc86d8d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.578123 Aug 29 10:37:53.812050 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 486/926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:53 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:54.175762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-799910717", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a0ef28b9-57a1-4ef0-9645-ec05cf810a01"}], "security_groups": [{"name": "tempest-securitygroup--1124011628"}], "key_name": "tempest-keypair-281157705", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:54.268826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:54.277934 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b0e932d-c762-4b18-b73a-ae3b4e075834 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1522 microversion: 2.1 time: 0.702253 Aug 29 10:37:54.292090 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 441/927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:53 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:54.302117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:54.303103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:54.310046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.310962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.311766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.312630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.313241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.313882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.537040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:54.547902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-98cb9e60-da23-456c-ab97-d50ac93e6209 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1479 microversion: 2.1 time: 0.249734 Aug 29 10:37:54.548714 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 442/928] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:54 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1479 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:54.565740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:54.566747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:54.573747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.575150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.575803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.576700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.577339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.577976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.582639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] validate_networks() for [('a0ef28b9-57a1-4ef0-9645-ec05cf810a01', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:37:54.615878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:37:54.739742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db22e254-af5c-4323-9f06-372c519a7af1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 204 len: 0 microversion: 2.1 time: 0.187352 Aug 29 10:37:54.742389 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 443/929] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:37:54 2022] DELETE /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:37:54.755433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:54.757666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:54.764798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.765675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.766242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.767047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:54.767670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:54.768282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:54.797682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:55.113597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:55.121758 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c3294d7a-c974-4cb6-8f0e-1c120eb49fbc tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.376718 Aug 29 10:37:55.124935 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 444/930] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:54 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:55.141367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:55.142028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:55.150193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.150712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.151142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.152575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.153036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.153468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.427151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:55.437348 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15875a8c-1318-48ac-8efd-36942d0458c1 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1528 microversion: 2.1 time: 0.311006 Aug 29 10:37:55.455343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:37:55.456367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:37:55.457266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:37:55.457811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:37:55.459371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:37:55.461598 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 445/931] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:55 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1528 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:55.468800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:55.477079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:55.485068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.485809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.486890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.487394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.488095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.488235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.489180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.490500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.491367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.493020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.498375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.501947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.551275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:37:55.559812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:55.561821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for user 30e7715efc824e0d9dc68fc5eb4b398b and project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:37:55.587520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:37:55.598081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:37:55.678423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82e8b432-9cab-4466-ab13-ea35d17a5013 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.504921 Aug 29 10:37:55.682131 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 487/932] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:37:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:37:55.688001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:55.695352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:55.695984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:55.699445 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eee884eb-45be-47a9-b477-becc332f5d86 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.236659 Aug 29 10:37:55.712922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 446/933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:55 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:55.712922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-360a0a05-4ebd-4c1e-80db-14f80aaed1af tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:55.712922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-360a0a05-4ebd-4c1e-80db-14f80aaed1af tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:55.721117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.721781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.724221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.725180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:55.726481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:55.726980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:55.822798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-360a0a05-4ebd-4c1e-80db-14f80aaed1af tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:55.831291 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-360a0a05-4ebd-4c1e-80db-14f80aaed1af tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1233 microversion: 2.1 time: 0.129653 Aug 29 10:37:55.834487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 447/934] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:55 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1233 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:56.005256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:56.019003 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a4b3a79-0cd5-492b-8789-8fd704441b13 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1479 microversion: 2.1 time: 0.332899 Aug 29 10:37:56.030007 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 488/935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:55 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1479 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:56.110385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "name": "network-vif-plugged", "status": "completed", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:56.145466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:56.145948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:56.151006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.151723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.152270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.157196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.157724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.158263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.158877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.159371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.159792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.210483 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] Creating event network-vif-plugged:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:37:56.230913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:56.239990 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b5dc7707-9082-4e31-9b32-2833c4377753 req-81a65ef0-6ea8-49c8-a286-6546ee74f892 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120400 Aug 29 10:37:56.240232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 448/936] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:56.461091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:56.461825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:56.477594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.478117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.478553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.479263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.480940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.481379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.560601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:56.569282 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6d25556-da6c-4958-a10e-75b7712993a9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.427656 Aug 29 10:37:56.574161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 489/937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:56 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:56.723138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:56.735702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:56.765756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.766283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.766741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:56.767483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:56.768130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:56.768749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.017803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:57.032479 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f65dc05-fd09-4036-a12d-9c9c016f5a93 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1528 microversion: 2.1 time: 0.569814 Aug 29 10:37:57.033305 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 449/938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:56 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1528 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:57.040131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:57.041015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:57.056687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.058095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.058846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.060011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.060631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.064487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.110142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:57.118879 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e22f25ba-cb53-486c-9752-8089a128aa0e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.402087 Aug 29 10:37:57.134436 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 490/939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:56 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:37:57.144465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:57.147989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:57.159368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.165929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.166532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.168012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.168602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.169140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.241674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:57.271386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e839efbb-90e6-4018-ad9d-6ffb3371851f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1285 microversion: 2.1 time: 0.235652 Aug 29 10:37:57.274112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 450/940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:57 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:57.417575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:57.426253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee5b514a-0c34-4338-9d5e-80f1c8c9dc2b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1479 microversion: 2.1 time: 0.289533 Aug 29 10:37:57.433075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 491/941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:57 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1479 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:57.571299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2e6676-1451-4d4d-88f2-3500238949f4", "name": "network-vif-deleted", "tag": "00e19c65-a267-438e-8a26-ff2f7827f601"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:57.594956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:57.595930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:57.611020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.611522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.611959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.612669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.613125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.613548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.616565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:57.617134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:57.617565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:57.685372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] Creating event network-vif-deleted:00e19c65-a267-438e-8a26-ff2f7827f601 for instance 7e2e6676-1451-4d4d-88f2-3500238949f4 on n-h2-854121-10 Aug 29 10:37:57.708271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fcc0788c-8beb-4c37-9b6a-4266516b6fe6 req-5c51ab43-1696-486f-8bdc-a08563397a7d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143924 Aug 29 10:37:57.723903 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 451/942] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:37:58.059810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:58.061079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:58.073836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.074570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.075796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.078878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.079555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.080161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.175362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.180448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.181099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.181742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lazy-loading 'fault' on Instance uuid 7e2e6676-1451-4d4d-88f2-3500238949f4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:37:58.381678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:58.390183 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a2bab60-6f33-411e-983b-1dc49e77cdbd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.799568 Aug 29 10:37:58.396468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 492/943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:57 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:58.401779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:58.407019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:58.426718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.427147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.427588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.428304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.428766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.429199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.446886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:58.478722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d3e986b-fb96-4d3d-a646-8ce875650d76 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1315 microversion: 2.1 time: 0.422470 Aug 29 10:37:58.486059 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 452/944] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:58 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:58.492328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:58.494066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:58.506194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.507342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.509451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.510424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.511222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.511892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.666447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:58.678631 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fee59a95-5a5b-42d3-ba7d-90652bec11cd tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1291 microversion: 2.1 time: 0.188499 Aug 29 10:37:58.696840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 453/945] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:58 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1291 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:58.705090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:58.711777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:58.718985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:37:58.723794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.724535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.725227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.726225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:58.727546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:58.729405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:58.938952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:58.971172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52beb91f-219f-4029-b0bf-c410ccfc957f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.567294 Aug 29 10:37:58.996995 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 493/946] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:58 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:59.416408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:59.417582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:59.425050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.425863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.426485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.427372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.427996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.428586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.647196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:59.658828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e31ed22-627b-4de0-be90-21aac589ae2e tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1464 microversion: 2.1 time: 0.960525 Aug 29 10:37:59.664495 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 454/947] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:58 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1464 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:59.678139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:37:59.678995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:59.690635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.692557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.693069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.696057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.696724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.699978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.774143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.774544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.774986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.778767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lazy-loading 'fault' on Instance uuid 7e2e6676-1451-4d4d-88f2-3500238949f4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:37:59.946091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:59.954604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9c3b844-8a1a-4ab5-9636-faa943b87cca tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 200 len: 1315 microversion: 2.1 time: 0.288778 Aug 29 10:37:59.965263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:37:59.966259 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 455/948] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:59 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:37:59.975402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:37:59.978089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:37:59.988506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.989355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.990326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.991273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:37:59.991947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:37:59.992608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:37:59.992920 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a85a61a4-6517-49c9-930c-a54f47609104 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.580309 Aug 29 10:37:59.993842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 494/949] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:59 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:00.004225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:00.010797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.024996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.025341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.030055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.035393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.036104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.036714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.164105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb26a801-126a-4c8d-9654-977df25f906d tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.196127 Aug 29 10:38:00.165811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 456/950] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:37:59 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:00.172982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:00.174335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.181165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.182392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.183591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.185507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.186332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.187307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.200035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:00.221689 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67af5a21-a661-4be4-94dd-e4b2acc156ce tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1291 microversion: 2.1 time: 0.226739 Aug 29 10:38:00.227069 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 495/951] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:37:59 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1291 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:00.234439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:00.235405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.248141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.248644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.251881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.254642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.255140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.256320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.304377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.305145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.305603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.306125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lazy-loading 'fault' on Instance uuid 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:00.582489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20681db3-c162-4a56-b7d9-e9b1d594c0c7 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1600 microversion: 2.1 time: 0.352235 Aug 29 10:38:00.595314 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 496/952] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:00 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1600 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:00.602674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:00.613058 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7b57eac-bebb-47d5-a34b-886a821d177e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.445520 Aug 29 10:38:00.615577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:00.618520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.620472 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 457/953] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:00 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:00.628084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.629065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.629871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.631618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.632287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.632874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.830832 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a34cd1e6-72d6-4fea-a85b-2739d10e5983 tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.220920 Aug 29 10:38:00.833863 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 497/954] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:00 2022] POST /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:00.842874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:00.843680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.868160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.868825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.869370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.871341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.871924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.872478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.986463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:00.987083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:00.993857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.994354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.995365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:00.996272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:00.996853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:00.997251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.048801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 HTTP/1.1 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4'} Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:01.050738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:01.055800 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f4b306b-11fe-44c3-a17a-cd9b1c7b2700 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 404 len: 111 microversion: 2.1 time: 0.069704 Aug 29 10:38:01.059595 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 498/955] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:00 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:01.064706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:01.065524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:01.071995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.072499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.073021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.073691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.074230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.074595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.294885 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7c578e4-07bc-4e28-8690-2ec9aac7c64a tempest-ServersAdminTestJSON-915857495 tempest-ServersAdminTestJSON-915857495-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1617 microversion: 2.1 time: 0.457699 Aug 29 10:38:01.298044 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 458/956] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:00 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1617 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:01.304686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad1a68e7-cdfe-42b5-9b2c-661414a19cf4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'create', calling method: .version_select at 0x7f66c70020d0>, body: {"keypair": {"name": "tempest-keypair-1963952526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeli5kKyA23MBN1eWaS8VtfbDuvakKqURZg0xWaGddHuVQaPetmsEvI2cKgK14ZYx7GaP/B80OXIAsE12IfJCroTLFwUgA+DJcfCymYtAlVTGxyy2FzF1HnzbyO6gGSSg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:01.326496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ad1a68e7-cdfe-42b5-9b2c-661414a19cf4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for project 881af47bf44a47a4b8161cd378e55839. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:01.332234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ad1a68e7-cdfe-42b5-9b2c-661414a19cf4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for user 8b5f92e4798240c3a3c95041dde29e60 and project 881af47bf44a47a4b8161cd378e55839. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:01.362673 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad1a68e7-cdfe-42b5-9b2c-661414a19cf4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063265 Aug 29 10:38:01.366104 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 459/957] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:38:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:01.383593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:01.384213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:01.399761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.400509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.405452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.406727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.407909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.409011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.435064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:01.453596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3523cbac-f56c-4954-9100-9c3114a2509f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.392790 Aug 29 10:38:01.462508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 499/958] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:01 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:01.468550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:01.479691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:01.499505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.500252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.502275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.502906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.506327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.506955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.547304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:38:01.657241 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d7d433e-2f8f-4661-ac7d-19fca22871a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 204 len: 0 microversion: 2.1 time: 0.193090 Aug 29 10:38:01.658863 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 500/959] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:01 2022] DELETE /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:01.669452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:01.672339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:01.690749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.692714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.693331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.697425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.698629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.699075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.852235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:01.860295 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e69f508e-63b3-440f-a454-627ba5c13b29 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.492658 Aug 29 10:38:01.860877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 460/960] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:01 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:01.884311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:01.885145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:01.903952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.904768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.905428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:01.907566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:01.908277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:01.908921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.118797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:02.129919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd0b303e-9229-4183-92bc-966df504a626 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.469517 Aug 29 10:38:02.131389 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 501/961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:01 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:02.302234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:02.310781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bcd07c70-ee15-4218-899a-dc881acd65a6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1468 microversion: 2.1 time: 0.431676 Aug 29 10:38:02.313580 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 461/962] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:01 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1468 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:02.447058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:02.461900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:02.462790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:02.463436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.478319 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] Creating event network-changed:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h2-854121-10 Aug 29 10:38:02.486303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ef41dccd-4c78-4385-9c28-1f7bf69a145e req-c3ac9121-6655-457d-8e8e-824138187a76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044771 Aug 29 10:38:02.487698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 502/963] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:02.487847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:02.488486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:02.497550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:02.498464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:02.499070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.500092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:02.500759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:02.501386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.542166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:02.749790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:02.758120 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d53c9611-9b14-4bec-b9d0-d110e1643067 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.274983 Aug 29 10:38:02.762153 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 462/964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:02 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:02.881136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:02.882494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:02.889979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:02.890927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:02.891653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.892689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:02.893399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:02.894089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:02.936736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:03.155567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:03.158014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:03.165394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:03.178664 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f6b67964-2b80-4a78-bd96-57a2517bab5f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.301798 Aug 29 10:38:03.181759 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 503/965] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:02 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:03.182739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.184777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.185528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:03.186654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.187399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.188051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:03.339330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:03.340103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:03.357576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.358528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.358528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:03.363366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.364483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.364966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:03.575024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:03.583904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3087def-f4eb-4173-8092-620ba383cd85 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.436637 Aug 29 10:38:03.586928 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 463/966] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:03 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:03.590602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-892698486", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:03.660103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:03.662350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] validate_networks() for [('5448ad7b-c0bc-4881-99bf-045f093f2719', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:38:03.677947 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4f3ab63-f228-49ac-bff4-2d7aeeae2086 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1468 microversion: 2.1 time: 0.346430 Aug 29 10:38:03.679248 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 504/967] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:03 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:03.789198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:03.790604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:03.806725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.809301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.810739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:03.812634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:03.819703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:03.819703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.134406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:04.148426 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3137e221-3810-4dcb-8114-107465bf83eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.365960 Aug 29 10:38:04.164049 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 505/968] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:03 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:04.210375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:04.211680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:04.218486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.219195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.219805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.220511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.221043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.221394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.647827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:04.648341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:04.650753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:04.652124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:04.652890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:04.664519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.665669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.666319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.667928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.668576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.669853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.672362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:04.681413 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0008e8d0-fb7c-4e16-b252-946fd036630e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.475324 Aug 29 10:38:04.697632 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 506/969] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:04 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:04.703771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1453d401-aa53-4b60-8369-7c02c38da691", "name": "network-vif-deleted", "tag": "371b8c35-ff2a-4824-8f4d-57d31fcbc18d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:04.714639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:04.716921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.717507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.718341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.721341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for user 8b5f92e4798240c3a3c95041dde29e60 and project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:04.735744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] Creating event network-vif-deleted:371b8c35-ff2a-4824-8f4d-57d31fcbc18d for instance 1453d401-aa53-4b60-8369-7c02c38da691 on n-h1-854121-10 Aug 29 10:38:04.742327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:38:04.744589 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f14b4a1d-ae6d-4c61-a786-63bf5b4cd229 req-dea20d79-287f-4cae-91b8-9db04ae8be57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042567 Aug 29 10:38:04.746610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:38:04.747612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 507/970] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:04.823091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7f16ac2-9143-47a9-a0a2-f4ea7427b2f7 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.236887 Aug 29 10:38:04.824512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 464/971] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:38:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:38:04.829542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:04.830237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:04.871440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.871956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.872413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.873138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:04.877839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:04.878297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:04.939713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8b0e57f-b6ed-4e4f-9072-bcf1fba58f93 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Action: 'create', calling method: .version_select at 0x7f66c6ef1b80>, body: {"keypair": {"name": "tempest-keypair-587756678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfHlsUFAmzlHW1i8TYD16h3MKKTp6yY1uAOpNbfd/+VrIGsQZMnL8T66EtJloMrpiYTBXtqxYdxpaw5q1ZGUKszNYt7b0pXTrEO2gykUiaC0LFxCfmZM2PMmsDEQ+FT8Q=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:04.966898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f8b0e57f-b6ed-4e4f-9072-bcf1fba58f93 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Getting quotas for project 0c22cf32e8b0433aabe8f224bb909f65. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:04.973552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f8b0e57f-b6ed-4e4f-9072-bcf1fba58f93 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Getting quotas for user 5c6b77799d1a489092731314c76af024 and project 0c22cf32e8b0433aabe8f224bb909f65. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:05.013070 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8b0e57f-b6ed-4e4f-9072-bcf1fba58f93 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263385 Aug 29 10:38:05.014642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 508/972] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:38:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:05.026574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:05.027573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:05.044005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.044780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.045638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.046421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.046994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.047618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.095198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.095800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.096315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.097006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lazy-loading 'fault' on Instance uuid 1453d401-aa53-4b60-8369-7c02c38da691 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:05.401609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:05.431230 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f62a468-627d-4e67-a7b7-45e5fae2de1d tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 200 len: 1302 microversion: 2.1 time: 0.413968 Aug 29 10:38:05.436815 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 509/973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:05 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 1302 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:05.466374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:05.468392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:05.513388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.518196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.521404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.522572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:05.526594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.528600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.529106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.531718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:05.534010 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b505efc6-5496-4fc3-9ab7-3834ce6ec3c1 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.708251 Aug 29 10:38:05.535284 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 465/974] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:04 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:05.540911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:05.542592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:05.549913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.550769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.551379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.552807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.553599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.554214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.670441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:05.684168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c8582da6-d305-46c7-b038-cec0252ad959 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1228 microversion: 2.1 time: 0.229603 Aug 29 10:38:05.686190 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 510/975] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:05 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:05.705592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:05.706245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:05.716527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.718325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.720259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.722270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:05.722915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:05.723380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:05.840982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:05.859852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12547036-8b85-4dd9-a0c4-44f15370465d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.323309 Aug 29 10:38:05.862246 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 466/976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:05 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:05.927939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:05.938749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b74be49-d722-4c28-96b2-7902b59eb9d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.237114 Aug 29 10:38:05.939423 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 511/977] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:05 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:06.458922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:06.459650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 1453d401-aa53-4b60-8369-7c02c38da691] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:06.467161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.467723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.468163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.468854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.469302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.469740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.483320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] HTTP exception thrown: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Request method failure captured: Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 HTTP/1.1 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaHBzzuVaVAFmlpK7MFhEPb4gnfFkfjdhHE6C2H3ZmmAlYMir5Y_SRHDKrt0O83xd2vA8HP4RRa1uHtX1GR1hHiqBfglqCG3WghGGgaqzGpIX2WNqevWWZNMIiqKsugbLsoYCr6EogX7MWj5OEeXSdyVooS-LZIBADpoujhWkZ5kO0 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_49a739367574418c86f7414199fd9729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/49a739367574418c86f7414199fd9729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a9dbd3b826964971aa24d942a5c16440 Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '1453d401-aa53-4b60-8369-7c02c38da691'} Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:06.484878 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Returning 404 to user: Instance 1453d401-aa53-4b60-8369-7c02c38da691 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4341c23-eead-4b75-83c0-8b89b109e4e3 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691" status: 404 len: 111 microversion: 2.1 time: 0.031573 Aug 29 10:38:06.492731 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 467/978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:06 2022] GET /compute/v2.1/servers/1453d401-aa53-4b60-8369-7c02c38da691 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:06.500299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:06.500798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:06.506981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.507563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.508192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.509097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.509582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.510786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.545449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:38:06.565218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:06.566129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:06.571987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.572469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.573096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.573896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.574352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.574780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.630450 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6a3215a-02d9-4ff1-8d09-b3911f40efa6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "DELETE /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 204 len: 0 microversion: 2.1 time: 0.134788 Aug 29 10:38:06.631144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 512/979] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:06 2022] DELETE /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:06.638890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1165988752", "imageRef": "46090ab9-2f19-44b9-8ff8-b4dfc36e4faa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7c5a55cd-d81c-49d1-9a76-11bee1e650fa"}], "security_groups": [{"name": "tempest-securitygroup--2042374833"}], "key_name": "tempest-keypair-587756678", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:06.856294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] validate_networks() for [('7c5a55cd-d81c-49d1-9a76-11bee1e650fa', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:38:06.869294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:06.877809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c53db263-31dd-4805-bae7-f17af170b058 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.316397 Aug 29 10:38:06.878377 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 468/980] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:06 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:06.882831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:06.883427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:06.890121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.890601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.891031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:06.891920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:06.892374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:06.892796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.065691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:07.074436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30cee69f-d91c-4763-943b-4eadbdb9b2df tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1470 microversion: 2.1 time: 0.194916 Aug 29 10:38:07.075020 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 469/981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:06 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:07.079847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:07.080650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:07.086888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.087362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.087793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.088617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.089063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.089482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.157683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:07.165336 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43369054-ab63-4c0d-9a1f-fa68c7f99687 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1284 microversion: 2.1 time: 0.089110 Aug 29 10:38:07.165926 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 470/982] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:07 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:07.170821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:07.171541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:07.177207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.177689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.178154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.178839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.179290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.179706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.394013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:07.399502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:07.399923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:07.400422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:07.400960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:07.401403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:07.401756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a59c752-8eb0-4188-aa0c-2eacb079a626 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.234350 Aug 29 10:38:07.402344 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 471/983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:07 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:07.406768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:07.407555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:07.410777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.411258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.411845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.412713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.413363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.413833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.414097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.414757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.415198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.415898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.416894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.417441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.432702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Getting quotas for project 0c22cf32e8b0433aabe8f224bb909f65. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:07.438063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Getting quotas for user 5c6b77799d1a489092731314c76af024 and project 0c22cf32e8b0433aabe8f224bb909f65. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:07.453184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:38:07.455624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46090ab9-2f19-44b9-8ff8-b4dfc36e4faa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:38:07.467951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:07.505176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-62326fa6-437e-4c5b-8127-f52882f4a37b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.872578 Aug 29 10:38:07.505857 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 513/984] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:38:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:38:07.518305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15af1c6f-2feb-4be5-9c36-141c0857d660 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:07.519122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15af1c6f-2feb-4be5-9c36-141c0857d660 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:07.594801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15af1c6f-2feb-4be5-9c36-141c0857d660 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:07.594976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:07.607626 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-71e2f753-7a84-43d3-b581-d507d3f3e643 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.203722 Aug 29 10:38:07.608043 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15af1c6f-2feb-4be5-9c36-141c0857d660 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1245 microversion: 2.1 time: 0.094267 Aug 29 10:38:07.609051 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 514/985] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:07 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:07.624529 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 472/986] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:07 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:07.688045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "name": "network-vif-plugged", "status": "completed", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:07.698547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.699238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.699845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.712432 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] Creating event network-vif-plugged:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h2-854121-10 Aug 29 10:38:07.718648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ac8561a0-a351-43f0-8146-8f1dfa47ac60 req-f475f2ff-daa4-4671-86b4-15c3166e9cc6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034576 Aug 29 10:38:07.719259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 515/987] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:07.900610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:07.901629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:07.910133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.911145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.912115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:07.913231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:07.913830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:07.914617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.056392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.064212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db1658ba-4db6-48c2-9af3-60a715f8ff53 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.169222 Aug 29 10:38:08.064716 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 473/988] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:07 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:08.096175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:08.096877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:08.103037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.103530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.105362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.106275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.106745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.107334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.188355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:08.189021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:08.195428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.195915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.196348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.197042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.197493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.199139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.261467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.269585 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08e75731-db77-4a32-9220-5bafe48b8c32 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1470 microversion: 2.1 time: 0.177613 Aug 29 10:38:08.270417 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 516/989] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:08 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:08.283089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.290838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-849608e7-2c5e-46c8-843b-2278e3b9a360 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1294 microversion: 2.1 time: 0.106343 Aug 29 10:38:08.291472 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 474/990] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:08 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:08.425385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:08.426112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:08.432692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.433286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.433729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.434421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.434869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.435293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.569810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.578164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e1873b33-ccda-447b-9e18-9f8a804b41bf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.156624 Aug 29 10:38:08.578665 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 517/991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:08 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:08.628235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:08.628847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:08.629196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:08.629842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:08.636236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.636376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.636726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.636856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.637161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.637279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.637886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.638085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:08.638342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.638545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:08.638764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.638973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:08.736752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.745725 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d03878cc-830b-4f58-b2e4-6eb9330b89e4 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1297 microversion: 2.1 time: 0.120045 Aug 29 10:38:08.746650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 518/992] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:08 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:08.804967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:08.813564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b142a0bc-97d3-4dbe-9931-466917f62276 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.189056 Aug 29 10:38:08.822137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 475/993] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:08 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:09.087231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:09.089975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:09.097455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.098050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.099085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.100304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.100843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.101610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.291274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:09.293145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:09.310957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.311596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.312191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.313388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.314096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.314717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.606067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:09.617331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c8fed430-30e1-4fa5-932f-d90f73ccca2a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.535158 Aug 29 10:38:09.622100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 519/994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:09 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:09.626936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:09.627544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:09.647275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.648025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.648618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.649489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.650270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.650915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.813225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:09.827981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d50a426-46a8-4d9c-808b-b430028f14f6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1470 microversion: 2.1 time: 0.540482 Aug 29 10:38:09.830310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 476/995] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:09 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:09.839556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:09.842971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:09.857987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.862394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.863090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.864357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.865326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.865972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.875835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:09.889308 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec6777c9-3a7d-4a24-8e77-0af7e2a1c861 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1282 microversion: 2.1 time: 0.266016 Aug 29 10:38:09.893135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 520/996] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:09 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:09.907482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:09.908110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:09.932350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.933077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.942256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:09.943064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:09.944412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:09.944883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:10.267361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:10.276536 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a108481d-4c77-4a8c-a267-e836e9ae884e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1303 microversion: 2.1 time: 0.381742 Aug 29 10:38:10.277145 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 521/997] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:09 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1303 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:10.287383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:10.287383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:10.293413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:10.294257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:10.294550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:10.295279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:10.295735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:10.296168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:10.325964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:10.454898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:10.464878 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d6dd1fad-b507-4984-83e9-a74038c5abd4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.633215 Aug 29 10:38:10.465654 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 477/998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:09 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:10.470545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:10.471234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:10.477565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:10.478179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:10.479266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:10.480227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:10.481057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:10.486357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.095281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:11.104862 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd7501ba-b9fa-4d16-a397-149ee5816e49 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1359 microversion: 2.1 time: 0.825921 Aug 29 10:38:11.105621 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 522/999] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:10 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1359 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:11.110146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:11.110979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:11.124106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.124712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.125490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.126089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.126553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.129989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.201578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:11.235997 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56227042-aae8-4698-872a-19be59efc28c tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 2423 microversion: 2.25 time: 0.769100 Aug 29 10:38:11.249736 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 478/1000] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:10 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 2423 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:11.249736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:11.249736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:11.250278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.250819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.251846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.252907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.253519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.254306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.613052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:11.621476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-394c7fc4-a370-4e70-a944-e36186afedd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.514763 Aug 29 10:38:11.622110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 523/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:11 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:11.630013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:11.640984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:11.658080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.658589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.659033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.659758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:11.660222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:11.660649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:11.937360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:11.956141 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2eb80954-fa4c-4d42-a9e5-e5f60de114e7 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 200 len: 1470 microversion: 2.1 time: 0.718044 Aug 29 10:38:11.959898 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 479/1002] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:11 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 1470 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:11.971219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": "auto"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:11.990948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:12.005434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.005976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.006425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:12.007154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.007622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.008078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:12.012798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:12.063459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'flavor' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:12.100677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Going to try to live migrate instance to n-h1-854121-10 {{(pid=128682) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:38:12.317153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:12.330698 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b528be90-a1b8-4f7a-865e-e34850e26b2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.702549 Aug 29 10:38:12.346323 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 524/1003] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:11 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:12.349736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:12.357769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:12.366250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.367569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.370485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:12.371736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.373941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.374448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:12.847418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:12.857611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df9e4a43-9918-41a2-a2fc-d8d20022e099 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.516808 Aug 29 10:38:12.862343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 525/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:12 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:12.878306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:12.879534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:12.888722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.890195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.891163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:12.892495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:12.893061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:12.893728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.153604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:13.171816 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2498b00c-24fe-4d8b-839e-7ec414366d02 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.301238 Aug 29 10:38:13.177790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 526/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:12 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:13.177790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fc53bd-6602-41c8-8583-bb797d0b556d", "name": "network-vif-deleted", "tag": "6fcd587d-a838-4e60-8dc0-19797f48f271"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:13.194344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.199082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.199549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.219528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] Creating event network-vif-deleted:6fcd587d-a838-4e60-8dc0-19797f48f271 for instance 76fc53bd-6602-41c8-8583-bb797d0b556d on n-h2-854121-10 Aug 29 10:38:13.225638 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f5e25e1e-b52a-4bfd-bb50-4deebbe32e1a req-f62c96c7-8db4-48a1-b514-f7077486bb46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051223 Aug 29 10:38:13.226707 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 527/1006] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:13.235423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:13.236244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:13.243829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.244171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.245064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.246762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.247556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.248364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.507828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:13.517880 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e658b338-9bd1-4612-b752-13b85f86c269 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1542 microversion: 2.1 time: 0.289390 Aug 29 10:38:13.518472 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 528/1007] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:13 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1542 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:13.523744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:13.524600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:13.531844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.532545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.533346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.534273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.534889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.535520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.774734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:13.793569 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56e1094f-b13b-462b-83e0-86426b5e6b3f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.273779 Aug 29 10:38:13.807320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 529/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:13 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:13.812883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:13.813730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 76fc53bd-6602-41c8-8583-bb797d0b556d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:13.825724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.826153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.826605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.827321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.827777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.828203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.844186 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] HTTP exception thrown: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Request method failure captured: Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d HTTP/1.1 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaHBzzuVaVAFmlpK7MFhEPb4gnfFkfjdhHE6C2H3ZmmAlYMir5Y_SRHDKrt0O83xd2vA8HP4RRa1uHtX1GR1hHiqBfglqCG3WghGGgaqzGpIX2WNqevWWZNMIiqKsugbLsoYCr6EogX7MWj5OEeXSdyVooS-LZIBADpoujhWkZ5kO0 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_49a739367574418c86f7414199fd9729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/49a739367574418c86f7414199fd9729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a9dbd3b826964971aa24d942a5c16440 Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '76fc53bd-6602-41c8-8583-bb797d0b556d'} Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:13.845882 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Returning 404 to user: Instance 76fc53bd-6602-41c8-8583-bb797d0b556d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a91fdb52-8b87-4580-81bf-a6f107121645 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d" status: 404 len: 111 microversion: 2.1 time: 0.038489 Aug 29 10:38:13.850219 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 530/1009] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:13 2022] GET /compute/v2.1/servers/76fc53bd-6602-41c8-8583-bb797d0b556d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:13.852500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:13.853029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:13.860436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.860923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.861364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:13.862101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:13.862564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:13.862990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.020640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:14.030076 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21d59a40-becb-4c37-afea-1b16690c3b01 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.181263 Aug 29 10:38:14.030656 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 531/1010] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:13 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:14.035382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.035871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.041683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.042196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.042633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.043329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.043784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.044208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.125648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-123a6d61-eb73-4eef-94ef-99f6b3ae469a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093916 Aug 29 10:38:14.126374 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 532/1011] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:38:14 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:14.131782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.132582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.141571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.142534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.143318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.144343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.145050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.145482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.172201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:38:14.270426 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21ff0ae8-d649-4925-9eed-0558e11ebe71 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 204 len: 0 microversion: 2.1 time: 0.142253 Aug 29 10:38:14.275075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 533/1012] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:14 2022] DELETE /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:14.281152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.282089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.289080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.290121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.290691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.292473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.292766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.293277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.463458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:14.472484 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8776b9e-0f21-4aeb-8aba-352e3c254cd3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.195501 Aug 29 10:38:14.481027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 534/1013] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:14 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:14.486256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.487021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.506746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.507422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.507963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.508785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.509339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.509986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.678760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:14.688619 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-880b0ea4-91e4-45a8-97bc-6ffb8f6c1543 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.214407 Aug 29 10:38:14.690343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 535/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:14 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:14.695200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.695982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.702388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:14.704886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.705403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.705892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.706608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.707064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.707491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.731622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:14.873626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:14.882353 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87c19dae-13fb-41c5-a714-9ac2befa114a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.190794 Aug 29 10:38:14.882950 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 536/1015] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:14 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:14.888211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:14.888830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:14.899036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.899528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.899969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:14.900728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:14.901191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:14.901969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.114414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:15.137952 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ba7ec7b-ea19-4ba3-bdd5-9c088f9d3ebd tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.245464 Aug 29 10:38:15.137952 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 537/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:14 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:15.137952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:15.137952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:15.151783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.152666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.153333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.154321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.154989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.155627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.334979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:15.339325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:15.344830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-14072977-c7e2-4e5b-b5b7-5867800170c9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.212281 Aug 29 10:38:15.345732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 538/1017] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:15 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:15.365609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3", "tag": "84882669-7bca-42c6-8a46-4a09e99c656b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:15.377106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.377549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.378050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.392291 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] Creating event network-changed:84882669-7bca-42c6-8a46-4a09e99c656b for instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 on n-h2-854121-10 Aug 29 10:38:15.397468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b55955a1-a515-41dd-8647-5a1124e4642b req-6b34030b-a16d-4ff6-ab1a-e72db02758d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037370 Aug 29 10:38:15.398442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 539/1018] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:15.497317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:15.498521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.515836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.802137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:15.811653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48c3126c-e94a-4724-b581-33d657720795 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.321288 Aug 29 10:38:15.813059 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 540/1019] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:15 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:15.817761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:15.827615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.828877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.829736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.852112 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] Creating event network-changed:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h2-854121-10 Aug 29 10:38:15.858533 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7211a53e-e349-426c-a48e-acda39d94399 req-121fa015-485c-4f00-97e6-bcde2898489c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043977 Aug 29 10:38:15.859488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 541/1020] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:15.866175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:15.867346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:15.875115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.875982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.876654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:15.877573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:15.878256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:15.878903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:16.296106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:16.308603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45fa9faa-39ce-4bdc-8e1a-e31564811783 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.447688 Aug 29 10:38:16.317626 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 542/1021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:15 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:16.334989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:16.336300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:16.347508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:16.348548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:16.349223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:16.350243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:16.350938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:16.352217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:16.653279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:16.663791 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e179cfbd-a20f-4ec3-a1b9-f6c1cb031e34 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.344651 Aug 29 10:38:16.664790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 543/1022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:16 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:16.671675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:16.672292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:16.687355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:16.687977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:16.688519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:16.689341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:16.689988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:16.690516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:16.969492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:16.977555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d5ecc965-2a19-4425-b9c6-81ac53a51199 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.311708 Aug 29 10:38:16.978229 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 544/1023] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:16 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:16.998416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:16.999043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:17.005238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.005774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.006210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.006993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.007456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.007890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.210632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:17.220168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-861be321-7546-4083-a024-faae163ff169 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.226352 Aug 29 10:38:17.223783 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 545/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:16 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:17.225497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:17.226225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:17.232567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.233156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.233683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.234594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.234956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.235453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.403467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:17.412188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-137c9913-1a62-44b0-bcd5-fd12f40156cf tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.190135 Aug 29 10:38:17.413009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 546/1025] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:17 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:17.417220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:17.417852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:17.423023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:17.425362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.426088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.426582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.427241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.427756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.428151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.603128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:17.609746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:17.628001 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca21c938-93d4-474a-93b2-b06e2b415f9a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.214200 Aug 29 10:38:17.633639 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 547/1026] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:17 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:17.690703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:17.691350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:17.698134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.698631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.699065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.699770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:17.700224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:17.700894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:17.850031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:17.858817 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-704277f3-8a24-4021-9063-5d60acc8ef98 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.172189 Aug 29 10:38:17.859421 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 548/1027] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:17 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:18.000053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:18.000788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:18.006944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.007501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.007941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.008633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.009087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.009510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.144450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:18.153239 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fd9fac7-799e-492d-a635-2f10bb3c4557 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.157544 Aug 29 10:38:18.153845 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 549/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:17 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:18.241005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:18.241569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:18.248108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.248595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.249032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.249744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.250203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.250628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.379357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:18.386928 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-022d75a6-7a34-4b04-a54d-73f72f965b22 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.150338 Aug 29 10:38:18.387527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 550/1029] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:18 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:18.432762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:18.433399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:18.439130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.439611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.440045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.440731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.441185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.441608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.567284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:18.575941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b854d0f4-dad3-4814-a133-3eb57c56854e tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.146839 Aug 29 10:38:18.576518 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 551/1030] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:18 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:18.648962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:18.649577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:18.656241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.656735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.657179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.657905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.658371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.658802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.841676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:18.849450 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53c0c0da-786b-427d-94d7-e4d79db9880f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.204418 Aug 29 10:38:18.850058 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 552/1031] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:18 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:18.879826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:18.880458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:18.887744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.888239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.888673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:18.889374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:18.889852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:18.890277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.366437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:19.375110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-997d9643-74cc-43e0-b891-86669f54f6b6 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.499104 Aug 29 10:38:19.375972 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 553/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:18 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:19.380238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:19.380837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:19.387541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.387541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.387891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.388590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.389044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.389461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.627130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:19.637823 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac198939-b8cd-4175-b3d9-c7a5fbaf6ded tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.260885 Aug 29 10:38:19.638566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 554/1033] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:19 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:19.643672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:19.644421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:19.651618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.652394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.653191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.654128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.654753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.655188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.865904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:19.879445 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-af7b9785-fa9a-48ff-97d4-a086ca8fe529 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.239488 Aug 29 10:38:19.888037 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 555/1034] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:19 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:19.888037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:19.889441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:19.902620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.904464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.904983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:19.905721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:19.906185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:19.906614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.037233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:20.040665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:20.046802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-34e0552f-f596-4be3-94c4-b5d679dae75c tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.165119 Aug 29 10:38:20.047369 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 556/1035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:19 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:20.051911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3", "name": "network-vif-plugged", "status": "completed", "tag": "84882669-7bca-42c6-8a46-4a09e99c656b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:20.061644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.062160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.062587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.073627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] Creating event network-vif-plugged:84882669-7bca-42c6-8a46-4a09e99c656b for instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 on n-h2-854121-10 Aug 29 10:38:20.078548 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-67b0714a-cb44-457e-a062-54c7185ae939 req-791b29d5-0e40-448d-a052-2e6de671b814 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030087 Aug 29 10:38:20.079176 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 557/1036] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:20.084388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4c3b17-121c-446e-a442-894299a85e46", "tag": "13c4e59c-35e5-4937-924f-506304ed75cd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:20.090143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:20.094516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.094995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.095417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.108052 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] Creating event network-changed:13c4e59c-35e5-4937-924f-506304ed75cd for instance 9c4c3b17-121c-446e-a442-894299a85e46 on n-h1-854121-10 Aug 29 10:38:20.112941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5a47bd4a-8b1a-4ea2-ba45-852a1689a7d8 req-3257132d-6317-4603-b5f5-dc841dc30717 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032426 Aug 29 10:38:20.113601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 558/1037] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:20.118684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:20.119968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:20.126107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.126587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.127018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.127762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.128153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.128616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.306022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:20.314732 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27009d1e-f3dd-47b2-a326-31daa591ddb7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.199899 Aug 29 10:38:20.315305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 559/1038] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:20 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:20.395583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:20.396103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:20.402624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.403104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.403543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.404322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.404776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.405201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.538092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:20.546007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7be81360-207f-4dac-be4e-939790120668 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.154461 Aug 29 10:38:20.546575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 560/1039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:20 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:20.660427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:20.660958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:20.668146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.668632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.669071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.669795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.670255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.670688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.798322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:20.805865 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f355465-1be0-4fa1-bcd0-deaa6057e371 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.149369 Aug 29 10:38:20.807117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 561/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:20 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:20.902085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:20.902716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:20.909015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.909501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.909972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:20.910706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:20.911108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:20.911529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.041825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:21.049376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5219810c-4d05-43da-96c7-115c2f7a12a9 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1324 microversion: 2.1 time: 0.151276 Aug 29 10:38:21.049981 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 562/1041] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:20 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:21.067469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:21.068103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:21.074133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.074619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.075055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.075747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.076205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.076635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.239022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:21.248880 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3929830e-d69f-4e99-b4a5-e1fc43f720fb tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.184844 Aug 29 10:38:21.249468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 563/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:21 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:21.335837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:21.336448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:21.343406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.343886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.344351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.345033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.345484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.345937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.479922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:21.487449 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ce8efff-009f-491e-838f-ef24ddffdee5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1477 microversion: 2.1 time: 0.155746 Aug 29 10:38:21.488016 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 564/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:21 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:21.567097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:21.567713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:21.573621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.574130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.574565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.575256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.575709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.576135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.708781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:21.718347 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84567c67-9151-4b52-9cd5-c4016097f57b tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1470 microversion: 2.1 time: 0.155236 Aug 29 10:38:21.718928 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 565/1044] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:21 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:21.827232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:21.827839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:21.834055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.834533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.834965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.835643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:21.836095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:21.836515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:21.974118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:21.986801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c78b0bd6-2f85-4592-8b06-620cbfcab206 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.162859 Aug 29 10:38:21.987720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 566/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:21 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:22.072013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:22.073101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:22.079668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.080214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.080944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.081352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.081830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.082450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.130983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:22.255915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:22.380358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:22.389694 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea391c41-b596-430f-811f-431dd33de937 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1521 microversion: 2.1 time: 0.322533 Aug 29 10:38:22.404932 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 567/1046] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:22 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:22.411661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:22.412674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:22.422643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.423289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.423910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.425657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.427222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.427926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.679722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9cdcd213-f79c-4c38-93af-fb5737901da7 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/action" status: 202 len: 0 microversion: 2.25 time: 10.718608 Aug 29 10:38:22.680926 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 480/1047] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:38:11 2022] POST /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/action => generated 0 bytes in 10720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:22.687400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:22.689829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:22.701421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.702258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.719161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.720306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.720990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.726128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.856216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:22.864714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-86d95cd9-8848-426c-9caa-7f54104f025f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.458124 Aug 29 10:38:22.865327 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 568/1048] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:22 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:22.874941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:22.876484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:22.885248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.886105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.887040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:22.887759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:22.888220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:22.888840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.057143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.064854 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c14b5bb-2aba-4a27-bb97-a8e78890fdc3 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1521 microversion: 2.1 time: 0.381578 Aug 29 10:38:23.065432 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 481/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:22 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:23.084678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.085282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.092052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.092533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.093007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.093725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.094167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.094586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.130337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.139328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c24c880-5ce6-46aa-a3b3-b5a7e3d03c6b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1476 microversion: 2.1 time: 0.272741 Aug 29 10:38:23.139911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 569/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:22 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:23.144721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.145505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.154439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.155367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.156237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.157792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.158816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.159423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.300507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.308679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12bbd5a3-70e8-4851-bc02-bf0ff0e89bed tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1428 microversion: 2.1 time: 0.167574 Aug 29 10:38:23.309274 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 570/1051] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1428 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:23.313723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe", "name": "network-vif-deleted", "tag": "b67e6e7b-a99b-44f3-a064-8f3eca247df4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:23.324261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.324742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.325175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.337191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] Creating event network-vif-deleted:b67e6e7b-a99b-44f3-a064-8f3eca247df4 for instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe on n-h1-854121-10 Aug 29 10:38:23.342606 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0436b754-dcd6-43d3-b476-e9fec957482e req-fe9e95d4-c02e-4aaf-9547-e42dde04f6ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Aug 29 10:38:23.343209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 571/1052] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:23.348247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.348949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.355278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.355771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.356219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.356924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.357392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.357852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.367738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.378047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.379484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.380759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6a0d247-0565-4364-ad6a-d08595a8e914 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.300333 Aug 29 10:38:23.381536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 482/1053] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:23.386981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-748161514"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:23.389392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.395558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.397245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.397928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.398834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.399463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.399896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.612914 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f9ba949d-afa0-4ad4-ac92-a054279c9db8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3/action" status: 202 len: 0 microversion: 2.1 time: 0.230124 Aug 29 10:38:23.613912 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 483/1054] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:23 2022] POST /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:38:23.620838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "name": "network-vif-unplugged", "status": "completed", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:23.629075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:23.630706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.631207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.631625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.637259 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4e80b52-edb8-4be6-88fc-6b2737c9a376 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1522 microversion: 2.1 time: 0.292883 Aug 29 10:38:23.650741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Creating event network-vif-unplugged:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h2-854121-10 Aug 29 10:38:23.651486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 572/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:23.658769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20cf73b6-a0ca-4ae5-a06c-7cb1a6724475 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c6e2f1f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.661398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] Instance a2a7afec-845f-46d0-b835-4235d35c15e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:38:23.674234 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1046c9eb-f095-4dfa-a21c-17781107e7fa req-f19013a0-6617-4daf-bc7c-f0b618c8cd97 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059005 Aug 29 10:38:23.674836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 484/1056] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:23.788077 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20cf73b6-a0ca-4ae5-a06c-7cb1a6724475 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae" status: 204 len: 0 microversion: 2.1 time: 0.135159 Aug 29 10:38:23.788654 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 573/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:23 2022] DELETE /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:23.798059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c383d15e-cd1e-462b-84da-a9550327724d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c6fca1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.821478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c383d15e-cd1e-462b-84da-a9550327724d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Image not found. Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c383d15e-cd1e-462b-84da-a9550327724d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae HTTP/1.1 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd01efa01-98b1-4436-af19-f91fa436d6ae'} Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d01efa01-98b1-4436-af19-f91fa436d6ae Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:38:23.824335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d01efa01-98b1-4436-af19-f91fa436d6ae could not be found. Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c383d15e-cd1e-462b-84da-a9550327724d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c383d15e-cd1e-462b-84da-a9550327724d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae" status: 404 len: 62 microversion: 2.1 time: 0.032077 Aug 29 10:38:23.829421 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 485/1058] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:38:23.839534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.840285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.846639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.847126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.847571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.848297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.848754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.849181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.887993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:23.888726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:23.895063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.895559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.896007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:23.896715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:23.897178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:23.897608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.160993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:24.169948 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a44fb067-1490-46b5-9c33-8b6b91c578ba tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1533 microversion: 2.1 time: 0.334544 Aug 29 10:38:24.170766 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 574/1059] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1533 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:24.216646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:24.224724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:24.225671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df308fdf-877f-460a-bb92-c51285b17fc1 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.342227 Aug 29 10:38:24.225841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.240041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.240585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 486/1060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:23 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:24.329605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:24.330261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:24.336959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.338153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.338622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.339313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.339772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.340200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.383037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.384250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.385735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.386360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lazy-loading 'fault' on Instance uuid 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:24.488416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9dbd3b826964971aa24d942a5c16440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a739367574418c86f7414199fd9729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:24.500774 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-081997c6-607f-4606-84cd-2e0a6f08236a tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 200 len: 1304 microversion: 2.1 time: 0.175014 Aug 29 10:38:24.501491 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 487/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:24 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:24.507636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:24.510658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:24.520199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.520829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.522370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.523155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.523615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.524215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.655292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:24.663473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e32abdb-9855-400d-a5bf-0adb8dab86b1 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1476 microversion: 2.1 time: 0.442957 Aug 29 10:38:24.664064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 575/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:24 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:24.669580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:24.670401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:24.676562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.677050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.677694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.678421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:24.678875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:24.679307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:24.699280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:25.098729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.107347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.108771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.109984 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-61cbf3e0-3a1f-4ab0-9985-3ac3358daef9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.607125 Aug 29 10:38:25.110537 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 488/1063] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:24 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:25.178507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.187691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60946cb1-7c52-4f1b-976e-ab28de791043 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1502 microversion: 2.1 time: 0.522606 Aug 29 10:38:25.201941 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 576/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:24 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1502 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.202139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.209668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.210561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.217099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.217686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.218226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.219003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.219542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.220068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.492892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.499887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.500830 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f88ca2f-274f-4920-9cfe-5e05debc8dcc tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1539 microversion: 2.1 time: 0.313238 Aug 29 10:38:25.501415 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 489/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:25.505984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.506623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.513797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.514288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.514727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.515419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.516126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.516633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.520882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84713b2b-7047-44b5-87bd-b9f826e9939a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1517 microversion: 2.1 time: 0.315554 Aug 29 10:38:25.521798 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 577/1066] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1517 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:25.541244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.541943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] [instance: 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.548921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.549417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.549881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.550599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.551059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.551555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.567189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] HTTP exception thrown: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Request method failure captured: Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe HTTP/1.1 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaHBzzuVaVAFmlpK7MFhEPb4gnfFkfjdhHE6C2H3ZmmAlYMir5Y_SRHDKrt0O83xd2vA8HP4RRa1uHtX1GR1hHiqBfglqCG3WghGGgaqzGpIX2WNqevWWZNMIiqKsugbLsoYCr6EogX7MWj5OEeXSdyVooS-LZIBADpoujhWkZ5kO0 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_49a739367574418c86f7414199fd9729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/49a739367574418c86f7414199fd9729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49a739367574418c86f7414199fd9729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 49a739367574418c86f7414199fd9729 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdminTestJSON-1802046124 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a9dbd3b826964971aa24d942a5c16440 Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdminTestJSON-1802046124-project Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe'} Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:25.568861 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] Returning 404 to user: Instance 9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:25.573149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9037780-068d-48f0-a8db-1448a6bdcb49 tempest-ServersAdminTestJSON-1802046124 tempest-ServersAdminTestJSON-1802046124-project] 10.222.0.47 "GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe" status: 404 len: 111 microversion: 2.1 time: 0.047187 Aug 29 10:38:25.574450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 578/1067] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/9ceb35d3-59e5-4ddd-b4b1-56afb3fdb7fe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:25.580234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:25.583622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.590177 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0/action HTTP/1.1 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 14 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: {"rescue": {}} Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0', 'body': {'rescue': {}}} Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.601855 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. Aug 29 10:38:25.607662 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:25.609786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 404 to user: Instance 8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:25.611407 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb0cea54-2877-4419-9d74-af81f6a8098c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0/action" status: 404 len: 111 microversion: 2.1 time: 0.035228 Aug 29 10:38:25.613158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 579/1068] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:25 2022] POST /compute/v2.1/servers/8dbb2e6c-d5f7-49b0-a1d0-063bd5b032a0/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:25.624936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:25.626367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.637569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.638103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.638617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.639413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.639942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.640386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.676524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.687721 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d30690d6-282e-480a-865c-40e22f6ab28f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.185199 Aug 29 10:38:25.688317 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 490/1069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:25.700696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.701486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.707569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.708326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.708767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.709474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.710146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.710890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.754325 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49cc559f-73e5-4842-882a-0ad8a0ccc8cc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.136127 Aug 29 10:38:25.756246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 580/1070] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:25 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:38:25.764621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:25.776344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.777179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.777747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.795565 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Creating event network-changed:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h2-854121-10 Aug 29 10:38:25.810053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] Instance a2a7afec-845f-46d0-b835-4235d35c15e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:38:25.847584 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8063388f-a02f-41c3-bdff-82bd790ec2fa req-43b4b77d-6ceb-4c16-9744-6cf92e3b75ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088511 Aug 29 10:38:25.849026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 581/1071] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:25.862925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:25.865192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:25.873039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.874733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.874733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.875229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:25.875790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:25.876557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:25.987676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:25.999954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-993b9200-b1d1-4470-b295-309c0ddf60ec tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1474 microversion: 2.1 time: 0.310601 Aug 29 10:38:26.000746 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 491/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:26.134260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:26.135970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:26.149149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.149682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.150436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.152548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.153248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.153895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.195151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:26.213526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd6fb683-a0c9-4767-a44c-5a006f35e5d7 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1522 microversion: 2.1 time: 0.362704 Aug 29 10:38:26.214152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 582/1073] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:25 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:26.447887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:26.459134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:26.461023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:26.465477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7be754f-2110-4ada-a2f5-99e7bc50835e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.333580 Aug 29 10:38:26.466788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 492/1074] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:26 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:26.524072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:26.524697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:26.539401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.539860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.540624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.542417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.543090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.543715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.708434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:26.712915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:26.725145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.727524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.728896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.730501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:26.732881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:26.734293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:26.811481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:26.819672 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2864754b-4e0e-4134-b7cf-34ff2a5716e2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1539 microversion: 2.1 time: 0.299390 Aug 29 10:38:26.822647 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 583/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:26 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1539 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:27.022146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:27.023100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.030767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.031505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.032107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.032982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.033792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.034379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.093879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.105564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84d6a030-278d-4dd7-b1bf-a7eab8ebd65a tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.400962 Aug 29 10:38:27.106799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 493/1076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:26 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:27.222978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.237234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:27.238052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.250420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.251092 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e85dc695-5a24-4e2c-8924-bec37564e804 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1474 microversion: 2.1 time: 0.232015 Aug 29 10:38:27.252366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.252922 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 584/1077] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:27 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:27.262376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.263234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.263766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.264266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.431089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.439345 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e32bffee-dc90-48b1-aac1-caa450be3229 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1502 microversion: 2.1 time: 0.208337 Aug 29 10:38:27.454312 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 494/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:27 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:27.461648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:27.465504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.472083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.472869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.473548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.474986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.475664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.476295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.492295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:27.492912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.503986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.504492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.504959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.514520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.515676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.516999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.522921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'flavor' on Instance uuid 3d50327c-ed07-477a-aec6-424b7178f0b4 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:27.539332 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Cannot 'rescue' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state paused Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action HTTP/1.1 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 14 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: {"rescue": {}} Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot 'rescue' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state paused Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3d50327c-ed07-477a-aec6-424b7178f0b4', 'body': {'rescue': {}}} Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 in vm_state paused. Cannot rescue while the instance is in this state. Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state paused Aug 29 10:38:27.542150 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state paused Aug 29 10:38:27.546478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:27.549114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 409 to user: Cannot 'rescue' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state paused {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:27.550283 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b9f8fdd-f83b-4501-ba98-480191e2b746 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action" status: 409 len: 144 microversion: 2.1 time: 0.092788 Aug 29 10:38:27.554658 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 585/1079] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:27 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action => generated 144 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:38:27.560945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:27.561811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.569578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.570378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.571064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.572580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.574129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.575478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.658993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff3c03f7-7e89-4d66-8520-1d30dd820308 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.102821 Aug 29 10:38:27.663310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 586/1080] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:27 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:27.669331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:27.670109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.677565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.678098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.678746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.679467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.680491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.680943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.937875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.961155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.964020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:27.965635 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5b96b3e-ac24-4a69-9f48-2d069dbfafcd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.477150 Aug 29 10:38:27.966909 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 495/1081] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:27 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:27.982410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:27.984420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:27.994621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.995424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.996042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:27.997353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:27.998127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:27.998722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.115336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:28.127362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7fed2df-a680-4a8b-97ff-67cf09a8513f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1509 microversion: 2.1 time: 0.462608 Aug 29 10:38:28.128259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 587/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:27 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:28.133248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.133899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.146698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.149226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.150368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.151236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.151731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.152292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.340326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:28.352691 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba9bbc29-c8a5-48b6-9ee2-e3a55382cd8f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1521 microversion: 2.1 time: 0.384502 Aug 29 10:38:28.354402 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 496/1083] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:27 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:28.358992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3", "name": "network-vif-plugged", "status": "completed", "tag": "84882669-7bca-42c6-8a46-4a09e99c656b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:28.381258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.381990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.391249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.396359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:28.410749 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] Creating event network-vif-plugged:84882669-7bca-42c6-8a46-4a09e99c656b for instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 on n-h2-854121-10 Aug 29 10:38:28.424077 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2c38a7e2-3ac0-4d60-b914-a4148f98b888 req-f79f3ea7-45a0-4a4d-b5d7-e1811707f67c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064589 Aug 29 10:38:28.426016 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 497/1084] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:28.435531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.436229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.454565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.455065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.455517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.456230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.456682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.462066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.480345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:28.495077 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fc8c2f0-059b-4d48-989e-967512ef798b tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.365539 Aug 29 10:38:28.497775 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 588/1085] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:28 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:28.516752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.517536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.526566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.527363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.528049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.529050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.529691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.530348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.590099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:38:28.687938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:28.701475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e4be384c-af94-4081-975a-916cf4afdd52 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1471 microversion: 2.1 time: 0.273945 Aug 29 10:38:28.717993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e06cb130-8716-46d4-8521-4cb01d73f900 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 204 len: 0 microversion: 2.1 time: 0.218520 Aug 29 10:38:28.719819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 589/1086] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:28 2022] DELETE /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:28.727714 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 498/1087] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:28 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:28.729882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.731076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.737603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.738338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.739280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.739995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.740472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.740905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.743995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:28.745123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.752598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.753468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.754211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.755193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.755866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.756514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.878576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9bc352b9-d1b9-43bf-96a5-5fe4b5a2e669 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2/action" status: 204 len: 0 microversion: 2.1 time: 0.146269 Aug 29 10:38:28.888697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 499/1088] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:28 2022] POST /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2/action => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:28.898402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.900638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:28.916777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:28.917177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.917858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.918496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.919441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:28.920047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:28.920627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:28.935163 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acaf17a4-ef24-48ba-b08b-c4b20b916d72 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1527 microversion: 2.1 time: 0.210981 Aug 29 10:38:28.935978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 590/1089] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:28 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1527 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:28.992466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:28.992942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:29.003063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.003558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.003995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.004703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.005158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.005581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.025414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:29.396616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.406593 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab99b076-05b2-4d98-966e-e3f66fde6813 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1471 microversion: 2.1 time: 0.513451 Aug 29 10:38:29.407218 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 500/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:28 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:29.412293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:29.413137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:29.421567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.422192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.422749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.423625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.424090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.424772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.451044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.465604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.468055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.469614 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ba69da9-5215-402c-a662-75344c383b32 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.481376 Aug 29 10:38:29.471057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 591/1091] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:28 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:29.519462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:29.523299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:29.530842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.531863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.532361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.533360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.533855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.534282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.835904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.845946 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42386718-7835-4690-8890-c4fb42c134e9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1517 microversion: 2.1 time: 0.437328 Aug 29 10:38:29.858544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 501/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:29 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1517 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:29.912930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:29.927581 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33df18a1-6755-45a9-9571-93efa5648cd5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.414708 Aug 29 10:38:29.928642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 592/1093] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:29 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:29.956378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:29.956993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:29.964910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.965888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.966506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:29.967395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:29.968008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:29.968593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:30.272090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:30.284656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24bf84f2-371b-4eb2-9fbe-289194f5153e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1527 microversion: 2.1 time: 0.330937 Aug 29 10:38:30.286102 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 502/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:29 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1527 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:30.428728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:30.429888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:30.443968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:30.444910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:30.446330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:30.449311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:30.451519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:30.452287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:30.495686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:30.497030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:30.550118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:30.550653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:30.556571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:30.557647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:30.558171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:30.558614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:31.391131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:31.403821 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-766655fc-eb55-4367-8690-a74872a15801 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1471 microversion: 2.1 time: 0.976399 Aug 29 10:38:31.419449 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 593/1095] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:30 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1471 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:31.424425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4c3b17-121c-446e-a442-894299a85e46", "name": "network-vif-plugged", "status": "completed", "tag": "13c4e59c-35e5-4937-924f-506304ed75cd"}, {"server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "name": "network-vif-plugged", "status": "completed", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:31.454306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:31.456072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:31.456944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:31.506084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Creating event network-vif-plugged:13c4e59c-35e5-4937-924f-506304ed75cd for instance 9c4c3b17-121c-446e-a442-894299a85e46 on n-h1-854121-10 Aug 29 10:38:31.506713 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] Creating event network-vif-plugged:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h2-854121-10 Aug 29 10:38:31.521447 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-948257a0-6874-40c9-996b-a4d3e5aed9a2 req-db3d3c59-3bf7-4eb6-a420-816af2d8d150 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100622 Aug 29 10:38:31.522486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 594/1096] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:31.537397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:31.538180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:31.553476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:31.554615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:31.555087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:31.556466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:31.561530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:31.562256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:31.647031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:31.672388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:31.679144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:31.682102 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7a088f4-5373-4af8-a11d-40b14a6b776d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 1.190808 Aug 29 10:38:31.683530 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 503/1097] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:30 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:31.699472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:31.700451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:31.714816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:31.721096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:31.722039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:31.723308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:31.723977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:31.724769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.451145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:32.468263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:32.473073 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae90cced-5745-4ba8-8cad-cfefb5c9731b tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1527 microversion: 2.1 time: 0.788172 Aug 29 10:38:32.485723 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 504/1098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:31 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1527 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:32.485723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:32.485723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:32.497116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77e28fd1-b46c-46ae-87b7-36a23099d9a2 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1371 microversion: 2.1 time: 0.973248 Aug 29 10:38:32.499012 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 595/1099] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:31 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1371 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:32.515638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.519296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.520160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.521671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:32.522388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.523533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:32.523981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.525822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.543773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.544278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.544718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.545431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.545925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.546370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.612249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:38:32.788442 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0d39506-9e87-4e81-88ca-662cb445264a tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 204 len: 0 microversion: 2.1 time: 0.311549 Aug 29 10:38:32.789824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 505/1100] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:32 2022] DELETE /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:38:32.799318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:32.802285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:32.818960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.819736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.820338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.821211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:32.822423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:32.823030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:32.991543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.000596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea353f04-c64f-42f0-8d7d-014a30c49604 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1463 microversion: 2.1 time: 0.499466 Aug 29 10:38:33.023336 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 596/1101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:32 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1463 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:33.041448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:33.046652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:33.078411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.079006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.079544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.080196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.080647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.086524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.324847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.337805 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a474333-72a8-4c72-9866-872039856903 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1713 microversion: 2.1 time: 0.310831 Aug 29 10:38:33.339045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 597/1102] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:33 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1713 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:33.346215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.366904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.367172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3", "name": "network-vif-deleted", "tag": "84882669-7bca-42c6-8a46-4a09e99c656b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:33.370425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.372549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9035231e-9ae5-4fa4-821d-ef914ca4d38c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.579330 Aug 29 10:38:33.373611 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 506/1103] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:32 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:33.380168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:33.391179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:33.391563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.392164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.394387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.409124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.410228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.410943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.412005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.412627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.413256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.422588 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] Creating event network-vif-deleted:84882669-7bca-42c6-8a46-4a09e99c656b for instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 on n-h2-854121-10 Aug 29 10:38:33.438674 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8ded3c46-341b-4405-83b6-99182b01aa42 req-1cf09feb-018c-49c5-8ae7-e0b6633b1cea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092372 Aug 29 10:38:33.440937 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 598/1104] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:33.456459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:33.458737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:33.474807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'flavor' on Instance uuid 3d50327c-ed07-477a-aec6-424b7178f0b4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:33.481400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.483094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.484370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.487028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.488819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.490698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.694233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88e60cd7-3acf-465e-9cf8-df861ea82c4a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action" status: 200 len: 32 microversion: 2.1 time: 0.318216 Aug 29 10:38:33.700308 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 507/1105] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:33 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:38:33.706875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:33.708263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:33.716942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.717896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.718597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.719600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.720301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.721302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.841981 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53bd0505-cdfc-4ebe-a6ad-4ff48fe1434d tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1616 microversion: 2.1 time: 0.397712 Aug 29 10:38:33.847797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 599/1106] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:33 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1616 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:33.876962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:33.881290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:33.892303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.892805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.893247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.901245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:33.901843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:33.902289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:33.923099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:33.937368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64370c7d-4a54-4f2a-84c8-c28f27285f2d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 200 len: 1485 microversion: 2.1 time: 0.233635 Aug 29 10:38:33.970127 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 508/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:33 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 1485 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:33.991815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3", "name": "network-vif-unplugged", "status": "completed", "tag": "84882669-7bca-42c6-8a46-4a09e99c656b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:34.003141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.003141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.003629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.018680 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] Creating event network-vif-unplugged:84882669-7bca-42c6-8a46-4a09e99c656b for instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 on n-h2-854121-10 Aug 29 10:38:34.027644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bfdc38b9-5cbe-4e6f-bc80-a3b344b79d87 req-d57b015e-4b73-4380-a97b-cd03d7f1a070 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053752 Aug 29 10:38:34.028637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 509/1108] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:34.043632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:34.044404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:34.058018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.071189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.071847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.074328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.076604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.077213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.135831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:34.237045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:34.249556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4ceb001-58a1-4f56-8d41-c3c7361ae47f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1556 microversion: 2.1 time: 0.387162 Aug 29 10:38:34.250676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 600/1109] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:33 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1556 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:34.258394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-662967c0-9d9a-44c8-ac1f-c9dc80113b04 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '.version_select at 0x7f66c6e2f5e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:34.265468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662967c0-9d9a-44c8-ac1f-c9dc80113b04 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.266235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662967c0-9d9a-44c8-ac1f-c9dc80113b04 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.267435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662967c0-9d9a-44c8-ac1f-c9dc80113b04 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.283379 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-662967c0-9d9a-44c8-ac1f-c9dc80113b04 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 2353 microversion: 2.1 time: 0.031638 Aug 29 10:38:34.291085 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 601/1110] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:38:34 2022] GET /compute/v2.1/os-migrations => generated 2353 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:34.302425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:34.303276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:34.312035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.312745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.313416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.314364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.314973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.315546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.542268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:34.564843 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2aa3612c-2562-4a9c-91eb-135172a6f84f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.532906 Aug 29 10:38:34.581599 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 510/1111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:34 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:34.596465 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5c010046-9411-4e4a-b623-b0eb1271f9d7 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.304106 Aug 29 10:38:34.597987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 602/1112] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:38:34 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-interface => generated 284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:34.605220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:34.605885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:34.612491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:34.613311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.614914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.615158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.615930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:34.616044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.616465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.616889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.635359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.642208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.642794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:34.643570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:34.644190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:34.644608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:35.370444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:35.383889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:35.385972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:35.387392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b05edffa-1ccc-4989-8d40-b9de9c197561 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.788275 Aug 29 10:38:35.387998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 603/1113] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:34 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:35.401203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-645926184", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:35.409095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:35.417793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27aa5ddc-29ab-41e4-8615-29ebcd7bec20 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1713 microversion: 2.1 time: 0.831829 Aug 29 10:38:35.418377 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 511/1114] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:34 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1713 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:35.435866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:35.436766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:35.442987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:35.443503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:35.443942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:35.444640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:35.445095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:35.445521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:35.491698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:38:35.499967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 HTTP/1.1 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3'} Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:35.501660 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fbc2ddce-21a2-4235-91a6-6bca65cf37cd tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 404 len: 111 microversion: 2.1 time: 0.083608 Aug 29 10:38:35.508585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 512/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:35 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:35.610416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:35.611309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:35.634950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:35.644549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:35.645480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:35.651993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:35.652444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:35.652969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:36.029834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:36.042572 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-203fe2c6-78e4-4d3f-8887-e7833ac0b69b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.439899 Aug 29 10:38:36.043831 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 513/1116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:35 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:36.068656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1112174548", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:36.075859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:36.076911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:36.077566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:36.078952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:36.079433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:36.105558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:36.109578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:36.110939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:36.115620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:36.116846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:36.119152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:36.172464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] validate_networks() for [('5448ad7b-c0bc-4881-99bf-045f093f2719', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:38:36.175619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:36.188010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:36.194208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:36.224323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:38:36.228154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:38:36.287509 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84a4f770-1797-437e-beab-459fe214a8fa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894596 Aug 29 10:38:36.288197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 604/1117] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:38:36.300427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7339992-edd6-4882-96e6-6baa456c9bea tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:36.301364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c7339992-edd6-4882-96e6-6baa456c9bea tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:36.622433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7339992-edd6-4882-96e6-6baa456c9bea tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:36.634045 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7339992-edd6-4882-96e6-6baa456c9bea tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1212 microversion: 2.1 time: 0.337556 Aug 29 10:38:36.654829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 605/1118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:36 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1212 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:36.660080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:36.662590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:36.684629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:36.685485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:36.686212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:36.687142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:36.687823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:36.688462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.062838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:37.087764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:37.089975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:37.091536 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31d2c56d-ddc6-49d6-8737-467480bbb9f2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.435442 Aug 29 10:38:37.092636 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 606/1119] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:36 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:37.097746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:37.098584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:37.105931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.106600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.107225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.108818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.109437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.110070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.325956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:37.361480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-849dbee9-57b8-4878-836c-8d0d7dd4d7ff tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1645 microversion: 2.1 time: 0.267533 Aug 29 10:38:37.375374 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 607/1120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:37 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1645 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:37.432133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:37.433022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:37.447914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.448993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.449638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.450731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.451204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.451637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.794258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:37.803491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8fdca7e-ac47-4be0-907d-3e9c7d4b3aac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.423248 Aug 29 10:38:37.804022 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 608/1121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:37 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:37.820780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4c3b17-121c-446e-a442-894299a85e46", "tag": "13c4e59c-35e5-4937-924f-506304ed75cd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:37.836843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.837785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.838445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.843295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:37.843824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:37.844266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:37.844684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:37.845094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:37.852066 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] Creating event network-changed:13c4e59c-35e5-4937-924f-506304ed75cd for instance 9c4c3b17-121c-446e-a442-894299a85e46 on n-h1-854121-10 Aug 29 10:38:37.857773 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-39e941c3-e6bf-4689-8f51-3f86cdb143d8 req-763083eb-7326-46b6-97fd-7390eed7046b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046093 Aug 29 10:38:37.859176 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 609/1122] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:37.866417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d093296-fa58-46c9-9265-f99c9c0cb097", "name": "network-vif-deleted", "tag": "3245372e-9f1b-48f4-ab6a-f9035e26187c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:37.873851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.875635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.876598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.877962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.878455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.878891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.880730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.882558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.884608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.911458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] Creating event network-vif-deleted:3245372e-9f1b-48f4-ab6a-f9035e26187c for instance 9d093296-fa58-46c9-9265-f99c9c0cb097 on n-h2-854121-10 Aug 29 10:38:37.933070 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-957a6de4-54a7-4467-9f09-a94cfa92ce61 req-e7f04a84-b230-4657-8759-feab70c820e8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071835 Aug 29 10:38:37.936679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 610/1123] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:37.945120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:37.946885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:37.955338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:37.961600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.963890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.964547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.966092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:37.967218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:37.967870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:37.970453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Getting quotas for user 8b5f92e4798240c3a3c95041dde29e60 and project 881af47bf44a47a4b8161cd378e55839. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:38.025197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:38:38.032643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:38:38.109434 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a16c36d2-8449-4180-93b2-c4c282a0a6c6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.063914 Aug 29 10:38:38.110746 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 514/1124] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:38:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:38:38.122494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:38.123427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:38.132837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.133590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.134284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.136031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.136647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.137398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.195689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.209186 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5cc41016-91db-4e33-89fd-ccb828889b23 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1264 microversion: 2.1 time: 0.270657 Aug 29 10:38:38.224462 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 611/1125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:37 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:38.238981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4578d46b-a859-4ba5-ae12-1680d547aa6d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:38.241883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4578d46b-a859-4ba5-ae12-1680d547aa6d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:38.375797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4578d46b-a859-4ba5-ae12-1680d547aa6d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.383754 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4578d46b-a859-4ba5-ae12-1680d547aa6d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1225 microversion: 2.1 time: 0.158049 Aug 29 10:38:38.388488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 612/1126] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:38 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:38.404622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:38.406616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:38.432055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.432655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.433193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.434004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.434478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.435048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.523304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.524122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.525690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.526579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lazy-loading 'fault' on Instance uuid 9d093296-fa58-46c9-9265-f99c9c0cb097 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:38.589264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca964aba784dfd9f250baad9e9ec19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e59eae080bd748178fd926a03feebc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.615639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9cf5e00a-7c4c-4018-baf7-c995477a54be tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 200 len: 1352 microversion: 2.1 time: 0.223715 Aug 29 10:38:38.641869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 613/1127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:38 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 1352 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:38.811832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.828200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:38.828992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:38.832050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.833969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:38.840497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3bbc99c-594d-4db8-b6d5-af534eec4783 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.719183 Aug 29 10:38:38.841137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 515/1128] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:38 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:38.855132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:38.862037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:39.233328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.234629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.247591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.248374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.249007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.251427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.252108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.252706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.256037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:39.269598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4257e899-70ed-4297-92b1-5e36e87323ab tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.445923 Aug 29 10:38:39.274036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 614/1129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:38 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:39.371579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:39.384546 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-933f6a8a-280d-42a3-91e5-df3237ff6336 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1270 microversion: 2.1 time: 0.155611 Aug 29 10:38:39.389202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 516/1130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:39 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:39.407336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.408086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.419602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.420264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.420707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.421427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.421909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.427540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.578403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:39.589380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c29d6b16-1ec7-403b-b84a-39644a1fffa4 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1221 microversion: 2.1 time: 0.185648 Aug 29 10:38:39.590103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 615/1131] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:39 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:39.645647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.646294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.662553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.663143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.663579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.672837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.673560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.674091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.718198 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 HTTP/1.1 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9d093296-fa58-46c9-9265-f99c9c0cb097'} Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:39.732240 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-687a4313-c041-4496-bfdc-96c507598bdc tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 404 len: 111 microversion: 2.1 time: 0.092387 Aug 29 10:38:39.736342 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 517/1132] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:39 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:39.746505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.747159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.761826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.762454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.763016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.764559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.765323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.765884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.788411 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d HTTP/1.1 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b8566034-3f61-4670-87f9-c70f21528d2d'} Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:39.801194 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f6293cf0-955b-4cef-9bc0-49aaceb2fd66 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 404 len: 111 microversion: 2.1 time: 0.060730 Aug 29 10:38:39.805370 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 616/1133] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:39 2022] DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:39.812817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.813647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.822112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.825753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.826601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.827802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.834182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.834924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.867238 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.870942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.871974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d HTTP/1.1 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b8566034-3f61-4670-87f9-c70f21528d2d'} Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.873074 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:39.877918 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:38:39.879915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:39.880899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5721ec6-8964-4340-bee8-1e5427ff1d86 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 404 len: 111 microversion: 2.1 time: 0.071971 Aug 29 10:38:39.882313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 518/1134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:39 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:39.887147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.888042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.888670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.889938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:39.890706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:39.891498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:39.892990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75044269-54df-4df4-a922-189812acc9c1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '.version_select at 0x7f66c6f375e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:39.926534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:39.935861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75044269-54df-4df4-a922-189812acc9c1 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982429982" status: 202 len: 0 microversion: 2.1 time: 0.048310 Aug 29 10:38:39.937241 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 519/1135] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982429982 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:38:40.297238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:40.298253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:40.323405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:40.324188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:40.325573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:40.326452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:40.329422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:40.330349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:40.389221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:40.410376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:40.411849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:40.413084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2cf2998-73cf-4375-af74-f4001ba47183 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.548879 Aug 29 10:38:40.413969 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 617/1136] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:39 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:40.419209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:40.419821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:40.436943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:40.437771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:40.438547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:40.439670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:40.440130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:40.440705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:40.980768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:40.994786 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a0c7fa1e-cbb2-4393-aeea-c3c4f2ff69a4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.706055 Aug 29 10:38:41.012488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 520/1137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:40 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:41.021468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:41.024910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:41.041076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:41.041076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:41.041290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:41.042217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:41.042862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:41.045421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:41.478820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:41.498632 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-976fdd5e-a61c-4d08-ba22-0bfd2510631f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 1.081380 Aug 29 10:38:41.500117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 618/1138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:40 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:41.523471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:41.525407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:41.537413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:41.539027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:41.540606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:41.542453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:41.543106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:41.543900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:41.604697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:41.614014 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-844d7b18-c5cb-478d-a6c3-e2e176c9ccb6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1283 microversion: 2.1 time: 0.600245 Aug 29 10:38:41.628559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 521/1139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:41 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1283 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:41.872994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "name": "network-vif-unplugged", "status": "completed", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:41.895561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:41.896132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:41.896563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:41.927292 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] Creating event network-vif-unplugged:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h2-854121-10 Aug 29 10:38:41.943655 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9e7d09c9-bb4c-4b4c-843f-36a3970ffb35 req-fdbab827-c1d9-40e9-87fb-8d03c2c86ae0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075985 Aug 29 10:38:41.944561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 522/1140] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:42.047288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:42.050062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:42.062464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.063138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.063687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:42.064512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.065260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.065833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:42.373593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:42.409001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:42.420554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:42.422209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0549a705-5402-4265-8997-140f9b0e4194 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.920721 Aug 29 10:38:42.423292 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 619/1141] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:41 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:42.543898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:42.544576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:42.551704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.552549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.553140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:42.555137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.556356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.557619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:42.827117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:42.858435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5dec3182-b3db-4971-8bf7-c208602a6cec tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.828057 Aug 29 10:38:42.860781 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 523/1142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:42 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:42.892858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:42.897557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:42.922089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.922863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.923476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:42.924859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:42.926080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:42.927052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:43.357928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:43.366616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-365054cd-f21f-494a-b909-9e51f4a2dc64 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1283 microversion: 2.1 time: 0.500694 Aug 29 10:38:43.367207 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 524/1143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:42 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1283 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:43.446533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:43.447389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:43.460859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:43.461356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:43.462009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:43.463398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:43.464051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:43.467479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:43.621060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:43.634371 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1170e117-b28f-451c-ac34-6f884822f73c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 1.112501 Aug 29 10:38:43.641366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 620/1144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:42 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:43.820954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2352d7ce-aabf-4abc-b552-2bf343d1c68e tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:43.863611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2352d7ce-aabf-4abc-b552-2bf343d1c68e tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/417933780" status: 202 len: 0 microversion: 2.1 time: 0.054104 Aug 29 10:38:43.873253 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 621/1145] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:38:43 2022] DELETE /compute/v2.1/flavors/417933780 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:43.878463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dd81297b-c54b-4fdd-a058-041ec0e1090a tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:43.931294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dd81297b-c54b-4fdd-a058-041ec0e1090a tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.055907 Aug 29 10:38:43.938102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 622/1146] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:38:43 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:43.954689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:43.955676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:43.972943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:43.973808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:43.974457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:43.975378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:43.976083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:43.976708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.187107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:44.204978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:44.209918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:44.212685 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d21284df-8767-4a16-a9e4-7759c557327e tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.770649 Aug 29 10:38:44.218989 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 525/1147] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:43 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:44.238429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8dbb8946-5eda-447d-9e9e-ea5757dbaacb tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.283855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8dbb8946-5eda-447d-9e9e-ea5757dbaacb tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/411152838" status: 202 len: 0 microversion: 2.1 time: 0.060164 Aug 29 10:38:44.284657 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 526/1148] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:38:44 2022] DELETE /compute/v2.1/flavors/411152838 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:44.296954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:44.324715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.327742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.328793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.359015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] Creating event network-changed:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h2-854121-10 Aug 29 10:38:44.373559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f1438c63-04ae-4c0b-a498-b8486194deef req-0b7abc2a-c685-4e10-92cf-172b40165481 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084071 Aug 29 10:38:44.377667 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 527/1149] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:44.416426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e94abcdc-f7a1-4c1b-ab8b-2fdec9112031 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.476603 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e94abcdc-f7a1-4c1b-ab8b-2fdec9112031 tempest-ServersWithSpecificFlavorTestJSON-1283284284 tempest-ServersWithSpecificFlavorTestJSON-1283284284-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093966 Aug 29 10:38:44.478802 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 528/1150] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:38:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:44.488260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.489382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:44.512716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.513615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.514275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.515394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.516023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.516709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.743710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:44.759498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f2881fd-3b11-49a1-98ea-87c38c8b8c79 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.817585 Aug 29 10:38:44.762316 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 623/1151] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:43 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:44.775270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.778090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:44.803016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:44.807562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.808114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.808541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.809592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.810286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.810716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.818531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5878a351-4dbf-4a77-bda7-376d43c4e264 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1283 microversion: 2.1 time: 0.337361 Aug 29 10:38:44.819348 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 529/1152] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:44 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1283 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:44.829039 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.830295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.830952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 HTTP/1.1 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9d093296-fa58-46c9-9265-f99c9c0cb097'} Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:44.831185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.835781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.838657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:44.839822 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d8f8f074-c14f-4581-99e8-daa03e4a0721 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 404 len: 111 microversion: 2.1 time: 0.075363 Aug 29 10:38:44.840836 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 624/1153] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:44 2022] DELETE /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:44.854527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.855155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.855666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.856496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.857077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.857911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: 9d093296-fa58-46c9-9265-f99c9c0cb097] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:44.862495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.863055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.872744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.873277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.874360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.875421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:44.875871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:44.878079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:44.911664 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 HTTP/1.1 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9d093296-fa58-46c9-9265-f99c9c0cb097'} Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.929492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. Aug 29 10:38:44.935328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:44.938416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance 9d093296-fa58-46c9-9265-f99c9c0cb097 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:44.938416 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23619bc1-f6bd-4ee3-ae70-979b74d341e6 tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097" status: 404 len: 111 microversion: 2.1 time: 0.092534 Aug 29 10:38:44.938416 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 625/1154] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:44 2022] GET /compute/v2.1/servers/9d093296-fa58-46c9-9265-f99c9c0cb097 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:44.966657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:44.967171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:45.006217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.007249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.008651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.010326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.011918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.012701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.037087 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d HTTP/1.1 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b8566034-3f61-4670-87f9-c70f21528d2d'} Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:45.039284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.047332 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.052862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:45.054066 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8d28767-d596-47a1-8c03-2bb1ee49525f tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 404 len: 111 microversion: 2.1 time: 0.108645 Aug 29 10:38:45.056376 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 626/1155] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:38:44 2022] DELETE /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:45.063730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7166b683-1fb7-4865-9722-256ce4dec614", "tag": "80e23a84-6b53-4495-a8c2-f6328360ca76"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:45.093605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.094225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.094907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.113870 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] Creating event network-changed:80e23a84-6b53-4495-a8c2-f6328360ca76 for instance 7166b683-1fb7-4865-9722-256ce4dec614 on n-h2-854121-10 Aug 29 10:38:45.122508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3004e083-cdd4-4408-b756-20e53d47681a req-00746f86-7577-4109-bb1a-5d3d1a98630c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064488 Aug 29 10:38:45.124978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 627/1156] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:45.140157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:45.144541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] [instance: b8566034-3f61-4670-87f9-c70f21528d2d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:45.154462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.155239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.156065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.158406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.159429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.160047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.188573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] HTTP exception thrown: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Request method failure captured: Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d HTTP/1.1 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZ0h5ackXPpBUUa2zpJ2Miiq98HFbrXhRDrQcUSTR-GIrFVEsDjn4AOHmi5x2O7rXRfiIfugzXIdfBsgEnyyWmWpmvH-CF-NOp7EyjlujZz4fMsxn9pXPpF6VioIwEyEI6lDv84A66uZki5-v7I9B9Fk9JPvK6TFqlaYc6PP2cwPBc Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e59eae080bd748178fd926a03feebc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e59eae080bd748178fd926a03feebc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e59eae080bd748178fd926a03feebc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e59eae080bd748178fd926a03feebc21 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caca964aba784dfd9f250baad9e9ec19 Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1338939424-project Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b8566034-3f61-4670-87f9-c70f21528d2d'} Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.191485 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] Returning 404 to user: Instance b8566034-3f61-4670-87f9-c70f21528d2d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89bd6d5e-4439-488a-bb24-e7f07c0efc7e tempest-ServersWithSpecificFlavorTestJSON-1338939424 tempest-ServersWithSpecificFlavorTestJSON-1338939424-project] 10.222.0.47 "GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d" status: 404 len: 111 microversion: 2.1 time: 0.065428 Aug 29 10:38:45.197143 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 628/1157] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:45 2022] GET /compute/v2.1/servers/b8566034-3f61-4670-87f9-c70f21528d2d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:38:45.243530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:45.245504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:45.253067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.253991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.254699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:45.255774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:45.256427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:45.257088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:46.047721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:46.077396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:46.084698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:46.094480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be824845-06b3-4811-a5b8-6f8feb75d6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.848119 Aug 29 10:38:46.110246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 629/1158] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:45 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:46.115642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:46.116185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:46.133603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:46.134534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:46.135193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:46.136212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:46.136882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:46.137534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:46.146671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:46.239353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:46.249304 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a39c5140-b70a-4a3f-9df1-7a80e7ae7591 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 1.428827 Aug 29 10:38:46.251087 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 530/1159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:44 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:46.256108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:46.256942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:46.266596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:46.267348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:46.268160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:46.269040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:46.269910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:46.270500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:47.111109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.125537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1186381d-aa35-42d3-8354-be34ead7a336 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 1.013956 Aug 29 10:38:47.126574 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 630/1160] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:46 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:47.311205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.324921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebf16287-0889-42df-a321-736339294c0e tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 1.072529 Aug 29 10:38:47.325915 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 531/1161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:46 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:47.336231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:47.337831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:47.359383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:47.360569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:47.361531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:47.362546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:47.363506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:47.364172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:47.420941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54e7d35d-04bf-4abb-b8b9-90eca252e658 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Action: 'create', calling method: .version_select at 0x7f66c6de3310>, body: {"keypair": {"name": "tempest-keypair-1269583699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFAWNW7j/UzoXgT5GQhR2UoCFz1sKcff2OYCvBaSPXtBMUbdDH1/ig40V8LAXF5KClH0qyANyenSHsTE8j8LAmCW1wrV0cui91TGsVlch3CLsMwFT9brI/pO7a8QNoGUw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:47.459443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-54e7d35d-04bf-4abb-b8b9-90eca252e658 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:47.466598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-54e7d35d-04bf-4abb-b8b9-90eca252e658 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for user 2789020d0cef4674be08b8aaa391ded6 and project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:47.497904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54e7d35d-04bf-4abb-b8b9-90eca252e658 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.369644 Aug 29 10:38:47.498799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 631/1162] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:38:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:47.503935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:47.504703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:47.514289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:47.515024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:47.515707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:47.516654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:47.517334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:47.518153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:47.849911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.882687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.886949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.889066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e18983e8-8ecf-44fb-a83a-dbb53bcf621b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.561682 Aug 29 10:38:47.890535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 532/1163] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:47 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:47.899881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:47.909592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f14789d-2a5a-4575-8590-8289cfcc592a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 0.409535 Aug 29 10:38:47.912880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 632/1164] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:47 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:48.152164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:48.153034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:48.160020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:48.171138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:48.192664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.193686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.194328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.195255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.196002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.196621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.350521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:48.351126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:48.371782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.372314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.372760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.373485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.373968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.374402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.634608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:48.645675 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d9f27821-7eff-48fe-be9a-039b9086b8b0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.501673 Aug 29 10:38:48.659356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 533/1165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:48 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:48.737419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:48.756559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c5a2098-df31-4344-b171-185c584fed9f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 0.409901 Aug 29 10:38:48.769432 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 633/1166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:48 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:48.852748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46518641-ae3b-48b7-8cd3-347ed513c09e", "tag": "104c2123-ec16-4a93-a189-7f70ca2f7b2a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:48.889667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.893053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.893740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.908835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:48.914729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:48.915338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:48.918671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] Creating event network-changed:104c2123-ec16-4a93-a189-7f70ca2f7b2a for instance 46518641-ae3b-48b7-8cd3-347ed513c09e on n-h2-854121-10 Aug 29 10:38:48.925051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.925550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.926242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.926722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.927183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.928935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.935233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-318744ca-4a28-4074-b645-ac96047172e3 req-cf50edae-d43f-4cec-81fd-d484784b83c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087425 Aug 29 10:38:48.935986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 534/1167] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:48.941282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:48.950740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:48.965991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:48.967737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:48.971652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:48.993160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:49.000461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:49.001405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:49.642337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:49.654695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:49.657805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:49.660911 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87963fac-60b7-4499-8963-bda2ab1c1bd9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.750178 Aug 29 10:38:49.665876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 634/1168] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:48 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:49.684998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:49.685900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:49.696599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:49.706423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:49.711437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:49.716086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8f1cf571-fa7c-4bb9-aeac-88c55d784c1b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 0.778700 Aug 29 10:38:49.716672 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 535/1169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:48 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:49.717525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:49.718472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:49.719105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:49.719728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:49.776328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:49.776942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:49.786669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:49.787162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:49.787600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:49.788387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:49.788826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:49.790406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:50.854900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:50.878578 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1eb61a8c-e9cb-4326-b892-ca37186d5c2b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 1.195383 Aug 29 10:38:50.892382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:50.900534 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 635/1170] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:49 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:50.904525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af3757f7-868c-41e2-b7c3-2e8e76a6b69f tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 1.131860 Aug 29 10:38:50.906335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1056012080", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bc24b41b-5dcc-4207-a850-f4f50c947735"}], "security_groups": [{"name": "tempest-securitygroup--62435058"}], "key_name": "tempest-keypair-1269583699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:50.907999 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 536/1171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:49 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:50.922769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:50.924493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:50.934839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:50.941274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:50.941782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:50.942530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:50.943001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:50.943433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.202008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] validate_networks() for [('bc24b41b-5dcc-4207-a850-f4f50c947735', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:38:51.459842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:51.470176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:51.471618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:51.472801 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e01af54e-92e8-4d83-89fb-0f8369e53408 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.563582 Aug 29 10:38:51.473362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 537/1172] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:50 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:51.491129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:51.491899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:51.498502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.499109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.499850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.500633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.501152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.501765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.710862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:51.720224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b2edfa6-b3e6-4dbd-a519-6c5d5d76ba10 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 0.245805 Aug 29 10:38:51.721209 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 538/1173] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:51 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:51.873006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:51.873463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:51.873922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:51.874416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:51.874836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:51.885999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.886670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.887360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.888224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.888656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.889262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.905081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:51.905689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:51.911758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.912248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.912687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.913386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:51.913876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:51.914471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:51.915092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:38:51.919902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:51.921294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for user 2789020d0cef4674be08b8aaa391ded6 and project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:38:51.957626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:38:51.959990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:38:52.047177 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99ce1606-b8b7-4ffe-b18c-1b20acbede30 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.144984 Aug 29 10:38:52.047611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 636/1174] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:38:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:38:52.075827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:52.079782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:52.094142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.107340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:52.108718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.109376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.110217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.110763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.111189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.118325 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb795f12-0511-428a-8709-31f9e8184570 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.215894 Aug 29 10:38:52.120048 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 539/1175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:51 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:38:52.125374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-999c6677-089a-40f2-99b4-6261f750e22f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:52.126462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-999c6677-089a-40f2-99b4-6261f750e22f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:52.218117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-999c6677-089a-40f2-99b4-6261f750e22f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:52.229027 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-999c6677-089a-40f2-99b4-6261f750e22f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1242 microversion: 2.1 time: 0.107610 Aug 29 10:38:52.232582 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 540/1176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:52 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:52.244381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:52.246529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:52.265893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.266604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.267251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.270607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.271198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.271741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.728593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:52.740142 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d09f6e07-9efd-4882-8099-05b1b4bfb94a tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 0.685683 Aug 29 10:38:52.759049 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 637/1177] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:52 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:52.781869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:52.783977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:52.801046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.804210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.807083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.809087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:52.813798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:52.814910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:52.871898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:53.119091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4592e67d-d025-43ac-a0fe-2968c8b13baf tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1814 microversion: 2.1 time: 0.879711 Aug 29 10:38:53.119875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 541/1178] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:52 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1814 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:53.127099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7166b683-1fb7-4865-9722-256ce4dec614", "name": "network-vif-plugged", "status": "completed", "tag": "80e23a84-6b53-4495-a8c2-f6328360ca76"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:53.139510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.140596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.141283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.158114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] Creating event network-vif-plugged:80e23a84-6b53-4495-a8c2-f6328360ca76 for instance 7166b683-1fb7-4865-9722-256ce4dec614 on n-h2-854121-10 Aug 29 10:38:53.165415 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1e1f078e-a058-4bbb-972d-30350d4785be req-a3d6d803-9bf8-458e-800d-6f5aa70b93c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041003 Aug 29 10:38:53.166776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 542/1179] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:53.174381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:53.175535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:53.184903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.186130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.187100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.188194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.188943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.189632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.450103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:53.459478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:53.461284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:53.462901 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d81ffa7-dbea-4002-b643-4e2783b7e1f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.699904 Aug 29 10:38:53.463471 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 638/1180] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:52 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:53.484074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:53.484976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:53.493578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.494268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.494703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.495630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.496053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.496626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.724767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:53.734356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-57609cf6-7d88-463c-a73c-4c2b07d75ffd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 0.565991 Aug 29 10:38:53.735240 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 543/1181] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:53 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:53.739950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:53.745114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.746008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.746683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.747684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.748382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.749080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.783414 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-37a1420c-0334-4a67-9727-df3adf387ae6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046796 Aug 29 10:38:53.784911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 544/1182] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:38:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:53.790798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:53.791797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:53.798923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.799815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.800213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.801025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.801619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.802221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.824649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:53.833777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2db84fd7-b832-4984-aa2f-2ea0ad0d15b3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.354221 Aug 29 10:38:53.851322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 639/1183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:53 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:53.857432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:53.858403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:53.865505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.866298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.866991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:53.868701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:53.869666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:53.870978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:54.075172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:54.103428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe0dbff9-c6bb-4f14-878f-87981ae937a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1294 microversion: 2.1 time: 0.317029 Aug 29 10:38:54.122799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 545/1184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:53 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1294 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:54.496487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:54.497219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:54.509558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:54.510263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:54.512012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:54.513090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:54.513793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:54.514319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:54.899950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:54.928626 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c37e332d-0049-4a7a-8c50-085260982581 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 1.071661 Aug 29 10:38:54.932985 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 640/1185] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:53 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:54.939969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:54.950370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:54.955962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:54.956592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:54.957126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:54.958991 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dce5488e-b497-4096-994d-2db168f50655 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.472400 Aug 29 10:38:54.963709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:54.964222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:54.965255 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 546/1186] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:54 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:54.969066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:54.970143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:54.970793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:54.971418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:54.991535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:55.001157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:55.008727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.009482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.009935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.010683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.011127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.011555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.372618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:55.378317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:55.387152 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15423f11-e2f2-4e31-8fde-e58b61e9dc61 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.407496 Aug 29 10:38:55.389174 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2c24755-a121-4d52-8406-ca9f10547b42 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1312 microversion: 2.1 time: 0.453163 Aug 29 10:38:55.390607 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 641/1187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:54 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1312 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:55.397935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:55.400502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:55.407825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.408657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.421768 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 547/1188] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:54 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:55.423708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.424641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.425291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.426680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.579178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:55.597689 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc17c432-26f7-44fe-ae07-778183b77b0f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1300 microversion: 2.1 time: 0.199564 Aug 29 10:38:55.598593 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 642/1189] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:55 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:55.950818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:55.951417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:55.959021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.960308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.960447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.963120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:55.963824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:55.964430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:55.995884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:55.996657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:56.009946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.010678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.011299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.013055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.013921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.014510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.430330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.440686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.442351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.443731 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b351b084-d587-4f24-b290-c1b70dc6a70f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1813 microversion: 2.25 time: 0.453126 Aug 29 10:38:56.453733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.454756 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 643/1190] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:55 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1813 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:56.464822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1c5c0b9-d6ca-4548-a30d-bf90870a2fc0 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 0.512246 Aug 29 10:38:56.464822 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 548/1191] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:55 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:56.467592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:56.468373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:56.472584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:56.474801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.475453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.476592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.477476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.478271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.480034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.482516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:56.490442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.491184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.491799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.493356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.494094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.494691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.854263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.881921 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5effb45-80ab-4c33-b8a1-e10f41411b19 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1460 microversion: 2.1 time: 0.421756 Aug 29 10:38:56.883683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 644/1192] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:56 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1460 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:56.891247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:56.892172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:56.900850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.901995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.902534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.903389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.903713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.904141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.908341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:56.918080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7fce759-85e7-4535-b150-c17567dd61a5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.454257 Aug 29 10:38:56.919121 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 549/1193] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:56 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:56.924305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aecf1ccc-b31c-4642-957b-5224a373cfb2", "device": "/dev/xvdb"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:56.927291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:56.936039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.937013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.937796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:56.938770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:56.939608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:56.940261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.126918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.136807 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-95975620-d029-4dcc-9b2f-d3ab2df7647d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.250758 Aug 29 10:38:57.138084 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 645/1194] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:56 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:57.143338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46518641-ae3b-48b7-8cd3-347ed513c09e", "name": "network-vif-plugged", "status": "completed", "tag": "104c2123-ec16-4a93-a189-7f70ca2f7b2a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:57.156111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.156652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.157328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.186405 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] Creating event network-vif-plugged:104c2123-ec16-4a93-a189-7f70ca2f7b2a for instance 46518641-ae3b-48b7-8cd3-347ed513c09e on n-h2-854121-10 Aug 29 10:38:57.198327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-08869d39-557b-4c2d-b9c5-28c18b4337b9 req-5b2ff0bf-953a-4677-bb41-94ffbc970331 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058092 Aug 29 10:38:57.199215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 646/1195] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:57.208755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:57.212255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:57.232729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.239082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.239863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.240934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.241908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.242677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.308136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e3cdeb5-8ee3-45f7-ab7c-f87f092cef15 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387481 Aug 29 10:38:57.309565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 550/1196] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:38:56 2022] POST /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:57.393024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.413619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 10:38:57.423752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:38:57.424310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:38:57.425330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:38:57.425881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:38:57.426390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:38:57.472733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:57.473651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:57.484044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.489527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.490297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.491414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.492630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.493546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.638421 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b68144cd-e0af-4599-a883-07638d27579e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614/action" status: 202 len: 0 microversion: 2.1 time: 0.434280 Aug 29 10:38:57.639118 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 647/1197] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:38:57 2022] POST /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:38:57.644684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:57.645495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:57.653986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.655252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.655349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.656201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.656706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.657136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.670267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.682119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.684300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.686274 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b49b227f-afe4-467b-9da2-83a41ced624d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1803 microversion: 2.25 time: 0.218158 Aug 29 10:38:57.687375 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 551/1198] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:57 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:38:57.692766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:57.694641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:57.703777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.704654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.705281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.716781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.718907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.723916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.746206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:38:57.908040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:57.926488 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3b1e5df-fb86-45e0-818b-d06ca4dd466d tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1325 microversion: 2.1 time: 0.284812 Aug 29 10:38:57.927945 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 648/1199] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:57 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:57.951238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-670b286e-6a6f-466e-91b7-e5d8f7bd4206 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '.version_select at 0x7f66c6e40d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:57.957743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-670b286e-6a6f-466e-91b7-e5d8f7bd4206 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:57.958483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-670b286e-6a6f-466e-91b7-e5d8f7bd4206 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:57.959138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-670b286e-6a6f-466e-91b7-e5d8f7bd4206 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:57.965139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:58.001826 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-483ffbc9-65a4-4745-b19c-1630f35cf55c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1469 microversion: 2.1 time: 0.311549 Aug 29 10:38:58.015660 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 552/1200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:57 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:58.046745 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-670b286e-6a6f-466e-91b7-e5d8f7bd4206 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 3180 microversion: 2.25 time: 0.103796 Aug 29 10:38:58.047369 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 649/1201] 10.222.0.47 () {60 vars in 1184 bytes} [Mon Aug 29 10:38:57 2022] GET /compute/v2.1/os-migrations => generated 3180 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:58.054919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:58.055591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:58.065922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:58.075886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:58.078926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.079515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.079954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.085680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.087442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.087898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.095393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.095964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.096405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.098033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.098504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.098931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.391521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:58.405483 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd3b1639-8a3d-45c9-bb60-0059b801758e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.386604 Aug 29 10:38:58.421165 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 553/1202] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:58 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:58.441977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:58.453010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:58.472771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.474426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.474882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.475629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.476087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.477055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.512224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:58.546287 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6d830339-589b-444f-a8cd-20014495a917 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 2423 microversion: 2.25 time: 0.486222 Aug 29 10:38:58.549091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 650/1203] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:58 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 2423 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:58.554325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d319a64e-826c-4f51-8fb7-bb4993be9a7f", "tag": "a4c764c3-9259-454a-b92a-f18da93414ee"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:38:58.568685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.569438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.570071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.584787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] Creating event network-changed:a4c764c3-9259-454a-b92a-f18da93414ee for instance d319a64e-826c-4f51-8fb7-bb4993be9a7f on n-h1-854121-10 Aug 29 10:38:58.593563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-95da1d3c-5b96-40ad-a3ba-8641b9faf0fa req-bf3910a9-3b2e-4792-a6a1-7cfabce2a6a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042350 Aug 29 10:38:58.595215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 651/1204] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:38:58.605419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:58.607374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:58.616047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.616812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.624193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:58.625420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:58.626012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:58.626585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.359364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:59.372225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f35bd18-168d-4583-8ae2-a7a8b83d17a5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.935314 Aug 29 10:38:59.386102 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 554/1205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:58 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:59.401790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:38:59.405555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:59.405555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:59.436904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.439314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.439838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.440511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.443232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.443704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.453315 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5893e0f7-0c0f-4b06-b63c-08ac4f4e560a tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 2423 microversion: 2.25 time: 0.852948 Aug 29 10:38:59.454257 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 652/1206] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:38:58 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 2423 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:38:59.460022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:59.461442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:59.468331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.469137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.469822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.474343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.475156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.476067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.730127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:38:59.775488 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-469ffb4b-d6ec-4037-b152-9f81d158fa52 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1522 microversion: 2.1 time: 0.387583 Aug 29 10:38:59.782975 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 555/1207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:59 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:38:59.800086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:38:59.803224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:38:59.827059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.831910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.832393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:38:59.835251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:38:59.835766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:38:59.837354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.078030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:00.096684 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c6729be-b3ec-40e5-b586-11ee703c837d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1469 microversion: 2.1 time: 0.639828 Aug 29 10:39:00.109880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 653/1208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:59 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1469 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:00.115801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:00.119171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:00.138487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.139541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.140158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.141387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.142173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.146355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.241152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:00.255015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb415e32-e45a-4f26-b289-bdc90e3a3239 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.468217 Aug 29 10:39:00.256507 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 556/1209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:38:59 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:00.263623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:00.266489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:00.298919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.302212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.302808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.303829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.318421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.321678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.370104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:39:00.408136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lazy-loading 'services' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:39:00.489720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:00.543370 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df00d144-b163-4e31-b594-2d775f8130db tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 204 len: 0 microversion: 2.1 time: 0.285240 Aug 29 10:39:00.544462 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 557/1210] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:39:00 2022] DELETE /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:39:00.560667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:00.561417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:00.574036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.575306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.576584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.578723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.580349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.581052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.684441 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-617d6ad5-7e5f-451a-a99b-994d316a4db2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments/c6b83881-75b1-41e1-8a20-1b9763b45a44" status: 202 len: 0 microversion: 2.25 time: 0.581810 Aug 29 10:39:00.685679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 654/1211] 10.222.0.47 () {60 vars in 1457 bytes} [Mon Aug 29 10:39:00 2022] DELETE /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments/c6b83881-75b1-41e1-8a20-1b9763b45a44 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:39:00.693248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:00.700588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:00.716382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.717588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.718328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.720345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:00.721000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:00.721661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:00.996479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:01.005308 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c24bd0cc-9333-46c8-a48a-5822e4bc456d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.458560 Aug 29 10:39:01.008656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 558/1212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:00 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:01.019747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:01.025265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:01.032696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.033536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.034059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.034772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.035404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.035855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.070026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9724b595-ea69-41ac-84b5-87da48a068be tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058380 Aug 29 10:39:01.070879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 559/1213] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:01 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:01.108591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:01.119106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6dc7ddac-8086-4871-9694-cbdbd6a2afe8 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1528 microversion: 2.1 time: 0.431940 Aug 29 10:39:01.123131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:01.124158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:01.131408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.132187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.133942 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 655/1214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:00 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1528 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:01.134326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.135122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.135657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.136538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.283245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:01.284072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:01.291386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.292039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.292816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.293167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:01.293623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:01.294077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:01.375357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:01.384538 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78b6b669-d47f-46ab-a43f-702e08b9ee76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1469 microversion: 2.1 time: 0.265378 Aug 29 10:39:01.385534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 560/1215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:01 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:01.592155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:01.606254 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45dbd28b-a557-4cde-b2c7-076b1164ff4d tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.328312 Aug 29 10:39:01.607328 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 656/1216] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:01 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:02.032205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:02.032820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:02.041804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.042165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.043176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.044369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.045074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.045662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.084178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:02.087937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:02.090029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:02.093628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=20 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:02.109329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.110024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.110283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.111198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.111839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.112428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.213197 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f7bc0f45-d0cf-4758-bc55-1eaab17777ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129897 Aug 29 10:39:02.219273 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 657/1217] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:02 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:02.223192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:02.225798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:02.227536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:02.234999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.235807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.236306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.237059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.237511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.238088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.442699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:02.454231 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59dcb0f2-9a75-46d7-842f-132da66262bb tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.427445 Aug 29 10:39:02.454811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 561/1218] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:02 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:02.464921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:02.467633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:02.477935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:02.480886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.481418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.490074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.490889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.491359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.492310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.642925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:02.652563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-337b1d0f-d7d6-4a94-a35c-cfec3d1e9027 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1528 microversion: 2.1 time: 0.431672 Aug 29 10:39:02.656697 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 658/1219] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:02 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1528 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:02.670034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:02.670930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:02.682282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.683894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.684372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.685103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:02.685561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:02.686009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:02.998886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:03.009034 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da8c8113-222a-4bd9-9827-e26ab2e98b86 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1469 microversion: 2.1 time: 0.552458 Aug 29 10:39:03.025358 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 562/1220] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:02 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1469 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:03.102299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:03.114803 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0afac02-5a84-494c-9d94-8e9ebc7f1aff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.453925 Aug 29 10:39:03.129757 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 659/1221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:02 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:03.238652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:03.241075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:03.248283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.248980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.249537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.250300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.250945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.251548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.305090 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-689d59ff-5e94-4d63-931b-3da5b2545860 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081296 Aug 29 10:39:03.311761 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 563/1222] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:03 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:03.481782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:03.482428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:03.492958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.493763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.495080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.496389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.497605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.498239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.662885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-618a1c8c-cfad-407e-82fa-92b3f907aff1 tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-38832024", "id": 991992579, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:03.697240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-618a1c8c-cfad-407e-82fa-92b3f907aff1 tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 463 microversion: 2.61 time: 0.268866 Aug 29 10:39:03.698821 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 660/1223] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:39:03 2022] POST /compute/v2.1/flavors => generated 463 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:03.707039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46518641-ae3b-48b7-8cd3-347ed513c09e", "name": "network-vif-deleted", "tag": "104c2123-ec16-4a93-a189-7f70ca2f7b2a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:03.720022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.720887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.721547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.745959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] Creating event network-vif-deleted:104c2123-ec16-4a93-a189-7f70ca2f7b2a for instance 46518641-ae3b-48b7-8cd3-347ed513c09e on n-h2-854121-10 Aug 29 10:39:03.752143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a0809d28-a445-4713-a5d1-3810ba07c455 req-e3ab8ab9-6d37-437c-ad66-d529d3e5b5ac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051902 Aug 29 10:39:03.753123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 661/1224] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:03.759235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:03.760332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:03.761578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:03.772210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.773299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.774142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.776574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.777498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.779235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.832389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:03.833302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:03.833936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:03.834876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lazy-loading 'fault' on Instance uuid 46518641-ae3b-48b7-8cd3-347ed513c09e {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:39:03.889154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:03.908761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-761b9475-720c-405f-ab9e-58ea6c7f83e9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.424388 Aug 29 10:39:03.911422 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 564/1225] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:03 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:03.938519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f92e4798240c3a3c95041dde29e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881af47bf44a47a4b8161cd378e55839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:03.948143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-120a9691-f0b4-4e32-82f9-5c67221faab6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 200 len: 1315 microversion: 2.1 time: 0.193458 Aug 29 10:39:03.948606 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 662/1226] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:03 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:04.031790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.032521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:04.058324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.059050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.061639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.062767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.063467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.065245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.190049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d7dd22e-9784-4782-8b9b-6fd2537963f1 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.217729 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d7dd22e-9784-4782-8b9b-6fd2537963f1 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] 10.222.0.47 "GET /compute/v2.1/flavors/991992579" status: 200 len: 463 microversion: 2.61 time: 0.304576 Aug 29 10:39:04.221892 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 565/1227] 10.222.0.47 () {60 vars in 1196 bytes} [Mon Aug 29 10:39:03 2022] GET /compute/v2.1/flavors/991992579 => generated 463 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:04.228692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d319a64e-826c-4f51-8fb7-bb4993be9a7f", "name": "network-vif-plugged", "status": "completed", "tag": "a4c764c3-9259-454a-b92a-f18da93414ee"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:04.241649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.243078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.244006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.259330 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] Creating event network-vif-plugged:a4c764c3-9259-454a-b92a-f18da93414ee for instance d319a64e-826c-4f51-8fb7-bb4993be9a7f on n-h1-854121-10 Aug 29 10:39:04.265584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e024cf6c-781e-43c3-859a-d883f460cbab req-1842a4c4-ffc9-4c81-b5d1-93edeeb0a7f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044768 Aug 29 10:39:04.266536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 566/1228] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:04.272620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.273453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:04.281913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.283057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.283728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.285293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.286445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.287289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.571040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:04.580156 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dafc4729-ab8f-4064-80c0-0d6d7a2a6de8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.311965 Aug 29 10:39:04.581140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 567/1229] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:04.586449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:04.595170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c1bcd75-6d8a-408d-a494-dd3d00122acf tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] Action: 'update', calling method: .version_select at 0x7f66c8cb3f70>, body: {"flavor": {"description": "new"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:04.599302 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-710074c4-54fb-40ef-a15b-85ba24cae26a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1469 microversion: 2.1 time: 0.572186 Aug 29 10:39:04.599891 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 663/1230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1469 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:04.605402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.607629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:04.614558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.615047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.615559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.616278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.617294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.617752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.638727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c1bcd75-6d8a-408d-a494-dd3d00122acf tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/991992579" status: 200 len: 464 microversion: 2.61 time: 0.048640 Aug 29 10:39:04.639955 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 568/1231] 10.222.0.47 () {62 vars in 1216 bytes} [Mon Aug 29 10:39:04 2022] PUT /compute/v2.1/flavors/991992579 => generated 464 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:04.650185 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27941cc0-f9dd-4e7d-bfc2-9b0822fe9f23 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049085 Aug 29 10:39:04.650677 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 664/1232] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:04.653000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0256e407-165e-4cc5-a359-f4b2c404d747 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.676057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0256e407-165e-4cc5-a359-f4b2c404d747 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 6245 microversion: 2.61 time: 0.027303 Aug 29 10:39:04.676622 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 569/1233] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/flavors/detail => generated 6245 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:04.698350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6808c45-79a0-4082-b548-526130968bc1 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.718781 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6808c45-79a0-4082-b548-526130968bc1 tempest-FlavorsV261TestJSON-1561844601 tempest-FlavorsV261TestJSON-1561844601-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 3152 microversion: 2.61 time: 0.024913 Aug 29 10:39:04.719620 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 665/1234] 10.222.0.47 () {60 vars in 1166 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/flavors => generated 3152 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:04.734856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb24f6bc-a93b-4ded-9408-9552c7be2ebd tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.751854 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb24f6bc-a93b-4ded-9408-9552c7be2ebd tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/991992579" status: 202 len: 0 microversion: 2.61 time: 0.020730 Aug 29 10:39:04.752400 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 570/1235] 10.222.0.47 () {60 vars in 1199 bytes} [Mon Aug 29 10:39:04 2022] DELETE /compute/v2.1/flavors/991992579 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:39:04.761752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9c0d715-d106-4884-9faa-ba33164eecf7 tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.783179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9c0d715-d106-4884-9faa-ba33164eecf7 tempest-FlavorsV261TestJSON-1234265120 tempest-FlavorsV261TestJSON-1234265120-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.026311 Aug 29 10:39:04.783728 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 666/1236] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:04.931381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.931991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:04.938498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.939040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.939653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.940952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.941619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.942281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.968799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:04.969412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 46518641-ae3b-48b7-8cd3-347ed513c09e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:04.975661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.976672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.977108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.977994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:04.978453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:04.978875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:04.993616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e HTTP/1.1 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '46518641-ae3b-48b7-8cd3-347ed513c09e'} Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:04.995307 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 46518641-ae3b-48b7-8cd3-347ed513c09e could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4324da4-c1f4-41d9-b031-9e352cd4af81 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e" status: 404 len: 111 microversion: 2.1 time: 0.032373 Aug 29 10:39:05.004189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 667/1237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/servers/46518641-ae3b-48b7-8cd3-347ed513c09e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:05.006478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddaab393-9503-4238-8218-85851d32d617 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c6c0e820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.068476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ddaab393-9503-4238-8218-85851d32d617 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Image not found. Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddaab393-9503-4238-8218-85851d32d617 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae HTTP/1.1 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd01efa01-98b1-4436-af19-f91fa436d6ae'} Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d01efa01-98b1-4436-af19-f91fa436d6ae to delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d01efa01-98b1-4436-af19-f91fa436d6ae could not be found. Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.070576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddaab393-9503-4238-8218-85851d32d617 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:05.075830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ddaab393-9503-4238-8218-85851d32d617 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae" status: 404 len: 62 microversion: 2.1 time: 0.070362 Aug 29 10:39:05.077681 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 668/1238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:05 2022] DELETE /compute/v2.1/images/d01efa01-98b1-4436-af19-f91fa436d6ae => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:39:05.082254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.083658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:05.090964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.091695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.092136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.092850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.093304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.093961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.112745 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 HTTP/1.1 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3'} Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:05.114643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.119869 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.122693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:05.124031 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e77ee17-7449-48e7-a7fc-af821e9db4ab tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 404 len: 111 microversion: 2.1 time: 0.046623 Aug 29 10:39:05.127905 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 669/1239] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:39:05 2022] DELETE /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:05.132173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:05.134604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.135396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:05.141096 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-26f27e24-ba96-46b0-9408-d2f8865de337 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1366 microversion: 2.1 time: 0.214296 Aug 29 10:39:05.142252 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 571/1240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:04 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:05.142691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.143223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.143659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.144429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.144888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.145312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.160417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 HTTP/1.1 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3'} Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.162458 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. Aug 29 10:39:05.167182 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:05.168420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:05.169521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-534f3386-e3f3-428c-a6a5-b77a908aede2 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3" status: 404 len: 111 microversion: 2.1 time: 0.040468 Aug 29 10:39:05.173719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 670/1241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:05 2022] GET /compute/v2.1/servers/8a1ad028-0eab-44b0-8bc6-e57b5a24d7e3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:05.178477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9e3a80b-840e-4f79-b686-ad25d0ee6d91 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c6e97c10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.198636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9e3a80b-840e-4f79-b686-ad25d0ee6d91 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963952526" status: 202 len: 0 microversion: 2.1 time: 0.023864 Aug 29 10:39:05.199397 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 572/1242] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:39:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963952526 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:39:05.606754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.607434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:05.622901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:05.624419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:05.634417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.634892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.638393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.638642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.640083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.640847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.641738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.642528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.643122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.644014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:05.659642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:05.661653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:05.740373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:05.958364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:05.989875 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bcee8859-dd46-4366-a89f-87d4c1465f61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.371705 Aug 29 10:39:05.991394 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 573/1243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:05 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:05.997136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.000520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:06.010872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.011734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.013369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.014420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.015205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.016022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.062574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d49fedf-f8df-4d25-8fc8-c572c935631b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069627 Aug 29 10:39:06.063356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 574/1244] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:05 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:06.105152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:06.120573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c710775-8cb8-4096-93f1-90d550fb4c20 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.521299 Aug 29 10:39:06.148461 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 671/1245] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:05 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:06.166923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.167727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:06.177371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19b0a68b-06a0-479c-b8ad-b3f9200817fe tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '.version_select at 0x7f66c6c513a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.183889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.185186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.186227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.188434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.190032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.193218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.230928 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-19b0a68b-06a0-479c-b8ad-b3f9200817fe tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Image not found. Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19b0a68b-06a0-479c-b8ad-b3f9200817fe tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/images/df41fb77-f06e-4027-8b18-f2c24c0b51fb HTTP/1.1 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'df41fb77-f06e-4027-8b18-f2c24c0b51fb'} Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df41fb77-f06e-4027-8b18-f2c24c0b51fb to delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df41fb77-f06e-4027-8b18-f2c24c0b51fb could not be found. Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.235133 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:39:06.240396 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.245439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19b0a68b-06a0-479c-b8ad-b3f9200817fe tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:06.249098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19b0a68b-06a0-479c-b8ad-b3f9200817fe tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/images/df41fb77-f06e-4027-8b18-f2c24c0b51fb" status: 404 len: 62 microversion: 2.1 time: 0.075835 Aug 29 10:39:06.250841 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 672/1246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:06 2022] DELETE /compute/v2.1/images/df41fb77-f06e-4027-8b18-f2c24c0b51fb => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:39:06.261489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.262177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:06.273403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.275212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.275925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.276891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.277652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.278512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.297578 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 HTTP/1.1 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4'} Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:06.299698 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.305193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.307536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:06.308595 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9561299-8871-4a21-aae8-18452658b6f6 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 404 len: 111 microversion: 2.1 time: 0.052610 Aug 29 10:39:06.309692 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 673/1247] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:39:06 2022] DELETE /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:06.318556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.319449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] [instance: 7e2e6676-1451-4d4d-88f2-3500238949f4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:06.326934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.328132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.329123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.330049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.330705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.331302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.351883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] HTTP exception thrown: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Request method failure captured: Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 HTTP/1.1 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbbpRb7FCEJTJPEcBL0Q_guWrQPx7Gnp4GR53tGG5Mvi4k1ZIqQf2FOQ2WzN0emLkaTBhkzRYv3TOusRBsVMW54svy7J_Z0ee4Dm_IM1Z1uaJ0-GaQdCgJB_Kf1mBUs0dizqLENTWTSSZ_xnaLMC6gRAKliP41DoA6bhuTwlxc9OvM Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_881af47bf44a47a4b8161cd378e55839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/881af47bf44a47a4b8161cd378e55839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 881af47bf44a47a4b8161cd378e55839 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b5f92e4798240c3a3c95041dde29e60 Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1049732983-project Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e2e6676-1451-4d4d-88f2-3500238949f4'} Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.354049 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. Aug 29 10:39:06.359677 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:06.362712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] Returning 404 to user: Instance 7e2e6676-1451-4d4d-88f2-3500238949f4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:06.364288 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-93549e29-dbbf-43f0-89e9-deec0857c607 tempest-ImagesOneServerNegativeTestJSON-1049732983 tempest-ImagesOneServerNegativeTestJSON-1049732983-project] 10.222.0.47 "GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4" status: 404 len: 111 microversion: 2.1 time: 0.050350 Aug 29 10:39:06.365819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 674/1248] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:06 2022] GET /compute/v2.1/servers/7e2e6676-1451-4d4d-88f2-3500238949f4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:06.420253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:06.431372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ea1d2240-457f-4838-bc2e-79e3b3787617 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1556 microversion: 2.1 time: 0.270909 Aug 29 10:39:06.432306 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 575/1249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:06 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1556 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:06.452809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:06.453316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:06.461385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.461921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.462582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.463482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:06.464113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:06.464730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:06.868501 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68f706b8-b662-42fe-8fad-a81410dcf2a1 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.419531 Aug 29 10:39:06.877954 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 675/1250] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:39:06 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-interface => generated 285 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:07.013873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:07.014674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:07.026595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.027427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.028090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.029222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.030022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.030742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.075526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:07.077843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:07.087935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.088724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.089775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.090752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.092399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.096572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.146353 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b4b80d5-6ec7-4462-8496-1b422ed4a071 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074369 Aug 29 10:39:07.146997 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 676/1251] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:07 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:07.176229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:07.176857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:07.186183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.186912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.187517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.188933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:07.189606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:07.190296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:07.349570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:07.380805 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-030833be-7635-41e8-91c0-06d993fe1d22 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.370940 Aug 29 10:39:07.384049 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 576/1252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:07 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:07.598224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:07.611727 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6309d86e-d5b6-4e14-b258-b2daa0861788 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.443734 Aug 29 10:39:07.617671 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 677/1253] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:07 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:08.161166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:08.165095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:08.178481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.179799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.184269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.185969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.186470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.186922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.279521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8f2bff7e-f505-41ce-9cce-5d9e1de8caf7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.122170 Aug 29 10:39:08.281971 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 577/1254] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 10:39:08 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:08.416321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:08.421979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:08.433308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.442299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.442881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.443642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.444565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.446486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.637259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:08.642457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:08.659775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.660275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.660729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.661448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.672814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.673343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.860345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:08.869275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ff9b453-0df3-4a15-b63f-0f7b54caf51d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.467272 Aug 29 10:39:08.876301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 678/1255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:08 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:08.882087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d319a64e-826c-4f51-8fb7-bb4993be9a7f", "tag": "a4c764c3-9259-454a-b92a-f18da93414ee"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:08.893646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:08.894375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:08.894994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:08.909802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] Creating event network-changed:a4c764c3-9259-454a-b92a-f18da93414ee for instance d319a64e-826c-4f51-8fb7-bb4993be9a7f on n-h1-854121-10 Aug 29 10:39:08.916527 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-30a28fd8-a96f-4ba3-838e-551954b69ebc req-320523e1-46f3-475f-80f9-27964a9dbc2c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038347 Aug 29 10:39:08.917671 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 679/1256] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.151767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6c51ee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.155894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.156804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.158749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.163473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.165501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.168365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:09.172881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.181487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49c5bee8-f25e-476d-b4c0-4bdb2bf86677 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.552549 Aug 29 10:39:09.182148 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 578/1257] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:08 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:09.208298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:09.222058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-418484d0-daa5-4fec-a5ca-72c0330f92b0 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.302897 Aug 29 10:39:09.223009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 680/1258] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:39:08 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.234998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6ef94c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.238811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.239304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.239745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.240477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.248690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.249379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.285221 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-893ced5b-b899-4625-9ea0-9bc64c3c0845 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.053972 Aug 29 10:39:09.286518 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 579/1259] 10.222.0.47 () {58 vars in 1139 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.298048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6df4550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.302691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.303461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.304878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.306687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.307597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.308427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.337953 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92d85f0a-a18d-4cfa-82c3-550aa109a7c8 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.043683 Aug 29 10:39:09.339701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 681/1260] 10.222.0.47 () {58 vars in 1145 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:39:09.364068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6ed0d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.369483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.370519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.371402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.372491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.373172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.373914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.403915 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a27640d2-e62a-4641-b740-d07295af3e74 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.043672 Aug 29 10:39:09.405023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 580/1261] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.416403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6d99f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.421265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.422014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.422896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.423877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.424889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.425554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.438070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:09.469784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1813c984-6b0c-42ad-9056-8b01e11f8da3 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.058359 Aug 29 10:39:09.478119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 682/1262] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.487465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6ebd8b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.490970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.491486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.492137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.493438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.493438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.494732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.573114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2ecae37-8403-4edf-bba7-68125d7f55f4 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.093942 Aug 29 10:39:09.573986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 581/1263] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.584730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6c0e5e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.611915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.615164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.616116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.659090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.659852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.665045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.718567 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d68bbe4b-956a-4dda-a062-a29ebb0d9b11 tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-h2-854121-10" status: 200 len: 735 microversion: 2.1 time: 0.137944 Aug 29 10:39:09.719636 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 683/1264] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts/n-h2-854121-10 => generated 735 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.729487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Calling method '.version_select at 0x7f66c6f04a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.750043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.750533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.751154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.777597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.778170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.778613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.831709 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b56dc8ee-f92a-4994-b7c5-288d2327d4bb tempest-HostsAdminTestJSON-1968084897 tempest-HostsAdminTestJSON-1968084897-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-h1-854121-10" status: 200 len: 999 microversion: 2.1 time: 0.105601 Aug 29 10:39:09.843289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 582/1265] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/os-hosts/n-h1-854121-10 => generated 999 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:09.896891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:09.897639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:09.904555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.905093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.905574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:09.910955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:09.911526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:09.912104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.220769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:10.223714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:10.224209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:10.240088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.240781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.242555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.243866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.245118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.246023 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1ce1f41-da2f-49c4-bc4c-68a48e8f6d3e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.349691 Aug 29 10:39:10.246201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.251622 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 684/1266] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:09 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:10.512006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:10.521254 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b52e3dc-16a3-4188-804c-7360f8fdddd9 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1503 microversion: 2.1 time: 0.318017 Aug 29 10:39:10.522204 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 583/1267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:10 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:10.544015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "126ece60-851f-43d6-88b6-eed88533fadd"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:10.547334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:10.557799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.566704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.568350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.570288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.572029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.572508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.635372 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Cannot 'attach_volume' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state rescued Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/os-volume_attachments HTTP/1.1 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 74 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: {"volumeAttachment": {"volumeId": "126ece60-851f-43d6-88b6-eed88533fadd"}} Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot 'attach_volume' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state rescued Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '3d50327c-ed07-477a-aec6-424b7178f0b4', 'body': {'volumeAttachment': {'volumeId': '126ece60-851f-43d6-88b6-eed88533fadd'}}} Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 10:39:10.646250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state rescued Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state rescued Aug 29 10:39:10.651692 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:10.653810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 409 to user: Cannot 'attach_volume' instance 3d50327c-ed07-477a-aec6-424b7178f0b4 while it is in vm_state rescued {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:10.654844 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-42928465-85ce-4d1c-9dc8-65424667cabf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.116189 Aug 29 10:39:10.655873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 685/1268] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:39:10 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:39:10.665070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:10.665961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:10.678127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.680430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.681057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.682019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.684525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.690310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.821574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68c90b65-eba5-4336-81fa-1a4cebacf954 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.160656 Aug 29 10:39:10.822498 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 584/1269] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:39:10 2022] POST /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:10.831457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:10.832244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:10.841239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.848512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.849165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:10.850086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:10.851574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:10.852101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:11.271829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:11.274220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:11.288381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:11.289139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:11.290884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:11.291511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:11.293156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:11.294580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:11.295798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:11.296268 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1bb946fc-8500-4b88-b89c-86d298469c4c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1511 microversion: 2.1 time: 0.469302 Aug 29 10:39:11.296866 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 686/1270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:10 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:11.894505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:11.904052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-505d745c-d52b-4abf-9255-4ec71009fc9b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.638783 Aug 29 10:39:11.905529 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 585/1271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:11 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:12.319735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:12.320654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:12.328984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:12.333545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:12.336303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:12.338138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:12.340032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:12.342032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:12.827851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:12.837168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27a2b75f-6a45-4877-81dd-63b6eca990d3 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1511 microversion: 2.1 time: 0.521373 Aug 29 10:39:12.838114 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 687/1272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:12 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:12.930639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:12.935211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:12.943947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:12.947111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:12.947801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:12.948699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:12.949616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:12.950534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:13.143457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:13.156731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1e87d2f-679e-4297-ad8b-77ad23ad4980 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.231416 Aug 29 10:39:13.157406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 586/1273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:12 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:13.862275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:13.863516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:13.873061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:13.876843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:13.878267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:13.879868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:13.880637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:13.883202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:14.091064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:14.101928 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8cb620cc-8dc3-4fda-9586-c2bf1b4c9fb0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1517 microversion: 2.1 time: 0.242794 Aug 29 10:39:14.102519 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 688/1274] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:13 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:14.179598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:14.180159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:14.187708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:14.188207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:14.188649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:14.189363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:14.189847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:14.190281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:14.389686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:14.400054 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d312aedc-e4cf-4751-bd12-2242eaeb507d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.224673 Aug 29 10:39:14.400889 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 587/1275] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:14 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:14.669152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ec77ecd-e3f5-47c4-9766-f860397fc90c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6ccb4c0>, body: {"keypair": {"name": "tempest-keypair-1435064962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjosdfuN6le+jRqjtS6FAqetD9d1T70+TOKk6+gdIYEWxeEIk2M/ys7VT4edid1ZG//TobY4M+6bXQN4zhKJIMxqPrYouWBPDx20jq6nG4iQHMrGYFrTZfsXG/IRRIHpQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:14.686884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3ec77ecd-e3f5-47c4-9766-f860397fc90c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:14.692427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3ec77ecd-e3f5-47c4-9766-f860397fc90c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:14.719936 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ec77ecd-e3f5-47c4-9766-f860397fc90c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.485640 Aug 29 10:39:14.720812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 689/1276] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:14.734452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-679ef5a6-1497-4e7d-950e-32d20c69b61c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6e30310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:14.739138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d30a8b7-c2dc-4658-a593-23f5d846ed9e tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] Action: 'create', calling method: .version_select at 0x7f66c6e9c3a0>, body: {"security_group": {"name": "tempest-securitygroup-1075086926", "description": "tempest-description-1212383042"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:14.750563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-679ef5a6-1497-4e7d-950e-32d20c69b61c tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1435064962" status: 200 len: 498 microversion: 2.1 time: 0.022206 Aug 29 10:39:14.751517 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 690/1277] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:39:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1435064962 => generated 498 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:14.762507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc503e8a-7824-4dd1-b018-1441566cabb3 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c7bf8280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:14.791706 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc503e8a-7824-4dd1-b018-1441566cabb3 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435064962" status: 202 len: 0 microversion: 2.1 time: 0.033115 Aug 29 10:39:14.792714 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 691/1278] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435064962 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:14.807979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25b9530a-2e73-4e86-854d-0ebffbb60c33 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6e7bdc0>, body: {"keypair": {"name": "tempest-keypair-1676650442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh7OEljb82aQmHNGjthYxxxEsy9gx6z3q7SFL+jSCafPzPCrV2HgMEKid7ujsw1ES+fStv84CEzK/Q0SaEsZBGnX9O778C0+JriyimcHklHoIJV0DElqlhl48RuVVSn8A=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:14.825100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-25b9530a-2e73-4e86-854d-0ebffbb60c33 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:14.837495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-25b9530a-2e73-4e86-854d-0ebffbb60c33 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:14.876130 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25b9530a-2e73-4e86-854d-0ebffbb60c33 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072837 Aug 29 10:39:14.883585 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 692/1279] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:14.890313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b17e909-10f6-4fa9-be6f-78bc40f4d79f tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6e37b80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:14.919079 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b17e909-10f6-4fa9-be6f-78bc40f4d79f tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676650442" status: 202 len: 0 microversion: 2.1 time: 0.033972 Aug 29 10:39:14.924499 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 693/1280] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676650442 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:14.932536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7e58e477-3b73-40ec-a879-92af2138fc58 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6decca0>, body: {"keypair": {"name": "tempest-keypair-276375981", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:14.970448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7e58e477-3b73-40ec-a879-92af2138fc58 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:14.977850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7e58e477-3b73-40ec-a879-92af2138fc58 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:15.028673 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7e58e477-3b73-40ec-a879-92af2138fc58 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.102658 Aug 29 10:39:15.036382 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 694/1281] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:14 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:15.043485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-073e8fb9-44a7-43ee-94ad-198f27b9a817 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6e8e1f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.084019 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-073e8fb9-44a7-43ee-94ad-198f27b9a817 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276375981" status: 202 len: 0 microversion: 2.1 time: 0.045786 Aug 29 10:39:15.086307 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 695/1282] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276375981 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:15.103555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a44439d-1377-4807-a76d-3aa8127c5c15 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6e7b0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1470726531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFhCfw+C/NH68EMOIgPDDZEbV3kSmdY+u1oCFvp1LHpGM4MsexB7VeofGqlxl3YTnQcqkT4BMRhYTHvEcJW0k1I+Tq8ws7z/w/W0XSRaROokHNT+CCXN2QZdCGVIVDZMA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:15.110505 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d30a8b7-c2dc-4658-a593-23f5d846ed9e tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.563279 Aug 29 10:39:15.112187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 588/1283] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:39:14 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:15.126485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce5c2dbe-fe46-4818-bad1-aa39d22cd80f tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] Action: 'create', calling method: .version_select at 0x7f66c6e9cf70>, body: {"security_group": {"name": "tempest-securitygroup-1758892924", "description": "tempest-description-1895144034"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:15.126657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6a44439d-1377-4807-a76d-3aa8127c5c15 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:15.132534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6a44439d-1377-4807-a76d-3aa8127c5c15 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:15.166674 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a44439d-1377-4807-a76d-3aa8127c5c15 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.073365 Aug 29 10:39:15.175536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 696/1284] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:15.181866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b600c355-17e6-4ae1-b7c3-82ca766cce63 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6e07d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1846712635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPF7DbLdwUKTC6SThJug4tTnIaacq1JiP0fcnqyRp6n/9wvgzrPn8sQuQA8C3rY0hnIb0G3guJnzFIqvzoWx2gzhOPpNxq9Hb4C/NLR+2hHWqA1g7pnxUe/THSYsUJJXRA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:15.199185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b600c355-17e6-4ae1-b7c3-82ca766cce63 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:15.205215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b600c355-17e6-4ae1-b7c3-82ca766cce63 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:15.259102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b600c355-17e6-4ae1-b7c3-82ca766cce63 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.079578 Aug 29 10:39:15.268697 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 697/1285] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:15.277196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2144f856-49db-41a4-a5dd-1dced2a003ad tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Action: 'create', calling method: .version_select at 0x7f66c6e7bb80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1486598757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNL6KGPShD1ozZQr87EVC7sxEQ95nX4JUn33V+AtBBQuMmxNliwzDWiHbTEFKGiVOZYJBpbnrp98Ni7RKgr6s0bXPxKeV6pY775pLeNJvzRH3VG1flpKBLn8+t2qWSxDA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:15.287407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:15.318560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2144f856-49db-41a4-a5dd-1dced2a003ad tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:15.338906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2144f856-49db-41a4-a5dd-1dced2a003ad tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Getting quotas for user cf7a5c93a8f0471bbab408f2ad920d9c and project 0101d20726a94bfd9848911fcde5c6d7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:15.375929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce5c2dbe-fe46-4818-bad1-aa39d22cd80f tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.253140 Aug 29 10:39:15.385744 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 589/1286] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:15.428127 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2144f856-49db-41a4-a5dd-1dced2a003ad tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.156891 Aug 29 10:39:15.430852 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 698/1287] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:15.436874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.437684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:15.447267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:15.447267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:15.447267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:15.448005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:15.448513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:15.448951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:15.481858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56957139-ee76-4377-8092-9b0753125c87 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] Action: 'create', calling method: .version_select at 0x7f66c6e97700>, body: {"security_group": {"name": "tempest-securitygroup-1877655489", "description": "tempest-description-232092512"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:15.656327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:15.665725 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c97b527a-d460-44af-8f3b-f43b943af695 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.233314 Aug 29 10:39:15.666535 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 699/1288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:15 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:15.671203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c64d8ad-9f5d-48f9-9672-1b944d020d5b tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6e30670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.675088 n-d-854121-10 devstack@n-api.service[128681]: WARNING oslo_db.sqlalchemy.utils [None req-0c64d8ad-9f5d-48f9-9672-1b944d020d5b tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:39:15.681909 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c64d8ad-9f5d-48f9-9672-1b944d020d5b tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.014525 Aug 29 10:39:15.682876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 700/1289] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:39:15 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:15.693340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e45bc60-007e-469b-8dba-81d35260b73d tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6e8ed30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.714118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e45bc60-007e-469b-8dba-81d35260b73d tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1486598757" status: 202 len: 0 microversion: 2.1 time: 0.024626 Aug 29 10:39:15.718056 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 701/1290] 10.222.0.47 () {58 vars in 1278 bytes} [Mon Aug 29 10:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1486598757 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:39:15.722999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a182830-9c70-48cc-9d21-a2bb4fc7e306 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6d99b80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.745892 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a182830-9c70-48cc-9d21-a2bb4fc7e306 tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846712635" status: 202 len: 0 microversion: 2.1 time: 0.026474 Aug 29 10:39:15.746797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 702/1291] 10.222.0.47 () {58 vars in 1278 bytes} [Mon Aug 29 10:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846712635 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:15.756002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5985123-af34-4030-8878-ff349645ed2e tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] Calling method '.version_select at 0x7f66c6c0e820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:15.782360 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5985123-af34-4030-8878-ff349645ed2e tempest-KeyPairsV2TestJSON-358067716 tempest-KeyPairsV2TestJSON-358067716-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1470726531" status: 202 len: 0 microversion: 2.1 time: 0.029746 Aug 29 10:39:15.783075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 703/1292] 10.222.0.47 () {58 vars in 1278 bytes} [Mon Aug 29 10:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1470726531 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:15.874467 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56957139-ee76-4377-8092-9b0753125c87 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.486534 Aug 29 10:39:15.875399 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 590/1293] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:15.889358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24cda5a5-af7b-469e-b76c-f79c44690919 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] Action: 'create', calling method: .version_select at 0x7f66c6d99940>, body: {"security_group": {"name": "tempest-securitygroup-1932168231", "description": "tempest-description-1356210247"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:16.056190 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24cda5a5-af7b-469e-b76c-f79c44690919 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.171539 Aug 29 10:39:16.057027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 704/1294] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:39:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:16.069080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f5d27a0-d1fb-4430-af73-92f872a2a3ef tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] Calling method '.version_select at 0x7f66c6f53d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:16.377253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:16.378037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:16.389085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:16.389682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:16.390538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:16.391502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:16.391977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:16.392413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:16.611106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d1bc277-802f-4e6f-a806-a2a7e9e8cff6 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1860 microversion: 2.1 time: 0.237475 Aug 29 10:39:16.612314 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 705/1295] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:16 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1860 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:16.635976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:16.651885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:16.664108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:16.664654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:16.665118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:16.670465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:16.670986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:16.671444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:16.706742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lazy-loading 'flavor' on Instance uuid 635c5b3a-b42f-4389-900b-5fd986b96a5e {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:39:16.724638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Going to try to live migrate instance to n-h1-854121-10 {{(pid=128681) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:39:18.086329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65081573-1649-40fd-b942-8db5793cdd9e tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/action" status: 202 len: 0 microversion: 2.1 time: 1.456134 Aug 29 10:39:18.087897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 706/1296] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:39:16 2022] POST /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/action => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:18.093092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72726538-5a94-4c36-b57b-a56b8be373b8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: .version_select at 0x7f66c6e07ca0>, body: {"keypair": {"name": "tempest-keypair-1953310974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5FhQKrcNyJQUZGO2ojvcCtV6C5JfbgEZNMJz1PpkaXSuRnFgSsrWbzsKNJxSoh/P23yejIt/1TCeUuFexCBlNYFYFNVvKCnIBoyZwVTeHCuugS9MYcnhfig2xOGbUhrg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:18.127865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-72726538-5a94-4c36-b57b-a56b8be373b8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for project 0be9d74a565a43c5987663c472a656ec. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:18.135277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-72726538-5a94-4c36-b57b-a56b8be373b8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for user 78cba28ccfd244dba6e46f23d7ef35f4 and project 0be9d74a565a43c5987663c472a656ec. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:18.185878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72726538-5a94-4c36-b57b-a56b8be373b8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096825 Aug 29 10:39:18.192092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 707/1297] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:18.192092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:18.192638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:18.199972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:18.201779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:18.202593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:18.203347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:18.203806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:18.204240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:18.470236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:18.483792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be461640-810a-48bd-9017-d147ae2f1972 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.293753 Aug 29 10:39:18.484684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 708/1298] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:18 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:18.768665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c34da244-096e-45f1-84c7-437bb023d347 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6c51940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm3r9pHVlQ1+1De/KsK7S5od9xsja6vzDBKfdOb7mBDEIcjUtOVg1OzPTFVok9+EVfT2xNDRXH7EKydMucB8++YzKqnKOrc0vMAeZkkDfXIn831cT8kwc5wgDkqODagOw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c34da244-096e-45f1-84c7-437bb023d347 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 257 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm3r9pHVlQ1+1De/KsK7S5od9xsja6vzDBKfdOb7mBDEIcjUtOVg1OzPTFVok9+EVfT2xNDRXH7EKydMucB8++YzKqnKOrc0vMAeZkkDfXIn831cT8kwc5wgDkqODagOw=="}} Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm3r9pHVlQ1+1De/KsK7S5od9xsja6vzDBKfdOb7mBDEIcjUtOVg1OzPTFVok9+EVfT2xNDRXH7EKydMucB8++YzKqnKOrc0vMAeZkkDfXIn831cT8kwc5wgDkqODagOw=='}}} Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 29 10:39:18.776697 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 10:39:18.781610 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:18.788552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c34da244-096e-45f1-84c7-437bb023d347 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:18.789880 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c34da244-096e-45f1-84c7-437bb023d347 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.288572 Aug 29 10:39:18.795240 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 709/1299] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:18 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:39:18.805635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:18.809917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:18.823803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:18.824303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:18.826915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:18.827674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:18.828149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:18.828584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:19.437205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:19.523630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:19.530692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:19.539580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ea4fb49-eddb-4519-92f9-1507c0d6accb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.741497 Aug 29 10:39:19.542572 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 710/1300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:18 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:19.556379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6e7b160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-785819093", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:19.620571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:19.628788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for user 54fae367b71c48ba8f8eea4362bc8b94 and project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:19.662062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 2166 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-785819093", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:19.701424 n-d-854121-10 devstack@n-api.service[128681]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-785819093', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:19.704055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de08e755-f9c9-4d61-93b7-6498e982f2c1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.159581 Aug 29 10:39:19.717317 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 711/1301] 10.222.0.47 () {60 vars in 1160 bytes} [Mon Aug 29 10:39:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:39:19.730918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f5d27a0-d1fb-4430-af73-92f872a2a3ef tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] 10.222.0.47 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14289 microversion: 2.1 time: 3.655495 Aug 29 10:39:19.742719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:19.742719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:19.742986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 591/1302] 10.222.0.47 () {58 vars in 1191 bytes} [Mon Aug 29 10:39:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14289 bytes in 3667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:39:19.751175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae189ed4-3772-4bfe-94b2-cf6f05e02545 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6f04c10>, body: {"keypair": {"name": "tempest-keypair-51619138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ5S2+RBZ+vwbb0gYDHP2n8PYDpD2Ao+zSO5962npnBISh3b0GNIiBDCzyoTGldlZtbzS4KfdARAyza86Z37+HJiFWF3HYfyWCIpxq1/zVWCzgppHpfNz5vqzihHL0vVg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:19.777198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:19.780222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:19.781666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:19.786202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:19.786713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:19.787170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:19.798026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ae189ed4-3772-4bfe-94b2-cf6f05e02545 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:19.809189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ae189ed4-3772-4bfe-94b2-cf6f05e02545 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for user 54fae367b71c48ba8f8eea4362bc8b94 and project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:19.889207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae189ed4-3772-4bfe-94b2-cf6f05e02545 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.143474 Aug 29 10:39:19.891321 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 592/1303] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:19.898838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-363d49a9-f3ea-4c02-9516-4a7724eb14d7 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] Calling method '.version_select at 0x7f66c6e74040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:20.141433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:20.154002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54f3c71f-ac8c-4aee-ab0e-632f91af235c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.449015 Aug 29 10:39:20.157380 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 712/1304] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:19 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:20.173102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6e07d30>, body: {"keypair": {"name": "tempest-keypair-51619138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB/Q5yWAJ6s4VkK0JHoqFh6WQDd+tmm9h3WzMGEiw1WswFSz2rmtcKOXC2tTXRaO8PTh1aeqNOqps6qUzb2BJFcSXIiCRwHBUyrLFpcUyWuulnn4wl2wKRIDcFNwJGIEQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.196237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:20.204718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for user 54fae367b71c48ba8f8eea4362bc8b94 and project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:20.239329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] HTTP exception thrown: Key pair 'tempest-keypair-51619138' already exists. Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 271 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "tempest-keypair-51619138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB/Q5yWAJ6s4VkK0JHoqFh6WQDd+tmm9h3WzMGEiw1WswFSz2rmtcKOXC2tTXRaO8PTh1aeqNOqps6qUzb2BJFcSXIiCRwHBUyrLFpcUyWuulnn4wl2wKRIDcFNwJGIEQ=="}} Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: exception: Key pair 'tempest-keypair-51619138' already exists. Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-51619138', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB/Q5yWAJ6s4VkK0JHoqFh6WQDd+tmm9h3WzMGEiw1WswFSz2rmtcKOXC2tTXRaO8PTh1aeqNOqps6qUzb2BJFcSXIiCRwHBUyrLFpcUyWuulnn4wl2wKRIDcFNwJGIEQ=='}}} Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '54fae367b71c48ba8f8eea4362bc8b94-tempest-keypair-51619138' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 10:39:20.248266 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result.read() Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 10:39:20.253330 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '54fae367b71c48ba8f8eea4362bc8b94-tempest-keypair-51619138' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 10, 39, 20, 225768), 'updated_at': None, 'name': 'tempest-keypair-51619138', 'user_id': '54fae367b71c48ba8f8eea4362bc8b94', 'fingerprint': 'cd:15:87:d0:9a:b0:1e:c3:f0:ce:b5:da:ac:d6:20:96', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB/Q5yWAJ6s4VkK0JHoqFh6WQDd+tmm9h3WzMGEiw1WswFSz2rmtcKOXC2tTXRaO8PTh1aeqNOqps6qUzb2BJFcSXIiCRwHBUyrLFpcUyWuulnn4wl2wKRIDcFNwJGIEQ==', 'type': 'ssh'}] Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi keypair.create() Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._create() Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-51619138' already exists. Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 29 10:39:20.260643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-51619138' already exists. Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-51619138' already exists. Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.269648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 409 to user: Key pair 'tempest-keypair-51619138' already exists. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.272422 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4cb5e02-cb48-4b18-b892-090f0a1e7e01 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.104527 Aug 29 10:39:20.274776 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 713/1305] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:39:20.286666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aaf25f5d-5b88-40a1-9707-f90bde434ef8 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Calling method '.version_select at 0x7f66c6e30310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:20.316402 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aaf25f5d-5b88-40a1-9707-f90bde434ef8 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51619138" status: 202 len: 0 microversion: 2.1 time: 0.037454 Aug 29 10:39:20.318095 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 714/1306] 10.222.0.47 () {58 vars in 1215 bytes} [Mon Aug 29 10:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51619138 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:39:20.333637 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-363d49a9-f3ea-4c02-9516-4a7724eb14d7 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.440030 Aug 29 10:39:20.334357 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 593/1307] 10.222.0.47 () {58 vars in 1191 bytes} [Mon Aug 29 10:39:19 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:20.341903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-531461f0-11b8-4b25-a172-c332f35f7995 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6c0e1f0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKAPpCSbpFonDWnYfZmZvOhjeqC/AeYDNMdjwsVPh680MK4rMmIx8pz4Mb2lZEMvSk5wGsRM15mtBrwi2kPC9Dx6QDGFnw+i9z8T9j3ET8HzIlwIaoBjAJtLgViAXHgEw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.347964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf9fd588-20d8-4b62-9796-6769d4f9a710 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] Calling method '.version_select at 0x7f66c6e71ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-531461f0-11b8-4b25-a172-c332f35f7995 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 247 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKAPpCSbpFonDWnYfZmZvOhjeqC/AeYDNMdjwsVPh680MK4rMmIx8pz4Mb2lZEMvSk5wGsRM15mtBrwi2kPC9Dx6QDGFnw+i9z8T9j3ET8HzIlwIaoBjAJtLgViAXHgEw=="}} Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKAPpCSbpFonDWnYfZmZvOhjeqC/AeYDNMdjwsVPh680MK4rMmIx8pz4Mb2lZEMvSk5wGsRM15mtBrwi2kPC9Dx6QDGFnw+i9z8T9j3ET8HzIlwIaoBjAJtLgViAXHgEw=='}}} Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '' Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:39:20.357503 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-531461f0-11b8-4b25-a172-c332f35f7995 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-531461f0-11b8-4b25-a172-c332f35f7995 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.034729 Aug 29 10:39:20.363058 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 715/1308] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:39:20.374951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6e7ed30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-510966", "public_key": " "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.413728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:20.421176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for user 54fae367b71c48ba8f8eea4362bc8b94 and project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:20.452164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 91 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-510966", "public_key": " "}} Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-510966', 'public_key': ' '}}} Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.456137 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef156350-ca66-4943-a424-59c0fe2cadac tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.089803 Aug 29 10:39:20.460620 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 716/1309] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:39:20.480186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4917fafd-4f85-42c2-a15f-010dfeb1a318 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6e7e9d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0a2r0b3Qf/O84x8eRJhkSH3f65NBjQOuL8Bof+w9M85OyuQqd74C3KF/c0wkjeicDBT68uhIQ2P5C8+bkrd5/yYVTekGArTx/aNMLEhLSv85sBpffeoCOml12EnfS5g=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4917fafd-4f85-42c2-a15f-010dfeb1a318 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 507 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0a2r0b3Qf/O84x8eRJhkSH3f65NBjQOuL8Bof+w9M85OyuQqd74C3KF/c0wkjeicDBT68uhIQ2P5C8+bkrd5/yYVTekGArTx/aNMLEhLSv85sBpffeoCOml12EnfS5g=="}} Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa0a2r0b3Qf/O84x8eRJhkSH3f65NBjQOuL8Bof+w9M85OyuQqd74C3KF/c0wkjeicDBT68uhIQ2P5C8+bkrd5/yYVTekGArTx/aNMLEhLSv85sBpffeoCOml12EnfS5g=='}}} Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 10:39:20.484188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4917fafd-4f85-42c2-a15f-010dfeb1a318 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.490228 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4917fafd-4f85-42c2-a15f-010dfeb1a318 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017844 Aug 29 10:39:20.498548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 717/1310] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:39:20.512249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Action: 'create', calling method: .version_select at 0x7f66c6e01670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-499728320", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.530123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:20.536388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Getting quotas for user 54fae367b71c48ba8f8eea4362bc8b94 and project a042c982f8c34d17b8329c5cb2e9523a. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:20.555991 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 117 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-499728320", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-499728320', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 10:39:20.558206 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 10:39:20.563027 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.566374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.567409 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e787da23-a881-4bc8-bd3b-7cdf6ee768ef tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.059682 Aug 29 10:39:20.568503 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 718/1311] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 10:39:20.576059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:20.576688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:20.583388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:20.583883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:20.584321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:20.585992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:20.586709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:20.587331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:20.728128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf9fd588-20d8-4b62-9796-6769d4f9a710 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/d2a3c4b5-08b9-4806-beef-74b40826b3cb" status: 202 len: 0 microversion: 2.1 time: 0.383932 Aug 29 10:39:20.729427 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 594/1312] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:39:20 2022] DELETE /compute/v2.1/os-security-groups/d2a3c4b5-08b9-4806-beef-74b40826b3cb => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:20.735946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-491ff492-4219-43aa-ae14-fead108ae1a1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Calling method '.version_select at 0x7f66c6e71670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:20.754821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-491ff492-4219-43aa-ae14-fead108ae1a1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-491ff492-4219-43aa-ae14-fead108ae1a1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Request method failure captured: Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-950481245 HTTP/1.1 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJdVlWqpfnDQ5xCVa5wxTS6hFUe-uWAzfwK-dxSdfQRgpvGIgamtUvJ9ePn3mdQhbEscchDp_xqwqBhZ2_VArI17VsYIGlPUiOsreirbNSBV_2gZLMsrByO-7yYxqRB4eQzmI1ZReM7THRQQ6HMFJxiv-kAkEM7BBaOPezC-hSRpCpg Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a042c982f8c34d17b8329c5cb2e9523a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: a042c982f8c34d17b8329c5cb2e9523a Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886666748 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886666748-project Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: exception: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'tempest-keypair-non-existent-950481245'} Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.759106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 Aug 29 10:39:20.764146 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:20.767923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-491ff492-4219-43aa-ae14-fead108ae1a1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] Returning 404 to user: Keypair tempest-keypair-non-existent-950481245 not found for user 54fae367b71c48ba8f8eea4362bc8b94 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:20.769722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-491ff492-4219-43aa-ae14-fead108ae1a1 tempest-KeyPairsNegativeTestJSON-886666748 tempest-KeyPairsNegativeTestJSON-886666748-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-950481245" status: 404 len: 144 microversion: 2.1 time: 0.038425 Aug 29 10:39:20.771123 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 595/1313] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 10:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-950481245 => generated 144 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:20.777875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:20.786964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08ca685c-9dfa-48fc-aa30-e13514a0258f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.216554 Aug 29 10:39:20.787556 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 719/1314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:20 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:20.802339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-185894118", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "091704cf-acbc-40d5-9973-35e52136f451"}], "security_groups": [{"name": "tempest-securitygroup--313010387"}], "key_name": "tempest-keypair-1953310974", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:20.810019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2daf3edc-8da3-4eea-ba42-5f79456e6055 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] Calling method '.version_select at 0x7f66c6e7e3a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:21.060087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] validate_networks() for [('091704cf-acbc-40d5-9973-35e52136f451', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:39:21.092764 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2daf3edc-8da3-4eea-ba42-5f79456e6055 tempest-SecurityGroupsTestAdminJSON-408746062 tempest-SecurityGroupsTestAdminJSON-408746062-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0123442a-3733-4ab7-8496-961b641b007e" status: 202 len: 0 microversion: 2.1 time: 0.287135 Aug 29 10:39:21.097209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 720/1315] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:39:20 2022] DELETE /compute/v2.1/os-security-groups/0123442a-3733-4ab7-8496-961b641b007e => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:21.106272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad22ae8-dab0-45a1-b6d0-b5aac3b58941"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:21.112415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:21.129027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:21.130143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:21.130854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:21.133320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:21.134637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:21.135907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:21.520010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:21.575056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-743ed564-9c23-41c1-8834-75f05c070c6d tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "POST /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475787 Aug 29 10:39:21.577481 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 721/1316] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:39:21 2022] POST /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:21.593180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d18647fb-8c62-4227-a9e0-eed1d2de0759 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] Calling method '.version_select at 0x7f66c6c513a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:21.816844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:39:21.817684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:39:21.818544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:39:21.819587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:39:21.820105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:39:21.841824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:21.842552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:21.844563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:21.845486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:21.847169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:21.849187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:21.893048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:21.910894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Getting quotas for user 78cba28ccfd244dba6e46f23d7ef35f4 and project 0be9d74a565a43c5987663c472a656ec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:21.936917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:39:21.939321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:39:21.967515 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d18647fb-8c62-4227-a9e0-eed1d2de0759 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/99aefabe-5cfb-4426-9a89-5d0d8774bcb9" status: 202 len: 0 microversion: 2.1 time: 0.384948 Aug 29 10:39:21.968181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 722/1317] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:39:21 2022] DELETE /compute/v2.1/os-security-groups/99aefabe-5cfb-4426-9a89-5d0d8774bcb9 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:21.973657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:21.974668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:22.006706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:22.008980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:22.009521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:22.010048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:22.010769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:22.013177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:22.013641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:22.052321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:22.089919 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a1d320a-f8d0-424e-b4e2-a3682196dc24 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.317364 Aug 29 10:39:22.093134 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 596/1318] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:39:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:39:22.100196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:22.112208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:22.123110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:22.127014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:22.127647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:22.128577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:22.132471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:22.133109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:22.342693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:22.363502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce807cbc-1033-4ea3-94e1-173d58b61c16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.392102 Aug 29 10:39:22.364357 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 723/1319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:21 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:22.376459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-381202c9-508c-499f-886a-6fe30e888047 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] Calling method '.version_select at 0x7f66c6d99820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:22.508634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:22.521393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed6c555a-266b-4974-afed-3c5b45088b76 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.423634 Aug 29 10:39:22.523987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 597/1320] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:22 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:22.535578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34daf74c-21de-4dae-8885-b2e3e5513e3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:22.536691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34daf74c-21de-4dae-8885-b2e3e5513e3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:22.646689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34daf74c-21de-4dae-8885-b2e3e5513e3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:22.666605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34daf74c-21de-4dae-8885-b2e3e5513e3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1245 microversion: 2.1 time: 0.131785 Aug 29 10:39:22.675486 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 598/1321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:22 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:22.814812 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-381202c9-508c-499f-886a-6fe30e888047 tempest-SecurityGroupsTestAdminJSON-1468335292 tempest-SecurityGroupsTestAdminJSON-1468335292-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/90c2a76a-cdb7-4955-a1ef-2d43c2abf281" status: 202 len: 0 microversion: 2.1 time: 0.444754 Aug 29 10:39:22.822851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 724/1322] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:39:22 2022] DELETE /compute/v2.1/os-security-groups/90c2a76a-cdb7-4955-a1ef-2d43c2abf281 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:23.382431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:23.384465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.384943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.385376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.386125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.386566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.386984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.390497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:23.391126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:23.400046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.400546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.400982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.401724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.402182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.402842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.465803 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af7eccef-4ebf-4820-b06d-e12fc9de9bbd tempest-AZV2TestJSON-299590420 tempest-AZV2TestJSON-299590420-project] 10.222.0.47 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.269021 Aug 29 10:39:23.469564 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 599/1323] 10.222.0.47 () {58 vars in 1164 bytes} [Mon Aug 29 10:39:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:39:23.546207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:23.547094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:23.555733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.559087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.566176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.567064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.567543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.568009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.718364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:23.726890 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03664211-87fc-43f1-ab40-a4a0a24ace7b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.342234 Aug 29 10:39:23.728131 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 725/1324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:23 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:23.733797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:23.734725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:23.748488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.751572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.752141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.753128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:23.756337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:23.760002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:23.890130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:23.903485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b0b4f0fd-7cef-4490-8dcf-e2ea47ea9208 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.359806 Aug 29 10:39:23.907437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 600/1325] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:23 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:23.939861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:23.970244 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b445f9f6-229e-49b9-b43a-808e6dece986 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1297 microversion: 2.1 time: 0.240757 Aug 29 10:39:23.971254 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 726/1326] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:23 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1297 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:24.747852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:24.749003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:24.766655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:24.767640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:24.768088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:24.768797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:24.769420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:24.770000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:24.774646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:24.931492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:24.932753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:24.941499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:24.942840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:24.943683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:24.945318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:24.946367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:24.947341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:25.212836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:25.226004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-212a580c-9228-436c-b0f4-d93e9a85799c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.480088 Aug 29 10:39:25.238385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 601/1327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:24 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:25.247255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:25.248191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:25.261062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:25.261995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:25.263816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:25.264672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:25.266354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:25.267070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:25.268743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:25.284946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee0b3051-6d4a-413f-946b-77ce87603de0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.353593 Aug 29 10:39:25.287257 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 727/1328] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:24 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:25.424381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:25.432255 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd86274e-1a7e-4c38-8dd1-0154be27b044 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1303 microversion: 2.1 time: 0.190801 Aug 29 10:39:25.432830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 602/1329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:25 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:26.248481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:26.249113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:26.263768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.264279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.268734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:26.270683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.271182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.272032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:26.308466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:26.309234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:26.329209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.332202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.334605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:26.338963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.342451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.347684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:26.808568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:26.822507 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3769fc5-a89f-4e38-95ab-13980af93287 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.577970 Aug 29 10:39:26.826880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 728/1330] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:26 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:26.843279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:26.844891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:26.855218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:26.873386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dcf5e63e-d175-4d9f-a0a1-43b26c10c4c1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.567798 Aug 29 10:39:26.876181 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 603/1331] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:26 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:26.878760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.880385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.881846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:26.883149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:26.883866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:26.884515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:27.148004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:27.156469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d5ab736-7890-4730-996e-1e94fe297861 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.326748 Aug 29 10:39:27.158836 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 729/1332] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:26 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:27.816980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:27.830263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:27.836612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:27.837305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:27.856910 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] Creating event network-changed:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:39:27.867531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-523922355", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:27.883226 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-81937b5b-df07-4082-84c8-7718a3e6286c req-7a8a6603-4a69-4688-b7bc-b238890c8c71 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428791 Aug 29 10:39:27.889812 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 604/1333] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:27.895629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:27.901767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:27.908778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:27.910098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:27.910780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:27.911744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:27.912421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:27.913537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:27.975646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:39:28.287159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:39:28.288645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:39:28.289442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:39:28.290130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:39:28.290765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:39:28.301967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.302806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.303481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:28.305127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.305843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.306452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:28.329220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Getting quotas for project 25b373ca0e054ebe812717ba13b2b899. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:28.336294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Getting quotas for user 92b7c1ee59144b229a2b5d246b74973b and project 25b373ca0e054ebe812717ba13b2b899. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:28.351436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:39:28.354299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:39:28.464324 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8021b31-e7c6-4f11-af16-26309eeabc79 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742602 Aug 29 10:39:28.465728 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 730/1334] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:39:28.482551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:28.490679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:28.496870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4907ae6e-effe-4426-b08e-dc9c587548f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.605249 Aug 29 10:39:28.498067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:28.498293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 605/1335] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:27 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:28.516861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.519294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.521460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:28.522572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.524185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.526381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:28.530394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:28.533504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:28.550016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.553095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.555837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:28.557848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:28.558888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:28.560130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:29.003527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:29.018584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb4571a0-ef00-415c-b742-59406eec67bb tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.518922 Aug 29 10:39:29.055236 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 606/1336] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:28 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:29.080551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:29.086367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7194f8ad-e4a7-4f1a-a277-756d4886123f tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:29.093857 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bcbb6d33-ccbe-4390-b5e6-20810138c4a5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.616988 Aug 29 10:39:29.098267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7194f8ad-e4a7-4f1a-a277-756d4886123f tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:29.109990 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 731/1337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:28 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:29.242556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7194f8ad-e4a7-4f1a-a277-756d4886123f tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:29.250436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7194f8ad-e4a7-4f1a-a277-756d4886123f tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1222 microversion: 2.1 time: 0.191475 Aug 29 10:39:29.252694 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 607/1338] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:29 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:29.522397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:29.523554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:29.549325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:29.554310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:29.554798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:29.555653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:29.556124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:29.556551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:29.883849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:29.895587 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06f697fb-8f20-4258-9b82-7546b3b4448b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.380289 Aug 29 10:39:29.896830 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 732/1339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:29 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:30.041928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:30.043194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:30.059091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.060371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.066010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.067434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.068127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.068831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.122581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:30.123456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:30.134458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.136734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.142277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.147969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.148521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.152800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.870507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:30.884458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50ca49e0-5fd6-4536-ace8-7ff3e9e21f5c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.770541 Aug 29 10:39:30.886499 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 733/1340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:30 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:30.901656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:30.902757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:30.911241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.911241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.914217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.915036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:30.915716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:30.916326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:30.946497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:30.956855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d279aea3-c995-47c1-83ec-38d74d4d3d8f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.918761 Aug 29 10:39:30.960797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 608/1341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:30 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:30.987255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:30.992629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:31.004976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:31.010483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:31.011155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:31.012212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:31.012835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:31.024667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:31.456168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:31.470108 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec861ba4-5fab-41ec-aa43-bb5544683f58 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1282 microversion: 2.1 time: 0.581533 Aug 29 10:39:31.470719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 734/1342] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:30 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1282 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:31.734324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:31.753371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-63e32573-3770-48ca-b9f2-9922ff0ff86d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.790858 Aug 29 10:39:31.754545 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 609/1343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:30 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:31.909628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:31.910282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:31.933794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:31.934304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:31.934771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:31.935580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:31.936039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:31.936540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:31.994909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:31.995466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:32.023187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:32.023699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:32.024144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:32.024871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:32.025323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:32.025772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:32.882359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:32.895399 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb54b4b8-9965-4290-aeec-4809bd7acf05 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.905962 Aug 29 10:39:32.897573 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 610/1344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:31 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:32.910535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:32.910535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:32.934639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:32.937902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:32.938371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:32.939130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:32.939596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:32.942894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:33.090494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:33.104322 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2eff52b3-ef8a-4f11-915b-459d1ebf58a8 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 1.199686 Aug 29 10:39:33.104942 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 735/1345] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:31 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:33.127268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:33.129546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:33.150165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:33.150913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:33.151689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:33.152581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:33.153587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:33.154586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:33.416840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:33.434097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:33.447824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae981b84-701e-471d-ba2f-aac736f0a160 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.547032 Aug 29 10:39:33.466769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 611/1346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:32 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:33.608015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:33.627191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d27d60e-d416-40a9-bd3f-ae089cbf4c4e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.511328 Aug 29 10:39:33.627871 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 736/1347] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:33 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:33.920886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:33.922355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:33.930743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:33.931681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:33.932838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:33.937121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:33.939468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:33.940159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.127467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:34.128080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:34.143270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.143765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.144201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.144921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.145374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.163439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.336144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:34.346635 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c520c181-69dc-43ae-aa7d-9cf7a6b623a2 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.431477 Aug 29 10:39:34.367864 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 612/1348] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:33 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:34.468378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:34.469882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:34.481324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.482663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.491095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.501963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.504966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.505653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.762891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:34.771260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5a576ed-e0e9-49e8-8cdd-562005bc32f5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.647608 Aug 29 10:39:34.780939 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 737/1349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:34 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:34.806324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40bcfdc6-677f-41e0-8e7a-6e9178179aca", "tag": "669f5359-2837-4b79-94bd-1b77e9133fe0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:34.836545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.837046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.837460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.860081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] Creating event network-changed:669f5359-2837-4b79-94bd-1b77e9133fe0 for instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca on n-h2-854121-10 Aug 29 10:39:34.870844 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5d3bd74c-d6e3-48d5-a683-8086768be7b1 req-db1bbf3e-ea66-4bcd-b37d-1e83f9519a54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074446 Aug 29 10:39:34.871763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 738/1350] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:34.876825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:34.877522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:34.902924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.903384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.903823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.904542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:34.904991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:34.905416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:34.972859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:34.986271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c539c3a-a577-4611-8c93-9ee93e4745dd tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.521622 Aug 29 10:39:34.986859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 613/1351] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:34 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:35.117805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90ab5aba-0319-4b2e-bcc3-099a965c86af tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Action: 'create', calling method: .version_select at 0x7f66c6e71c10>, body: {"keypair": {"name": "tempest-keypair-1818058567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxRiufRXfGsn2rfFIFkAHic5QYmgB7oh4/yumPOHbVhQLsAXtfCaJnHmRxjXCW+6lnZdwGs2DX8iEQXzeJXjgKk7U+smbQMtJNtsoz9I1gxdKX5td/FNOxUiNQkbvu4iw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:35.135223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-90ab5aba-0319-4b2e-bcc3-099a965c86af tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for project bf9acc70e7f746889c1533b615510465. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:35.144722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:35.147383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-90ab5aba-0319-4b2e-bcc3-099a965c86af tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for user 6f952170d12540be9a74809c5607e5b7 and project bf9acc70e7f746889c1533b615510465. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:35.153121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b62ab68-102e-4ab6-a994-f4883dc1bceb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1474 microversion: 2.1 time: 0.280152 Aug 29 10:39:35.154272 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 739/1352] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:34 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1474 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:35.182872 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90ab5aba-0319-4b2e-bcc3-099a965c86af tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149993 Aug 29 10:39:35.183725 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 614/1353] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:35.392726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:35.394018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:35.402899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:35.403713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:35.404384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:35.405769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:35.406617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:35.407297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:35.618290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:35.626263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6cc13cf-8ab7-490b-9777-5c0df2749729 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.239101 Aug 29 10:39:35.627098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 740/1354] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:35 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:35.810268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:35.811197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:35.820571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:35.821102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:35.821592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:35.822695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:35.823427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:35.824066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.015525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:36.023283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:36.039375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.040647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.041331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.042298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.043735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.045608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.104804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:36.235811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:36.293831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-669535fc-9747-4187-8f13-9b845905efe7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.465652 Aug 29 10:39:36.295827 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 615/1355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:35 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:36.325606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:36.330275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:36.355289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.371650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.373587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.375424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.376294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.378029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.737264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:36.764478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef5cf946-aa66-480c-9786-d07acf5d01ab tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.754563 Aug 29 10:39:36.766392 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 741/1356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:36 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:36.782470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:36.784654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:36.803978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.804774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.805224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.816535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.817128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.817586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.854013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:36.867566 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a9df75a-dfe3-4d79-adde-9de2915120d9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1473 microversion: 2.1 time: 0.568758 Aug 29 10:39:36.876411 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 616/1357] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:36 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1473 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:36.885819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "name": "network-vif-plugged", "status": "completed", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:36.898244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:36.899198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:36.899851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:36.913291 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] Creating event network-vif-plugged:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:39:36.921385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2443d8f7-4c50-4008-9e01-1e520e42fe4a req-81613fa8-a98a-47fe-9e75-28bddf62b1b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043269 Aug 29 10:39:36.922397 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 617/1358] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:37.035316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:37.044828 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41c5c518-3474-4269-921a-adc01a72fc8c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.276833 Aug 29 10:39:37.046898 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 742/1359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:36 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:37.322400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:37.323696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:37.331245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.331728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.332368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:37.333283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.334010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.335898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:37.546428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:37.556641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4863ae93-33ed-4984-baf9-31a33173d0b4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.239815 Aug 29 10:39:37.570677 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 618/1360] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:37 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:37.793116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:37.793823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:37.806405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.807869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.809509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:37.811285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.811757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.812486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:37.889212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:37.889847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:37.898759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.899248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.899681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:37.904846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:37.905319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:37.906773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:38.233483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:38.242644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7ff0671-b1c3-4ed8-b8d4-613505284460 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.453871 Aug 29 10:39:38.262208 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 743/1361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:37 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:38.268330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:38.268965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:38.286346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:38.286865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:38.287353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:38.288103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:38.288571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:38.288999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:38.319825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:38.344544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=50 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:38.861631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:38.873966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f92cd0d-4bff-49e5-bee8-6304b97b62dd tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1473 microversion: 2.1 time: 0.988782 Aug 29 10:39:38.888691 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 619/1362] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:37 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1473 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:38.896921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-358648080", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "216ce7f7-153f-4fc4-88fa-0b56f8f31bc3"}], "block_device_mapping_v2": [{"uuid": "d4e1ab66-7bab-4d8f-85f0-ec6168668950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:38.981908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] validate_networks() for [('216ce7f7-153f-4fc4-88fa-0b56f8f31bc3', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:39:39.101013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:39.119980 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb0f14cc-26c7-4fa1-bd13-eac15d212abc tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1370 microversion: 2.1 time: 0.856523 Aug 29 10:39:39.140775 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 744/1363] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:38 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1370 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:39.151885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:39.152762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:39.163620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:39.164505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:39.165323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:39.166281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:39.166913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:39.167516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:39.690229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:39.702610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03a7699a-1ae0-4063-a6b0-11d2d69b8d56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.558694 Aug 29 10:39:39.703751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 745/1364] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:39 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:39.709077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:39.710047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:39.717532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:39.718631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:39.719251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:39.720388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:39.721019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:39.721609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.132487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:40.150785 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50469c99-92c1-444c-acf6-86e63d6fafc7 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.445524 Aug 29 10:39:40.151903 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 746/1365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:39 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:40.159089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:40.159931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:40.170957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.171926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.172620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.173540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.174178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.175070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.388392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:39:40.389638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:39:40.390413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:39:40.391903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:39:40.393214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:39:40.406642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.407352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.410313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.413948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.415203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.416180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.462930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:40.470001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Getting quotas for user ad7622f1f2834d1e9171f6525f0e6481 and project 4c4d81dd195c4af6b439b88f621def9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:40.523316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:40.538651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96d64bbd-e85d-491a-a27a-f7d0f36daeda tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1473 microversion: 2.1 time: 0.383477 Aug 29 10:39:40.554783 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 747/1366] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:40 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:40.560566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:40.561390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:40.569168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.569996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.571007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.572103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:40.572733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:40.573318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:40.600556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:39:40.603248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4e1ab66-7bab-4d8f-85f0-ec6168668950',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:39:40.937597 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-691813b9-2953-4f50-94cf-4f44d1ba0b93 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.045088 Aug 29 10:39:40.941887 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 620/1367] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:39:40.953184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "name": "network-vif-unplugged", "status": "completed", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:41.000936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.001427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.003801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.030673 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] Creating event network-vif-unplugged:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h2-854121-10 Aug 29 10:39:41.041941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d1cd1b6a-587b-4a70-a3d7-2989708d5233 req-fa4f62f9-c6ee-4657-b744-3f5f5e4500d9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091545 Aug 29 10:39:41.045085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 621/1368] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:41.056528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.059288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.069880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.071170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.072054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.073102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.073905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.074542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.095399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:41.181663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.191191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2363c54b-3ae5-45fc-a6e6-13de57d95213 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1565 microversion: 2.1 time: 0.634674 Aug 29 10:39:41.192202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 748/1369] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:40 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1565 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:41.281607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7166b683-1fb7-4865-9722-256ce4dec614", "name": "network-vif-unplugged", "status": "completed", "tag": "80e23a84-6b53-4495-a8c2-f6328360ca76"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:41.308409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.308903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.309343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.343694 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Creating event network-vif-unplugged:80e23a84-6b53-4495-a8c2-f6328360ca76 for instance 7166b683-1fb7-4865-9722-256ce4dec614 on n-h2-854121-10 Aug 29 10:39:41.355693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] Instance 7166b683-1fb7-4865-9722-256ce4dec614 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:39:41.374226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.384904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6ec0fce1-9981-42e3-af9f-13d0c61657cb req-ba829413-0606-4fbd-8ed2-8a317b45b5b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189832 Aug 29 10:39:41.385448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 749/1370] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:41.393382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-79f6a37d-79f2-449e-8902-d1a72c218862 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.345809 Aug 29 10:39:41.393972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 622/1371] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:41.401178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.403377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.410397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.414766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.430778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.431196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.433032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.435379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.435852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.436287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.499446 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-600df75c-1b96-48db-bb77-eec8c8153989 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104448 Aug 29 10:39:41.501094 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 623/1372] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:41.507382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.508229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.517442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.517977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.518677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.519585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.520235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.520856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.531387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.543816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.546022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.547600 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-462ef99c-3074-4a04-af25-3d6b6d74bd71 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1103 microversion: 2.25 time: 0.151250 Aug 29 10:39:41.562708 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 750/1373] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1103 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:41.569818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.570654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.576910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.578086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.578768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.579820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.580777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.581214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.748493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cef4d7a4-4895-498a-ad34-12247995f7de tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185943 Aug 29 10:39:41.750273 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 751/1374] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:41.756478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.758818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.767771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.769385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.770113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.772603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.773321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.774050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.813199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:41.823402 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53868d0f-a1d3-47ab-abca-6533651935f8 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.320933 Aug 29 10:39:41.824749 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 624/1375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:41.829600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:41.831290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:41.841107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.841601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.842121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.842946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:41.843401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:41.844060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:41.894752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lazy-loading 'services' on Instance uuid 9c4c3b17-121c-446e-a442-894299a85e46 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:39:42.024162 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5a7cbbc-ba2d-46d8-a5fb-28c9b4bf0f06 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments/4ad22ae8-dab0-45a1-b6d0-b5aac3b58941" status: 202 len: 0 microversion: 2.1 time: 0.271602 Aug 29 10:39:42.025092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 752/1376] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:39:41 2022] DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments/4ad22ae8-dab0-45a1-b6d0-b5aac3b58941 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:39:42.042139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:42.050485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1c039d8-92fe-444f-8970-328f54f4b639 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1471 microversion: 2.1 time: 0.224651 Aug 29 10:39:42.054124 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 625/1377] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:41 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:42.417587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:42.418911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:42.426905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.429379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.430251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:42.431627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.432536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.433182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:42.573834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:42.574459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:42.587277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.588823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.592641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:42.595361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.596725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.598348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:42.622356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:42.637323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45ea4609-31e7-4684-af37-09e205c8820a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.225445 Aug 29 10:39:42.638510 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 753/1378] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:42 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:42.723860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:42.738235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:42.741297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:42.751937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86323ddd-f905-49d6-9383-61cad5ae4fe4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1232 microversion: 2.25 time: 0.183017 Aug 29 10:39:42.753863 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 626/1379] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:42 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1232 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:42.847990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:42.848603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:42.859469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.859970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.860406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:42.861124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:42.861577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:42.862030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.060209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:43.071440 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98fc72da-0b3a-4011-b23d-cd5281945282 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 0.230018 Aug 29 10:39:43.074681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:43.075362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:43.077107 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 754/1380] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:42 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:43.091055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.091759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.092197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.093406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.093977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.094632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.110293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:43.133625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.134428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.135454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.192222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] Creating event network-changed:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h2-854121-10 Aug 29 10:39:43.202903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1e32ac2b-02ec-4d33-9f6a-4ceca811ab93 req-03ba2c8c-2609-4d0c-b236-a79504db6ac6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098736 Aug 29 10:39:43.208123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 755/1381] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:43.388873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:43.398467 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6e8ab43-64b6-42fd-9459-e099e204a82f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1468 microversion: 2.1 time: 0.327791 Aug 29 10:39:43.402487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 627/1382] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:43 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1468 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:43.425558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:43.426383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:43.459341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.460055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.463176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.465512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.467668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.468907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.563749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:43.597429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.601589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.602548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.614833 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44a9df0f-292a-4d01-a889-aca64a1fb848 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614/action" status: 204 len: 0 microversion: 2.1 time: 0.194069 Aug 29 10:39:43.616697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 628/1383] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:39:43 2022] POST /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:39:43.625688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bcfdc6-677f-41e0-8e7a-6e9178179aca", "name": "network-vif-plugged", "status": "completed", "tag": "669f5359-2837-4b79-94bd-1b77e9133fe0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:43.643526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] Creating event network-changed:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:39:43.660137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.660137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.660137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.676035 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a5aa071d-a0ee-4157-b6d3-77dd83526dad req-f7508f69-6fd2-4eef-95b8-15907758587d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315085 Aug 29 10:39:43.676634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] Creating event network-vif-plugged:669f5359-2837-4b79-94bd-1b77e9133fe0 for instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca on n-h2-854121-10 Aug 29 10:39:43.682302 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 756/1384] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:43.683608 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-53cff3cd-110d-4f9e-97e8-b0fe4c934e48 req-787b0d0c-1366-4599-ba3a-2e808f050902 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064868 Aug 29 10:39:43.684537 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 629/1385] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:43.690938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:43.691153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:43.692180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:43.692414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:43.696810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:43.702178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.702511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.702787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.703244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.703903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.704515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.704840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.705571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.706222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:43.706610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:43.707082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:43.707575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:44.388571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:44.399600 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ec3fc99-d1c5-429c-a27f-79971b71b13e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.713246 Aug 29 10:39:44.403732 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 630/1386] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:43 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:44.413525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:44.422722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:44.429620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:44.430339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:44.431215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:44.432827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:44.434234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:44.441994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:45.261425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:45.272137 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6db2b848-ffde-4ce2-951a-37563641dfe8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1468 microversion: 2.1 time: 1.588314 Aug 29 10:39:45.275045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 757/1387] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:43 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1468 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:45.288440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:45.289527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:45.308924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:45.309912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:45.311971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:45.313386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:45.314874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:45.318837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:45.628826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:45.642064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:45.644533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:45.645943 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b65801c3-6f4e-41d9-b065-8ce958eb69f6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1250 microversion: 2.25 time: 1.241016 Aug 29 10:39:45.673424 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 631/1388] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:44 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1250 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:45.683114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:45.684049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:45.694241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:45.694942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:45.695379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:45.696086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:45.696543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:45.697509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.426930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:46.435316 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94921df1-2ef6-44a5-9cb4-3dacbc348176 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1322 microversion: 2.1 time: 1.157987 Aug 29 10:39:46.436094 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 758/1389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:45 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1322 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:46.440716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7166b683-1fb7-4865-9722-256ce4dec614", "name": "network-vif-plugged", "status": "completed", "tag": "80e23a84-6b53-4495-a8c2-f6328360ca76"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:46.451505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:46.452258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:46.452689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.465851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Creating event network-vif-plugged:80e23a84-6b53-4495-a8c2-f6328360ca76 for instance 7166b683-1fb7-4865-9722-256ce4dec614 on n-h2-854121-10 Aug 29 10:39:46.471822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] Instance 7166b683-1fb7-4865-9722-256ce4dec614 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:39:46.479321 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-564b2b96-8c97-4452-b96f-c5c7c53bad16 req-92a5e441-decc-4cc9-b77e-758b282ef099 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041930 Aug 29 10:39:46.484324 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 759/1390] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:46.490661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:46.491693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:46.498516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:46.499221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:46.499821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.500937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:46.501559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:46.502354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.535869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:46.547233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-983387ca-c413-4b17-a6c1-9d51c3d38355 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.872529 Aug 29 10:39:46.550094 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 632/1391] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:45 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:46.675111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:46.676728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:46.690670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:46.691537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:46.692155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.694079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:46.694969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:46.695595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:46.850702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:46.869540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:46.873566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:46.875913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cf64890-5862-48a9-8046-7da00f5ad6da tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1250 microversion: 2.25 time: 0.206564 Aug 29 10:39:46.876988 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 633/1392] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:46 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1250 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:47.076299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:47.081465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:47.089832 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96917ccd-9bc1-4e66-9312-28faf058d254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1468 microversion: 2.1 time: 0.603882 Aug 29 10:39:47.091330 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 760/1393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:46 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1468 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:47.457919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:47.461974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:47.477627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.478563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.479302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.481632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.482660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.483473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.571137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:47.571902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:47.583307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.584243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.585023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.586149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.586866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.587537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.753985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:47.767541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5489835-883d-4d47-a8eb-1b28d4b50815 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1472 microversion: 2.1 time: 0.314665 Aug 29 10:39:47.768153 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 634/1394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:47 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:47.791860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:47.791983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:47.798591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.799294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.799915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.800842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.801310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.801821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.836165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Request method failure captured: Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca/diagnostics HTTP/1.1 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJdeCiyYmbsAMt7C8uPp0C_nRjrReN1hfqKjGJkZ0NCsdI0fusR-qbzEwFyLpl12-jHxQf_RrmtkX-nQD99dITF8NdpCoW6ngAZoh3mffY6ZksLaDlVkE8cO3jqLxvRLmbow4tHP54F9RWXbMHPAuF4oL4g9zaO7A1DuzTk4gmbkfeI Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 25b373ca0e054ebe812717ba13b2b899 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 25b373ca0e054ebe812717ba13b2b899 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiagnosticsNegativeTest-1988070455-project Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92b7c1ee59144b229a2b5d246b74973b Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1988070455-project Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '40bcfdc6-677f-41e0-8e7a-6e9178179aca'} Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:47.844265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:47.848847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:47.860218 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-48f1617f-c232-4f94-ad17-44d811407266 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.063999 Aug 29 10:39:47.867965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 635/1395] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:39:47 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca/diagnostics => generated 117 bytes in 81 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:47.878816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:47.880887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:47.891299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.892454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.893159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.894542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.895254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.897665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.937811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:47.950610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c276d7a-a79c-4e35-ab2b-b919957c3f62 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.384916 Aug 29 10:39:47.951888 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 761/1396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:47 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:47.956508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:39:47.959581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:47.961795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:47.970435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.971182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.972036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:47.973097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:47.973766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:47.975277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:48.070168 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-766016c9-f9a6-4591-ab4c-5ad00a6af5f3 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "DELETE /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 204 len: 0 microversion: 2.1 time: 0.200700 Aug 29 10:39:48.071140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 636/1397] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:39:47 2022] DELETE /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:39:48.081343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:48.081597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:48.090070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:48.090725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:48.091271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:48.092053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:48.092579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:48.093079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:48.098755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:48.306145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:48.319654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:48.322619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:48.325438 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b65be783-072d-48de-8096-12dc427c797d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 0.372490 Aug 29 10:39:48.330558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 762/1398] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:47 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:48.337904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:48.339358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:48.350950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:48.352038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:48.354751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:48.355948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:48.356632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:48.357651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:48.391917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:48.406486 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-17547c40-b9c9-484e-8242-79ab8ec30878 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1478 microversion: 2.1 time: 0.329367 Aug 29 10:39:48.407715 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 637/1399] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:48 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1478 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:48.919113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:48.928110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-57c043df-d2e4-4216-98b7-38cb6729da8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1468 microversion: 2.1 time: 0.595548 Aug 29 10:39:48.945605 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 763/1400] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:48 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1468 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:48.973045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:48.985623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:48.987399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:48.990327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:49.000071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.001044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.001664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.002755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.003205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.006609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.007154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.007726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.007898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.008763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.010738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.011301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.088449 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e415d6b1-3d86-4257-add1-259f53db64b3 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102260 Aug 29 10:39:49.095321 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 764/1401] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:39:48 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:39:49.200322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ae5faf-832a-4a32-9fa1-6c8faa805d70", "tag": "de6638be-9318-49a6-992d-99a3ea048be1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:49.211953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.212923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.213607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.231742 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] Creating event network-changed:de6638be-9318-49a6-992d-99a3ea048be1 for instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 on n-h1-854121-10 Aug 29 10:39:49.237537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f89ee27e-7a9d-46e1-b6d0-cca6614c5f54 req-9944714d-57db-47c9-9b52-3080c944ab98 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041081 Aug 29 10:39:49.238912 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 765/1402] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:49.321556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:49.335512 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9792ebb6-2161-4e0f-bb5f-d5d678d27099 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.366513 Aug 29 10:39:49.337245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 638/1403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:48 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:49.355940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:49.357168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:49.364307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:49.367842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.368823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.369911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.371823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.372540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.373205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.429516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:49.430402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:49.437226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.438338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.439451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.440590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.441421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.443137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.843145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:49.858241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:49.859502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:49.860886 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46f5d3cf-4236-4140-88cf-904dd94018d8 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 0.514149 Aug 29 10:39:49.870471 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 766/1404] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:49 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:49.916313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:49.927008 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-21b33527-5b75-417d-9ef6-88d6b56e2cf9 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1478 microversion: 2.1 time: 0.502614 Aug 29 10:39:49.940880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 639/1405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:49 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1478 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:49.953111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:49.954225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:49.965804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.966642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.967151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:49.968196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:49.969623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:49.970357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.238889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:50.251583 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f97f06cf-a04f-4407-a592-97e70b4ced8c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1460 microversion: 2.1 time: 0.302230 Aug 29 10:39:50.253995 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 767/1406] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:49 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1460 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:50.282515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:50.284290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:50.303985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.304932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.306989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.307992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.309536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.310631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.364068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:50.370558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:50.387818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.388415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.388914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.394613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.395546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.396206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.444182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:50.488034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:50.692012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:50.703937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58919f1d-fa64-4d12-8c8e-97c87e14879e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1460 microversion: 2.1 time: 0.433654 Aug 29 10:39:50.722177 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 640/1407] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:50 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1460 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:50.730975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29cacd5a-795d-430b-830a-97d90f5120aa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'create', calling method: .version_select at 0x7f66c6f95ee0>, body: {"keypair": {"name": "tempest-keypair-1424024772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMEKG2CZfJISuLaWYgDYzAGrvLTCh7GFzsHlTME6LYJhYdn/jczoBx8xMpdayd48rT/8IgfH2oVnsuJxzDdgFOUlTPbtcjP79jDLE2LsxTsE5xuH5WcdOSnky/1PfXiBw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:50.751560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-29cacd5a-795d-430b-830a-97d90f5120aa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:50.759114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-29cacd5a-795d-430b-830a-97d90f5120aa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:50.806913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29cacd5a-795d-430b-830a-97d90f5120aa tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081070 Aug 29 10:39:50.808816 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 641/1408] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:39:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:50.834371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:50.858128 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c405bc0-3a36-4240-8c08-d1e53dc73d14 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.501603 Aug 29 10:39:50.869361 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 768/1409] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:50 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:50.894762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:50.895013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:50.910797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.911295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.913433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.916411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.916974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.917418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.951331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:50.952353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:50.971934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.973046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.974910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:50.975841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:50.978368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:50.979159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:51.210855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b7c1ee59144b229a2b5d246b74973b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b373ca0e054ebe812717ba13b2b899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:51.234022 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79b63548-0002-4429-a5ca-c77457783200 tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 200 len: 1307 microversion: 2.1 time: 0.288170 Aug 29 10:39:51.236894 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 769/1410] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:50 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:51.261299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bcfdc6-677f-41e0-8e7a-6e9178179aca", "name": "network-vif-deleted", "tag": "669f5359-2837-4b79-94bd-1b77e9133fe0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:51.275142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:51.275692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:51.276179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:51.289984 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] Creating event network-vif-deleted:669f5359-2837-4b79-94bd-1b77e9133fe0 for instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca on n-h2-854121-10 Aug 29 10:39:51.319013 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-468a2b0b-5d53-420c-8095-897f99181c3b req-168200b9-890d-4b4d-bbe3-2e3f05617049 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062703 Aug 29 10:39:51.323453 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 770/1411] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:51.410512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:51.420504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:51.428925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:51.435889 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df18d576-3846-497e-91b1-e441f25677ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 0.548104 Aug 29 10:39:51.436718 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 642/1412] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:50 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:51.894443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:51.895780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:51.898550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:51.906782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:51.907326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:51.907760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:51.908519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:51.908974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:51.911929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.138475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:52.149368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79ef0bab-0eaa-4918-869f-b3d57e187494 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.259381 Aug 29 10:39:52.150577 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 771/1413] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:51 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:52.259617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:52.261023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] [instance: 40bcfdc6-677f-41e0-8e7a-6e9178179aca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:52.268387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:52.269663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:52.271406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.273208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:52.274494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:52.275722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.296120 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] HTTP exception thrown: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Request method failure captured: Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca HTTP/1.1 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJdeCiyYmbsAMt7C8uPp0C_nRjrReN1hfqKjGJkZ0NCsdI0fusR-qbzEwFyLpl12-jHxQf_RrmtkX-nQD99dITF8NdpCoW6ngAZoh3mffY6ZksLaDlVkE8cO3jqLxvRLmbow4tHP54F9RWXbMHPAuF4oL4g9zaO7A1DuzTk4gmbkfeI Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 25b373ca0e054ebe812717ba13b2b899 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/25b373ca0e054ebe812717ba13b2b899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 25b373ca0e054ebe812717ba13b2b899 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1988070455 Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiagnosticsNegativeTest-1988070455-project Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92b7c1ee59144b229a2b5d246b74973b Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1988070455-project Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '40bcfdc6-677f-41e0-8e7a-6e9178179aca'} Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:52.298131 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. Aug 29 10:39:52.303705 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:39:52.305483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] Returning 404 to user: Instance 40bcfdc6-677f-41e0-8e7a-6e9178179aca could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:39:52.306462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46e3d6ba-7523-41f4-92eb-91cd5b28a0cf tempest-ServerDiagnosticsNegativeTest-1988070455 tempest-ServerDiagnosticsNegativeTest-1988070455-project] 10.222.0.47 "GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca" status: 404 len: 111 microversion: 2.1 time: 0.053898 Aug 29 10:39:52.307106 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 643/1414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:52 2022] GET /compute/v2.1/servers/40bcfdc6-677f-41e0-8e7a-6e9178179aca => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:39:52.461591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:52.462739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:52.476868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:52.480222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:52.482094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.483258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:52.483946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:52.485346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.756359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-887fec06-fdcd-466a-8b77-a4919f9f2a25 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '.version_select at 0x7f66c6e741f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:52.759973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-887fec06-fdcd-466a-8b77-a4919f9f2a25 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:52.761458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-887fec06-fdcd-466a-8b77-a4919f9f2a25 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:52.762005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-887fec06-fdcd-466a-8b77-a4919f9f2a25 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:52.778879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:52.789009 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-887fec06-fdcd-466a-8b77-a4919f9f2a25 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 3136 microversion: 2.1 time: 0.037873 Aug 29 10:39:52.789217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:52.791114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:52.792632 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72c005ce-f240-447b-9ced-e041fb822578 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 0.337363 Aug 29 10:39:52.794118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 644/1415] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:39:52 2022] GET /compute/v2.1/os-migrations => generated 3136 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:52.804283 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 772/1416] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:52 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:52.815047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a9906175-fe2d-4c72-99c5-b94fb278bce8 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:52.823756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a9906175-fe2d-4c72-99c5-b94fb278bce8 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012580 Aug 29 10:39:52.824966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 645/1417] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:39:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:39:52.837501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b87351bf-d18d-471c-89dc-dd5b48fe8618 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-362244570", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:52.858495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b87351bf-d18d-471c-89dc-dd5b48fe8618 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.025550 Aug 29 10:39:52.866390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 773/1418] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Aug 29 10:39:52 2022] POST /compute/v2.1/flavors => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:52.870989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78a777f8-1f84-4e09-8ef6-2d6719784fdd tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:52.878970 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78a777f8-1f84-4e09-8ef6-2d6719784fdd tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011565 Aug 29 10:39:52.879847 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 646/1419] 10.222.0.47 () {58 vars in 1182 bytes} [Mon Aug 29 10:39:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:39:53.079422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1454244586", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "0911103d-e88a-453b-a1f7-69f08bcc878f"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:53.155862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:39:53.171159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:53.172445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:53.184988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.185813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.186616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:53.187681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.189503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.190141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:53.516203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:53.539909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16712d60-9054-4d98-adc3-55ced2277807 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.372665 Aug 29 10:39:53.542565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 647/1420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:53 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:53.571218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:39:53.571733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:39:53.572292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:39:53.572765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:39:53.573243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:39:53.586982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.588499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.588936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:53.590538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.591191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.591777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:53.611926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:39:53.617271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:39:53.631756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:39:53.634156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:39:53.690609 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17ba4fd0-6083-4b57-ade4-d85c0adec512 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615356 Aug 29 10:39:53.698612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 774/1421] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:39:53.703522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab79d333-55f5-47ca-8c5b-347fd4478786 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:53.704347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab79d333-55f5-47ca-8c5b-347fd4478786 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:53.785551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab79d333-55f5-47ca-8c5b-347fd4478786 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:53.796697 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab79d333-55f5-47ca-8c5b-347fd4478786 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1279 microversion: 2.1 time: 0.097448 Aug 29 10:39:53.798485 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 648/1422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:53 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:53.843111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:53.843801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:53.851102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.851940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.852087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:53.852900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:53.854794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:53.855314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.102882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:54.113146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:54.115171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:54.116788 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00be859a-f737-4b69-9427-c4a1b104bbf6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 0.278965 Aug 29 10:39:54.117684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 775/1423] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:53 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:54.271421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:54.275500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:54.284764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.285589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.287060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.288276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.289020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.289660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.337907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97ea7481-8a68-4521-a90b-3116545352d5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072082 Aug 29 10:39:54.344384 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 649/1424] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:39:54 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:39:54.565373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:54.566110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:54.598242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.602552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.603266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.614307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.617803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.618804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.823162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:54.827740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:54.851929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.852787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.853450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:54.857013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:54.860590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:54.862870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.162077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:55.179577 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8121cb30-7929-4cee-87c9-f3c82577cb6c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1275 microversion: 2.1 time: 0.363485 Aug 29 10:39:55.197843 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 650/1425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:54 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1275 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:55.213604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:55.214127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:55.234022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.242099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.242891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.244198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.245057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.246104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.304169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:39:55.461127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12ae327d-4be3-480e-9a28-9e107934f6d6 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 204 len: 0 microversion: 2.1 time: 0.254931 Aug 29 10:39:55.465041 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 651/1426] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:39:55 2022] DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:39:55.470008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:55.483501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:55.500896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.505027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.508089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.515927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.517350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.518663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.776372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:55.791266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f50c5363-c197-448f-92fe-0d86bcfd14b5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 1.231628 Aug 29 10:39:55.795946 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 776/1427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:54 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:39:55.816305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:55.818465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:55.841505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.845013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.846575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:55.851220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:55.851966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:55.852696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:56.706348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:56.716315 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-851cf68c-05c9-45c8-ad52-2be13811b0ff tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1681 microversion: 2.1 time: 0.918728 Aug 29 10:39:56.717689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 777/1428] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:55 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1681 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:56.724456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:56.726179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:56.740883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:56.741875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:56.742681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:56.744185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:56.744849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:56.746308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:56.804445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:56.823980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:56.836098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:56.837368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3acd4f6d-a81d-4b9b-914a-ddc3f6533164 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1292 microversion: 2.25 time: 1.373886 Aug 29 10:39:56.849722 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 652/1429] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:55 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1292 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:56.849722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:56.849722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:56.871082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:56.871480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:56.871943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:56.872635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:56.873098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:56.873549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:56.991630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:57.002524 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66cd8d9a-f243-4079-98f9-929a9622aa7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1337 microversion: 2.1 time: 0.283517 Aug 29 10:39:57.003766 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 778/1430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:56 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1337 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:57.172282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57f3c161-ace7-4a8e-bb4a-18e3a1da6e86"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:57.180779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:57.193789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:57.198343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:57.198946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:57.200783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:57.201737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:57.202536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:57.254102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:57.280863 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-85bc3311-9ca3-4d05-89f2-200d8889e024 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.441494 Aug 29 10:39:57.281463 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 653/1431] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:56 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:57.739333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:57.740330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:57.749988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:57.750803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:57.752691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:57.753682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:57.754428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:57.755736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:57.929204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:39:57.968644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa0ae44e-b0eb-4dde-9bd5-76be30706552 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "POST /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.801478 Aug 29 10:39:57.990737 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 779/1432] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:39:57 2022] POST /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:39:58.014617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:58.017440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:58.041123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:58.041811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:58.042402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:58.043700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:58.047761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:58.048438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.030371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.053565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.063105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af136393-4573-43eb-8ab4-4a910c7dfbad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1681 microversion: 2.1 time: 1.327996 Aug 29 10:39:59.065431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.068094 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 654/1433] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:57 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1681 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:59.082388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:59.083323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:59.086211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.087508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1678a3f-e8b8-41ca-bda9-c6d45c640ad9 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 1.094661 Aug 29 10:39:59.102590 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 780/1434] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:39:57 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:39:59.104380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:39:59.111639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:39:59.115600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:59.116922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:59.117405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.120209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:59.122508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:59.123349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.131637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:59.132144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:59.132594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.133322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:59.133811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:59.134248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.772489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.788831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0672eded-ba26-4895-8872-3aad564ddd6d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.718185 Aug 29 10:39:59.803440 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 655/1435] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:59 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:59.835408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4c3b17-121c-446e-a442-894299a85e46", "name": "network-vif-deleted", "tag": "13c4e59c-35e5-4937-924f-506304ed75cd"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:39:59.867551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:39:59.868412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:39:59.869419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:39:59.888378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:39:59.904106 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] Creating event network-vif-deleted:13c4e59c-35e5-4937-924f-506304ed75cd for instance 9c4c3b17-121c-446e-a442-894299a85e46 on n-h1-854121-10 Aug 29 10:39:59.908995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e1ab6f6-6e31-4677-813b-17ca6b24c5e4 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.819908 Aug 29 10:39:59.910513 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7a36abeb-dbe3-4dea-895c-8d5e99096f56 req-02aa9a67-6cea-47e6-9842-da0541611434 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105511 Aug 29 10:39:59.912222 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 781/1436] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:39:59 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:39:59.912973 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 656/1437] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:00.089343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:00.089990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:00.100986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:00.103203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:00.104248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:00.105165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:00.110123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:00.110852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:00.121005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:00.123795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:00.138829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:00.143512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:00.147984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:00.153674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:00.154771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:00.155636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:00.210237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:00.211004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:00.211675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:00.212305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lazy-loading 'fault' on Instance uuid 9c4c3b17-121c-446e-a442-894299a85e46 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:01.013331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6b77799d1a489092731314c76af024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c22cf32e8b0433aabe8f224bb909f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:01.028153 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1437a367-4afb-4198-896f-8e891830b5ad tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 200 len: 1331 microversion: 2.1 time: 0.939029 Aug 29 10:40:01.030005 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 782/1438] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:00 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 1331 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:01.046761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:01.048099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:01.068911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:01.069553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:01.070037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:01.073390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:01.073905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:01.074537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:01.429428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:01.444257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:01.445754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:01.446891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-897748c5-babd-4e24-b9dc-7226a1a3858d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 1.333416 Aug 29 10:40:01.460416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 657/1439] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:00 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:01.465445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:01.466331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:01.476926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:01.477676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:01.478653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:01.479112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:01.485117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:01.486062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:01.492300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:01.685897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:01.697103 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de4e4fc7-69d3-4277-b23a-87d5ed564d76 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.665432 Aug 29 10:40:01.721092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 783/1440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:01 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:02.055464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:02.056701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:02.078937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.079925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.082176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:02.083184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.084736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.085949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:02.127839 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] HTTP exception thrown: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Request method failure captured: Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 HTTP/1.1 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbo1z4-ZaINlntPwZDeOpoAVJivdaO6AQ0JJSoS8obC5-bM9GiWeDQTKgADBFnmoSGSAy0dl9dN9gGsozMEURhpB4XsVHv4R5kDfDgovK9ISCLfFSDUFsFVzO_UlmY-qGc_bwIOGKDo_CYSWWsktJAZj7z1VEBsIMcA0lwlugDy-K8 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5c6b77799d1a489092731314c76af024 Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9c4c3b17-121c-446e-a442-894299a85e46'} Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:02.150255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:02.154701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Returning 404 to user: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:02.158649 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5176b50-79ea-40ec-bb24-4c8ff836f1b5 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 404 len: 111 microversion: 2.1 time: 0.107568 Aug 29 10:40:02.158649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 784/1441] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:02 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:40:02.176063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-da2d3c46-9687-4044-996a-cb0b98a4a9ea tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '.version_select at 0x7f66c71b6280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:02.235050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:02.249826 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-da2d3c46-9687-4044-996a-cb0b98a4a9ea tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587756678" status: 202 len: 0 microversion: 2.1 time: 0.082535 Aug 29 10:40:02.254869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 785/1442] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587756678 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:02.276858 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-60ce60a9-394d-4ac4-b9f4-953a5a61c2bc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1717 microversion: 2.1 time: 0.814093 Aug 29 10:40:02.280536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 658/1443] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:01 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1717 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:02.472925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:02.473164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:02.513301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.517594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.518313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:02.523334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.526523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.527135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:02.720623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:02.722107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:02.747763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.754568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.756671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:02.757670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:02.762700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:02.763501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:03.404363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:03.437901 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ea897b0-f96b-4e0d-894b-91cd2e9db618 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.721783 Aug 29 10:40:03.444332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:03.458386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 659/1444] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:02 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:03.464766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:03.470922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:03.472937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:03.476112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:03.477957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-832c26c4-45f2-4c60-801b-00167765fe2b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 1.009219 Aug 29 10:40:03.495150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:03.496004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:03.496663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:03.499049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:03.499944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:03.500604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:03.503070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 786/1445] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:02 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:03.796624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:04.169247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:04.227509 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad0e2be5-d89f-4970-857b-c8a4b0428f8e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1707 microversion: 2.1 time: 0.767155 Aug 29 10:40:04.245795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:04.246502 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 660/1446] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:03 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1707 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:04.247365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:04.255724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:04.281389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d02792ff-93dc-4628-889e-9ecb8ffc5dd1 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '.version_select at 0x7f66c6f04f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:04.298242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d02792ff-93dc-4628-889e-9ecb8ffc5dd1 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.298861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d02792ff-93dc-4628-889e-9ecb8ffc5dd1 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.299407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d02792ff-93dc-4628-889e-9ecb8ffc5dd1 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:04.301986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.304716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.305485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:04.325063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d02792ff-93dc-4628-889e-9ecb8ffc5dd1 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 3136 microversion: 2.1 time: 0.058567 Aug 29 10:40:04.328029 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 661/1447] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:40:04 2022] GET /compute/v2.1/os-migrations => generated 3136 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:04.345416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:04.347958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:04.355078 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] Creating event network-changed:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:40:04.371816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.373563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c9a15c13-2a9e-4040-a54f-4eb804a543c3 req-3a237f56-4820-433b-baae-8c12b46fc9ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128325 Aug 29 10:40:04.378755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.379487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:04.380318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.380858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.384240 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 787/1448] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:04.384684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:04.483016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:04.487015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:04.514289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.517137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.517833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:04.518751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:04.523137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:04.523787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:05.112640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5471578a-3ee5-4b6b-a2fb-a45f8539b282 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1860 microversion: 2.1 time: 0.772263 Aug 29 10:40:05.113733 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 662/1449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:04 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1860 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:05.127686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:05.129240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:05.171588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:05.172109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:05.172553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:05.173271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:05.174312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:05.175156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:05.391507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:05.406442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43980583-1618-4556-9f3d-f613dfe73587 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.946485 Aug 29 10:40:05.420730 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 788/1450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:04 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:05.447395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:05.449951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:05.481917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:05.482604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:05.483072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:05.483834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:05.486777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:05.487246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:05.764507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:05.788247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:05.790267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:05.795980 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-697b5c1e-0f6c-4db8-aad2-b1ffd4751dc2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 0.678583 Aug 29 10:40:05.801080 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 663/1451] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:05 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:06.121373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f645d029-79bf-42b3-a47e-a8a02126f909 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 200 len: 1860 microversion: 2.1 time: 0.699459 Aug 29 10:40:06.125082 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 789/1452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:05 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 1860 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:06.256196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:06.261920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:06.288714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:06.289231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:06.289678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:06.296230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:06.297478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:06.299363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:06.433834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:06.435390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:06.447203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:06.452344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:06.453099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:06.467783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:06.469080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:06.469648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:06.570746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lazy-loading 'services' on Instance uuid 635c5b3a-b42f-4389-900b-5fd986b96a5e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:06.866593 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb20bc3d-e3dc-4855-a341-74708dd1dbdb tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments/aecf1ccc-b31c-4642-957b-5224a373cfb2" status: 202 len: 0 microversion: 2.1 time: 0.613868 Aug 29 10:40:06.866593 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 664/1453] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:40:06 2022] DELETE /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments/aecf1ccc-b31c-4642-957b-5224a373cfb2 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:06.871057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-512107119", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "514cbd94-683e-4958-907d-3dc0bf3af658"}], "security_groups": [{"name": "tempest-securitygroup--289490117"}], "key_name": "tempest-keypair-1818058567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b7ddc2cb-5755-4399-a750-905daa28cc1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:07.046437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:07.065727 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b6076b52-70fb-4be4-ae62-f068121668e3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.637105 Aug 29 10:40:07.066555 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 790/1454] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:06 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:07.074978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:07.075939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:07.093231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:07.094145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:07.094802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:07.095734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:07.096359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:07.097296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:07.226547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] validate_networks() for [('514cbd94-683e-4958-907d-3dc0bf3af658', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:40:07.473777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:07.484365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:07.486105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:07.487650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94706817-d974-4f17-8c90-fb74b132b0a6 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 0.418771 Aug 29 10:40:07.504363 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 791/1455] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:07 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:07.510229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:07.512545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:07.519553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:07.520224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:07.520720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:07.521441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:07.522533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:07.522969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:07.559942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b9f8c26-45df-45a3-8358-5545852d8b81 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056322 Aug 29 10:40:07.560978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 792/1456] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:07 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:07.565568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ae5faf-832a-4a32-9fa1-6c8faa805d70", "name": "network-vif-plugged", "status": "completed", "tag": "de6638be-9318-49a6-992d-99a3ea048be1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:07.578571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:07.578948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:07.579646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:07.593693 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] Creating event network-vif-plugged:de6638be-9318-49a6-992d-99a3ea048be1 for instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 on n-h1-854121-10 Aug 29 10:40:07.600034 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a8d092b2-8245-41c7-aa53-7aa749b50caa req-6cb6a2a4-d86c-4f48-a060-1a25a3bad9c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Aug 29 10:40:07.600880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 793/1457] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:08.089171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:08.090616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:08.112320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:08.126115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:08.126702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:08.127489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:08.127973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:08.128412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:08.751279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:08.760756 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e98b73e-e0ca-4d98-b72e-0dd96cebf7a3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.675904 Aug 29 10:40:08.761348 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 794/1458] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:08 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:08.779118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:08.780002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:08.788929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:08.789669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:08.791249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:08.792681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:08.793727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:08.795000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:08.972286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for project bf9acc70e7f746889c1533b615510465. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:08.990574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for user 6f952170d12540be9a74809c5607e5b7 and project bf9acc70e7f746889c1533b615510465. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:09.012181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:09.016581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:40:09.017182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:40:09.018867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:40:09.019473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:40:09.020649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:40:09.046178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.046969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.047576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:09.048567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.049186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.054453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:09.103313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for project bf9acc70e7f746889c1533b615510465. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:09.109512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Getting quotas for user 6f952170d12540be9a74809c5607e5b7 and project bf9acc70e7f746889c1533b615510465. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:09.173166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:09.189777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:09.194243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:09.200374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f45690f4-59fa-4ae3-b13c-02afed28d280 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1280 microversion: 2.25 time: 0.437617 Aug 29 10:40:09.206380 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 795/1459] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:08 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1280 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:09.226429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:09.232082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:09.245414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.250234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.258915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:09.259900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.260795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.261400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:09.287405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:40:09.289889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7ddc2cb-5755-4399-a750-905daa28cc1b',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:40:09.327253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66f58bdd-ccde-44dc-b629-984dd4f990cf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118327 Aug 29 10:40:09.335011 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 796/1460] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:09 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:09.549162 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27104c50-53dd-467f-987a-aa806e346ac2 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.684979 Aug 29 10:40:09.549840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 665/1461] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:40:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:40:09.562052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88eb30ce-b483-4a3f-95bc-72d485534903 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:09.562980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88eb30ce-b483-4a3f-95bc-72d485534903 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:09.655711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1254632222", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "4ce7087a-e7e6-464c-800e-ebc499b2a8b5"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:09.701221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88eb30ce-b483-4a3f-95bc-72d485534903 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:09.720106 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88eb30ce-b483-4a3f-95bc-72d485534903 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1121 microversion: 2.1 time: 0.163154 Aug 29 10:40:09.738188 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 666/1462] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:09 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1121 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:09.770552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] validate_networks() for [('4ce7087a-e7e6-464c-800e-ebc499b2a8b5', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:40:09.782427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:09.783037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:09.802155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.802706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.803159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:09.803899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:09.804351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:09.804780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.365417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:10.384331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f54569ca-2b22-438c-9e7a-af8e25c43cbe tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.605759 Aug 29 10:40:10.390162 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 667/1463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:09 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:10.403742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:10.404360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:10.419769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.420270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.420713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.421434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.421930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.422361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.743406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:40:10.743920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:40:10.744332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:40:10.745608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:40:10.746161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:40:10.781340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.784503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.785156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.787886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.789178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.790878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.834275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:10.846078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Getting quotas for project 75c4e9e2642c49ca91e44474dc29a2a2. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:10.850285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:10.854314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:10.857922 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f17415d0-830a-451d-9f39-272a8d167d1b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1476 microversion: 2.25 time: 0.465224 Aug 29 10:40:10.858715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Getting quotas for user 53f12313264d4d2faa86f19e1e8c4059 and project 75c4e9e2642c49ca91e44474dc29a2a2. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:10.864258 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 668/1464] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:10 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:10.875185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:10.878082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:10.887532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.892204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.892475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:40:10.893048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.894634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:10.895821 n-d-854121-10 devstack@n-api.service[128681]: WARNING nova.utils [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1254632222 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-125463222 Aug 29 10:40:10.895982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:10.896575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:10.897074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:40:10.967985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8129180f-1ac5-44ce-be65-5a97a94e48d2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631602 Aug 29 10:40:10.977983 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 797/1465] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:40:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:40:10.990787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:10.991718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:10.997054 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4dde1177-694e-4cd4-9634-c0912b3ba252 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131236 Aug 29 10:40:10.998605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 669/1466] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:10 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:11.005544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.006499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.007599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.008809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.009490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.010399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.011409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:11.012111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:11.033035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.040950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.041540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.042511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.042895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.043391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.142247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:11.153245 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-440f3f45-8c6b-4faf-b990-3900c95c8b7a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1219 microversion: 2.1 time: 0.173276 Aug 29 10:40:11.163240 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 798/1467] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:10 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:11.180141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbc6be4b-0788-4e28-8101-7c423c4eb657 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:11.180762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbc6be4b-0788-4e28-8101-7c423c4eb657 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:11.196243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:11.344917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbc6be4b-0788-4e28-8101-7c423c4eb657 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:11.353068 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbc6be4b-0788-4e28-8101-7c423c4eb657 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1232 microversion: 2.1 time: 0.188636 Aug 29 10:40:11.367195 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 799/1468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:11 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1232 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:11.408891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:11.409946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:11.420312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.422609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.423127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.423828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.424296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.424764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.453513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:11.514030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 73ae5faf-832a-4a32-9fa1-6c8faa805d70 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:11.539440 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-63783bdf-c7a5-488d-8090-df9a816a3eee tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1970 microversion: 2.25 time: 0.537885 Aug 29 10:40:11.541010 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 670/1469] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:10 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1970 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:11.566120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:11.567998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:11.590219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.591001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.591736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:11.593807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:11.595178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:11.595829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.100284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:12.114439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf2a19f6-5516-4f0c-bbea-5aeaaae95462 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.710189 Aug 29 10:40:12.117500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 800/1470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:11 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:12.133804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:12.143936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:12.159214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.170559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.171574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.172559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.173425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.174118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.247260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a5429d09-3e52-4b04-bdb4-48bee5ca90d1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120381 Aug 29 10:40:12.249776 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 801/1471] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:12 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:12.278925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:12.280752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:12.303591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.306447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.310384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.311165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.311647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.312083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.422030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 73ae5faf-832a-4a32-9fa1-6c8faa805d70 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:12.461769 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-faea35f2-65c0-4c89-91cc-cf142e10fedb tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1970 microversion: 2.25 time: 0.902171 Aug 29 10:40:12.471251 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 671/1472] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:11 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1970 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:40:12.490135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:12.491430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:12.516203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.518016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.518771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.519619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.523265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.523872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.672172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:12.685459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d61684c-9d2c-4ef8-963f-d670ed1a84b1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1237 microversion: 2.1 time: 0.431764 Aug 29 10:40:12.687919 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 802/1473] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:12 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1237 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:12.699515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:12.710397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.714213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.714865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.715909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.717678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.721884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.792357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-645f7f30-8f18-4841-8301-5de926048451 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.101410 Aug 29 10:40:12.803951 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 803/1474] 10.222.0.47 () {60 vars in 1217 bytes} [Mon Aug 29 10:40:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:40:12.820946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-10", "block_migration": "auto"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:12.826502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:12.837946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:12.838175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdf2a8a1-f328-4251-8d53-49d02ba07990 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1284 microversion: 2.1 time: 0.363320 Aug 29 10:40:12.844438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.845183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.846038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.846945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.847140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 672/1475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:12 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:12.848192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.849118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.891051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-plugged", "status": "completed", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:12.925639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'flavor' on Instance uuid 73ae5faf-832a-4a32-9fa1-6c8faa805d70 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:12.937557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:12.938406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:12.939213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:12.953464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Going to try to live migrate instance to n-h2-854121-10 {{(pid=128681) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:40:12.969325 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] Creating event network-vif-plugged:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:40:12.979571 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-92126e84-b10f-41b5-8904-121a15789b54 req-6051de3a-f2d2-4048-a7be-8493983b2a15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093197 Aug 29 10:40:12.981018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 673/1476] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:13.147633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:13.148897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:13.175580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:13.179389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:13.181078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:13.184099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:13.186394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:13.189123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:13.887279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:13.897901 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e75de4a3-794f-472c-adb1-deaa04524782 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.760203 Aug 29 10:40:13.899794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 674/1477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:13 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:13.905686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:13.908613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:13.919365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:13.920927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:13.921547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:13.923149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:13.923997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:13.924682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:13.978259 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-39d87200-780b-4276-a4df-1e988cbe75fe tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072094 Aug 29 10:40:13.980579 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 675/1478] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:13 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:13.992743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:13.993569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:14.009832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:14.010457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:14.011252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:14.012244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:14.012954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:14.013617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:14.039142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:14.784861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:14.801302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ac0a66ab-47a4-4314-9545-440ccd659ade tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1304 microversion: 2.1 time: 0.816802 Aug 29 10:40:14.802569 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 676/1479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:13 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1304 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:14.811987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:14.813316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:14.835648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:14.836153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:14.836598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:14.837302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:14.837949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:14.838394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.035888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:15.053040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35df1edb-a8bc-4053-8c34-28cde25e622c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1290 microversion: 2.1 time: 0.249032 Aug 29 10:40:15.066325 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 677/1480] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:14 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1290 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:15.066325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.066325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.071366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.072148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.072740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.073636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.074254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.080658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.150950 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-537a9793-4534-4c04-a068-2d13de5aaec0 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70/action" status: 202 len: 0 microversion: 2.25 time: 2.345496 Aug 29 10:40:15.152031 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 804/1481] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:40:12 2022] POST /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70/action => generated 0 bytes in 2347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:15.161546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.164326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.172064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.172786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.173375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.174330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.175005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.175649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.239671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-492b6ea4-8305-4b41-8186-e3053e4acbd0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086324 Aug 29 10:40:15.241459 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 805/1482] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:15 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:15.374731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.375562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.382675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.383173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.383618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.384332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.384795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.386293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.626278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:15.637405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e51f7d8-f138-4c63-a8c2-8bc10b3f15e7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1379 microversion: 2.1 time: 0.582270 Aug 29 10:40:15.656129 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 678/1483] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:15 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1379 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:15.682225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.682751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.704991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.705977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.706521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.707619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.708496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.709175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.727751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] HTTP exception thrown: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Request method failure captured: Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 HTTP/1.1 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbo1z4-ZaINlntPwZDeOpoAVJivdaO6AQ0JJSoS8obC5-bM9GiWeDQTKgADBFnmoSGSAy0dl9dN9gGsozMEURhpB4XsVHv4R5kDfDgovK9ISCLfFSDUFsFVzO_UlmY-qGc_bwIOGKDo_CYSWWsktJAZj7z1VEBsIMcA0lwlugDy-K8 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5c6b77799d1a489092731314c76af024 Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9c4c3b17-121c-446e-a442-894299a85e46'} Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:40:15.729641 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.735509 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.739664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Returning 404 to user: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:15.741097 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdc0ad80-86ad-47b8-8ce0-37392b325490 tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 404 len: 111 microversion: 2.1 time: 0.063200 Aug 29 10:40:15.742274 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 679/1484] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:40:15 2022] DELETE /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:40:15.750857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.751848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] [instance: 9c4c3b17-121c-446e-a442-894299a85e46] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.759823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.760646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.761353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.762374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.763049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.763697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.780062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] HTTP exception thrown: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Request method failure captured: Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 HTTP/1.1 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbo1z4-ZaINlntPwZDeOpoAVJivdaO6AQ0JJSoS8obC5-bM9GiWeDQTKgADBFnmoSGSAy0dl9dN9gGsozMEURhpB4XsVHv4R5kDfDgovK9ISCLfFSDUFsFVzO_UlmY-qGc_bwIOGKDo_CYSWWsktJAZj7z1VEBsIMcA0lwlugDy-K8 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c22cf32e8b0433aabe8f224bb909f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c22cf32e8b0433aabe8f224bb909f65 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1761747272 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5c6b77799d1a489092731314c76af024 Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1761747272-project Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9c4c3b17-121c-446e-a442-894299a85e46'} Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:15.782067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] Returning 404 to user: Instance 9c4c3b17-121c-446e-a442-894299a85e46 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:15.790186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5404a1c8-43cb-4bec-a8e4-de701834980f tempest-AttachSCSIVolumeTestJSON-1761747272 tempest-AttachSCSIVolumeTestJSON-1761747272-project] 10.222.0.47 "GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46" status: 404 len: 111 microversion: 2.1 time: 0.041667 Aug 29 10:40:15.796763 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 680/1485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:15 2022] GET /compute/v2.1/servers/9c4c3b17-121c-446e-a442-894299a85e46 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:40:15.824580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:15.825512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:15.836220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.836881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.837780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.838771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:15.839148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:15.839444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:15.839940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:15.874561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:15.877661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:15.882197 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12038bf4-3060-423f-b7d2-eee416934129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.638995 Aug 29 10:40:15.882779 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 806/1486] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:15 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:16.074049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:16.074668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:16.081488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.084579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.085972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.087513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.088679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.089515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.466233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:16.484670 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e680340c-0501-4f20-a54f-1d33cfe3bf45 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1304 microversion: 2.1 time: 0.665969 Aug 29 10:40:16.486261 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 681/1487] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:15 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1304 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:16.498781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:16.501752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:16.510494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.511384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.512090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.513004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.513666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.514594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.555173 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc62acc0-36d2-4f0c-8e01-d39fa77bc6e9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067240 Aug 29 10:40:16.563527 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 682/1488] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:16 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:40:16.664318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:16.664943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:16.672831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.673335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.673843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.674574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.675039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.675474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.772809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:16.783255 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a41f398-84c9-4eec-8a40-eb8975d89357 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1332 microversion: 2.1 time: 0.713063 Aug 29 10:40:16.784968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 807/1489] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:16 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1332 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:16.907899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:16.909108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:16.925365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.928347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.929931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:16.931660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:16.933568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:16.934451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:17.508582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:17.521015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74ec5611-4879-4d6f-9dd3-5905d48246f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1528 microversion: 2.1 time: 0.860497 Aug 29 10:40:17.526857 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 683/1490] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:16 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1528 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:17.534464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b60670e-e446-465f-9682-785bf357a149", "tag": "8d8b40ab-28c2-4510-9ce3-43aba828a5dc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:17.575719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:17.577731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:17.580775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:17.603411 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] Creating event network-changed:8d8b40ab-28c2-4510-9ce3-43aba828a5dc for instance 2b60670e-e446-465f-9682-785bf357a149 on n-h2-854121-10 Aug 29 10:40:17.609441 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b0199acf-f12e-4f64-b870-a37a54082716 req-69fc2f90-3434-4080-80f7-c9fd3148c950 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081107 Aug 29 10:40:17.612070 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 684/1491] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:17.864719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "55a026b6-75d2-492f-849b-992c83d05aab"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:17.867351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:17.883131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:17.884159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:17.884666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:17.885657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:17.886376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:17.887035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:17.919706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:17.947003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:17.965589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:17.975796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed1a64d0-4824-4f56-975e-b214759f2320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 1.073136 Aug 29 10:40:17.976687 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 808/1492] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:16 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:40:17.994476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:17.995520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:18.010259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:18.011149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:18.011832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:18.012730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:18.013550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:18.014180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:19.081771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:19.118705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:19.150015 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e5b36157-57a1-4399-a5ef-dc6f577bb87f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1304 microversion: 2.1 time: 1.171048 Aug 29 10:40:19.150613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 809/1493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:17 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1304 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:19.180890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:19.183838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:19.203282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:19.205232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:19.205740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:19.209514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:19.210377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:19.210821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:19.538997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:19.563899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1babb2c7-bc88-4a1a-bb35-7e07165a8574 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1528 microversion: 2.1 time: 0.398772 Aug 29 10:40:19.584384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 810/1494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:19 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:19.595692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:19.597466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:19.613622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:19.614721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:19.615185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:19.617215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:19.618272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:19.618881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:19.711400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:20.151192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:20.182462 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-afdd4f72-82af-4527-ad84-dd6ca6592ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1332 microversion: 2.1 time: 0.595687 Aug 29 10:40:20.186122 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 811/1495] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:19 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1332 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:20.217911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:20.230177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:20.249627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:20.251961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:20.257136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:20.259718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:20.261962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:20.262630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:21.350741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:22.744860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:25.617983 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] HTTP exception thrown: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Request method failure captured: Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments/57f3c161-ace7-4a8e-bb4a-18e3a1da6e86 HTTP/1.1 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 74 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJc2tvm2XVYBr0GaVZTPB13BjJsaQ-J2MZO2lpM7iCZxBJPJYvNOnjNszPDvkxE6d9F044f7gMmE987yyGXGhn3KSUpDlCDDKc98HBFfdNqKQjODEJgIP7Cfmz20vsFucKdLe-bMEMF7vqmMwccSl3oosOIKHTTq1c4niUSilLgieV0 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 04c678a3336e4328a494ec8a7520715f Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_04c678a3336e4328a494ec8a7520715f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 04c678a3336e4328a494ec8a7520715f Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesAdminNegativeTest-15076440-project-admin Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4259d7be5acd4427b000ef2b5c0b0e14 Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesAdminNegativeTest-15076440-project-admin Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: {"volumeAttachment": {"volumeId": "55a026b6-75d2-492f-849b-992c83d05aab"}} Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': 'd319a64e-826c-4f51-8fb7-bb4993be9a7f', 'id': '57f3c161-ace7-4a8e-bb4a-18e3a1da6e86', 'body': {'volumeAttachment': {'volumeId': '55a026b6-75d2-492f-849b-992c83d05aab'}}} Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. (HTTP 404) (Request-ID: req-339d83d4-d0d1-444b-a54a-45f34eb77145) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:40:25.653078 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Returning 400 to user: Volume 55a026b6-75d2-492f-849b-992c83d05aab could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:25.658437 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cdeab71-5e4b-4a2b-974a-12096c1692bb tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] 10.222.0.47 "PUT /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments/57f3c161-ace7-4a8e-bb4a-18e3a1da6e86" status: 400 len: 107 microversion: 2.1 time: 8.041236 Aug 29 10:40:25.662584 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 685/1496] 10.222.0.47 () {60 vars in 1433 bytes} [Mon Aug 29 10:40:17 2022] PUT /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments/57f3c161-ace7-4a8e-bb4a-18e3a1da6e86 => generated 107 bytes in 8046 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:40:25.665455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:25.665962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:25.696202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:25.697206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:25.698477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:25.701102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:25.702042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:25.702489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:25.824009 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f306d187-f04c-4630-be64-af6552f9991a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.627687 Aug 29 10:40:25.826589 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 812/1497] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:40:20 2022] POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 194 bytes in 5639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:25.837382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-823f19d6-eb0f-49bc-86fc-af7f7bca4923 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:25.872964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-823f19d6-eb0f-49bc-86fc-af7f7bca4923 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/0911103d-e88a-453b-a1f7-69f08bcc878f" status: 202 len: 0 microversion: 2.1 time: 0.043059 Aug 29 10:40:25.877967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 813/1498] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:40:25 2022] DELETE /compute/v2.1/flavors/0911103d-e88a-453b-a1f7-69f08bcc878f => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:25.887301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73bb8d5-65ee-4179-8f1a-30d97276a727", "tag": "c16fab9c-1289-4323-97f4-6f87daebbab4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:25.901672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:25.902312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:25.902819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:25.917184 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] Creating event network-changed:c16fab9c-1289-4323-97f4-6f87daebbab4 for instance d73bb8d5-65ee-4179-8f1a-30d97276a727 on n-h2-854121-10 Aug 29 10:40:25.923896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0459de0b-0806-4784-a5e2-0dcc48f40c29 req-948753eb-468e-43b7-9a38-1253e264c427 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043968 Aug 29 10:40:25.925237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 814/1499] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:25.932952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:25.934011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:25.945640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:25.949939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:25.953289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:25.955595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:25.956641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:25.958890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.007940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:26.020925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:26.022782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:26.024643 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-370e65f0-7af1-41aa-bb4b-cb4b09321984 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.364674 Aug 29 10:40:26.025425 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 686/1500] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:25 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:26.042335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:26.043046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:26.049114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.049876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.050584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.051592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.052170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.052664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.269317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:26.273277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:26.287139 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f52f7ad8-4360-4ff8-acbc-21a1bbe9867e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.359709 Aug 29 10:40:26.289482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 815/1501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:25 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:26.301914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:26.302659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:26.314994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.315718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.316531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.317968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.319365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.320346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.335108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:26.343305 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fddb7469-7361-435f-bb37-2f073d3950eb tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1332 microversion: 2.1 time: 0.316598 Aug 29 10:40:26.343878 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 687/1502] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:26 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:26.353578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dde13fc8-28fa-48e9-a16d-56b59bbb5c29 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:26.376122 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dde13fc8-28fa-48e9-a16d-56b59bbb5c29 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025962 Aug 29 10:40:26.376711 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 688/1503] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:40:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:26.400155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:26.413744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:26.421457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.421984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.422422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.423128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:26.423586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:26.424051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:26.492214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lazy-loading 'services' on Instance uuid d319a64e-826c-4f51-8fb7-bb4993be9a7f {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:27.066113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:27.076731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Old instance type tempest-test_resize_flavor_-362244570, new instance type m1.heat {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 10:40:27.090538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:40:27.091108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:40:27.092370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:40:27.093059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:40:27.093749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:40:27.482969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-460f0829-cae0-4b5d-b58d-20c955645c66 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e/action" status: 202 len: 0 microversion: 2.1 time: 1.092333 Aug 29 10:40:27.483929 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 689/1504] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:26 2022] POST /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e/action => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:40:27.490513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bb8d5-65ee-4179-8f1a-30d97276a727", "name": "network-vif-plugged", "status": "completed", "tag": "c16fab9c-1289-4323-97f4-6f87daebbab4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:27.503094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:27.503731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:27.504241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:27.517977 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] Creating event network-vif-plugged:c16fab9c-1289-4323-97f4-6f87daebbab4 for instance d73bb8d5-65ee-4179-8f1a-30d97276a727 on n-h2-854121-10 Aug 29 10:40:27.526229 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b704ad58-aa15-423e-98ff-7ea076187ab5 req-79a9f30e-c1db-459e-b12d-263c7728d68e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040610 Aug 29 10:40:27.527782 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 690/1505] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:27.533929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:27.535701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:27.544386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:27.545080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:27.545914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:27.546989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:27.548194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:27.548736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:27.792922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:27.806303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:27.813377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:27.818997 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee778f2d-faf6-4945-967e-338d44963f16 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.288470 Aug 29 10:40:27.836596 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 691/1506] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:27 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:28.159062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32bca3e8-785c-4fbe-ab2e-f2fd916f98d5 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments/57f3c161-ace7-4a8e-bb4a-18e3a1da6e86" status: 202 len: 0 microversion: 2.1 time: 1.851022 Aug 29 10:40:28.166075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 816/1507] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:40:26 2022] DELETE /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments/57f3c161-ace7-4a8e-bb4a-18e3a1da6e86 => generated 0 bytes in 1875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:28.191797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.194083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:28.214161 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e311d211-f5e0-4735-a0db-992529251d5c tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.375655 Aug 29 10:40:28.215960 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 692/1508] 10.222.0.47 () {58 vars in 1128 bytes} [Mon Aug 29 10:40:27 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 10:40:28.219415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.224711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.225593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:28.226492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.226982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.227742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.228373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.228639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.235213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.236135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.237061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.239337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.240052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.241105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.512201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:28.530526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66bd69b0-f567-495d-b149-3e427d437240 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.358916 Aug 29 10:40:28.534339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 817/1509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:28 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:28.536754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:28.545679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.547691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:28.554108 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9214a49e-4981-4b29-9986-1fde87571769 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1332 microversion: 2.1 time: 0.335977 Aug 29 10:40:28.557237 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 693/1510] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:28 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:28.562591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.562955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.563520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.564242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.564785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.565323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.571016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.573489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:28.584390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.585058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.585554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.586564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.587440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.587967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.633003 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97acab08-1ba4-43c1-a701-56ba9119f8ee tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074987 Aug 29 10:40:28.633362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 694/1511] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:28 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:28.646240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40b5fc88-c349-497b-9e22-fae6bb1a81fe tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Calling method '.version_select at 0x7f66c6e83c10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.676782 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-40b5fc88-c349-497b-9e22-fae6bb1a81fe tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] HTTP exception thrown: Image not found. Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40b5fc88-c349-497b-9e22-fae6bb1a81fe tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Request method failure captured: Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeba8v-A-ni4BjAq-zy50SofSrzsgbTIAmZBpkDkwmmoptklEa6Sa0Y_Oie0QTXblTi2ZVU06GPcy-rRkeKVvOTkzksMuYSL8W_FN5xf3h80lQxBtZ1GtZnqv45pLHskwL_pyBplrhpSyvbd7HjUl7m2IQwP_kE3jx84Sopa_rLFHo Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 00412bb73cb743d89f32513166984ee3 Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '-1'} Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.680606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.686858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40b5fc88-c349-497b-9e22-fae6bb1a81fe tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:28.689224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40b5fc88-c349-497b-9e22-fae6bb1a81fe tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.043179 Aug 29 10:40:28.689224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 695/1512] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 29 10:40:28 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:40:28.700539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-05f14d97-ae7f-4785-98f2-3135484bceee tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Calling method '.version_select at 0x7f66c6e4c3a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.758824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-05f14d97-ae7f-4785-98f2-3135484bceee tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] HTTP exception thrown: Image not found. Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-05f14d97-ae7f-4785-98f2-3135484bceee tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Request method failure captured: Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/1028e2fc-e8f0-4340-a89f-0190059e602j HTTP/1.1 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeba8v-A-ni4BjAq-zy50SofSrzsgbTIAmZBpkDkwmmoptklEa6Sa0Y_Oie0QTXblTi2ZVU06GPcy-rRkeKVvOTkzksMuYSL8W_FN5xf3h80lQxBtZ1GtZnqv45pLHskwL_pyBplrhpSyvbd7HjUl7m2IQwP_kE3jx84Sopa_rLFHo Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 00412bb73cb743d89f32513166984ee3 Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '1028e2fc-e8f0-4340-a89f-0190059e602j'} Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1028e2fc-e8f0-4340-a89f-0190059e602j to delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1028e2fc-e8f0-4340-a89f-0190059e602j could not be found. Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.762712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-05f14d97-ae7f-4785-98f2-3135484bceee tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-05f14d97-ae7f-4785-98f2-3135484bceee tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/1028e2fc-e8f0-4340-a89f-0190059e602j" status: 404 len: 62 microversion: 2.1 time: 0.069662 Aug 29 10:40:28.768346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 696/1513] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:28 2022] DELETE /compute/v2.1/images/1028e2fc-e8f0-4340-a89f-0190059e602j => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 10:40:28.780578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c28996b4-5d81-4cd6-bf7f-ac50fb9a494f tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Calling method '.version_select at 0x7f66c6e4c9d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.804302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c28996b4-5d81-4cd6-bf7f-ac50fb9a494f tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] HTTP exception thrown: Image not found. Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c28996b4-5d81-4cd6-bf7f-ac50fb9a494f tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Request method failure captured: Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/70b71260-ee5b-4697-877d-c9171cc0f5f91 HTTP/1.1 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeba8v-A-ni4BjAq-zy50SofSrzsgbTIAmZBpkDkwmmoptklEa6Sa0Y_Oie0QTXblTi2ZVU06GPcy-rRkeKVvOTkzksMuYSL8W_FN5xf3h80lQxBtZ1GtZnqv45pLHskwL_pyBplrhpSyvbd7HjUl7m2IQwP_kE3jx84Sopa_rLFHo Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 00412bb73cb743d89f32513166984ee3 Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '70b71260-ee5b-4697-877d-c9171cc0f5f91'} Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70b71260-ee5b-4697-877d-c9171cc0f5f91 to delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70b71260-ee5b-4697-877d-c9171cc0f5f91 could not be found. Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.810894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c28996b4-5d81-4cd6-bf7f-ac50fb9a494f tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c28996b4-5d81-4cd6-bf7f-ac50fb9a494f tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/70b71260-ee5b-4697-877d-c9171cc0f5f91" status: 404 len: 62 microversion: 2.1 time: 0.040760 Aug 29 10:40:28.817917 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 697/1514] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:40:28 2022] DELETE /compute/v2.1/images/70b71260-ee5b-4697-877d-c9171cc0f5f91 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 10:40:28.830219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d386a677-c350-433e-8b37-5a50267beb8b tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Calling method '.version_select at 0x7f66c6e83b80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.835003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:28.846812 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0348b216-2b05-4db0-997c-631533d8a68d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1537 microversion: 2.1 time: 0.307642 Aug 29 10:40:28.849292 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 818/1515] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:28 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1537 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:28.855932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.857081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:28.861155 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d386a677-c350-433e-8b37-5a50267beb8b tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] HTTP exception thrown: Image not found. Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d386a677-c350-433e-8b37-5a50267beb8b tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Request method failure captured: Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/tempest-invalid-1221270542 HTTP/1.1 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeba8v-A-ni4BjAq-zy50SofSrzsgbTIAmZBpkDkwmmoptklEa6Sa0Y_Oie0QTXblTi2ZVU06GPcy-rRkeKVvOTkzksMuYSL8W_FN5xf3h80lQxBtZ1GtZnqv45pLHskwL_pyBplrhpSyvbd7HjUl7m2IQwP_kE3jx84Sopa_rLFHo Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 00412bb73cb743d89f32513166984ee3 Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'tempest-invalid-1221270542'} Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1221270542 to delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1221270542 could not be found. Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.864544 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d386a677-c350-433e-8b37-5a50267beb8b tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d386a677-c350-433e-8b37-5a50267beb8b tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/tempest-invalid-1221270542" status: 404 len: 62 microversion: 2.1 time: 0.045131 Aug 29 10:40:28.869728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 698/1516] 10.222.0.47 () {58 vars in 1206 bytes} [Mon Aug 29 10:40:28 2022] DELETE /compute/v2.1/images/tempest-invalid-1221270542 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:40:28.871651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.871651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.871651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.872912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:28.880450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:28.881176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:28.885575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ced75ab8-b78b-41da-a064-ea91237b61b4 tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Calling method '.version_select at 0x7f66c6e35430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:28.921455 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ced75ab8-b78b-41da-a064-ea91237b61b4 tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] HTTP exception thrown: Image not found. Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ced75ab8-b78b-41da-a064-ea91237b61b4 tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Request method failure captured: Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/d531fe27-b84e-4484-a8d1-6dcb01429a7f HTTP/1.1 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeba8v-A-ni4BjAq-zy50SofSrzsgbTIAmZBpkDkwmmoptklEa6Sa0Y_Oie0QTXblTi2ZVU06GPcy-rRkeKVvOTkzksMuYSL8W_FN5xf3h80lQxBtZ1GtZnqv45pLHskwL_pyBplrhpSyvbd7HjUl7m2IQwP_kE3jx84Sopa_rLFHo Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f1eadeeab5614ad389e48285f96df0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f1eadeeab5614ad389e48285f96df0ca Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 00412bb73cb743d89f32513166984ee3 Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1741807778-project Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd531fe27-b84e-4484-a8d1-6dcb01429a7f'} Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d531fe27-b84e-4484-a8d1-6dcb01429a7f to delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d531fe27-b84e-4484-a8d1-6dcb01429a7f could not be found. Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.923525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:40:28.929291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:28.945460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ced75ab8-b78b-41da-a064-ea91237b61b4 tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:28.946708 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ced75ab8-b78b-41da-a064-ea91237b61b4 tempest-ImagesDeleteNegativeTestJSON-1741807778 tempest-ImagesDeleteNegativeTestJSON-1741807778-project] 10.222.0.47 "DELETE /compute/v2.1/images/d531fe27-b84e-4484-a8d1-6dcb01429a7f" status: 404 len: 62 microversion: 2.1 time: 0.072150 Aug 29 10:40:28.951922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 699/1517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:28 2022] DELETE /compute/v2.1/images/d531fe27-b84e-4484-a8d1-6dcb01429a7f => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:40:29.105046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:29.131012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:29.135843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:29.142868 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bc2d36b-da07-4338-92e7-3905a37487ec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.291998 Aug 29 10:40:29.143474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 819/1518] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:28 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:29.558060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:29.558843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:29.570857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.571758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.572830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.573846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.574648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.575251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.577013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:29.577694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:29.589299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.590198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.591097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.592427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.593114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.593731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.894813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:29.918420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-757ddb7a-ab47-4823-9fe6-5b59743ee492 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1536 microversion: 2.1 time: 0.345279 Aug 29 10:40:29.929731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 820/1519] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:29 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1536 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:29.929970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:29.930118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:29.930118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:29.945362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.946232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.946771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.947811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.948355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.948976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.949312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5aa08538-b1c0-4687-9949-dbc5ef3599d5 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.397908 Aug 29 10:40:29.949941 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 700/1520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:29 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:29.960528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:29.961132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:29.971777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.991048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.991749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:29.992748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:29.993417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:29.994103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:30.046145 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a68dc53-f01c-4bb2-905d-cf0b3f0b3654 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125415 Aug 29 10:40:30.046731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 821/1521] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:29 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:30.063646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a7e880c-29e9-4ddd-905d-0471f2d5f53a tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'create', calling method: .version_select at 0x7f66c758fd30>, body: {"pool": "7b4815eb-0686-4480-b1c1-43f6f902729a"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:30.768153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:30.786874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:30.789361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c11ce28d-e3b2-4a71-9ebb-f6d653bfc10e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1537 microversion: 2.1 time: 0.833645 Aug 29 10:40:30.790248 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 701/1522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:29 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1537 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:30.794978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:30.796133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:30.802861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:30.803349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:30.803787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:30.804490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:30.804951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:30.805377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.262654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:31.279018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:31.282561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:31.284288 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a4d47bd8-d0ef-43f0-a89b-5af6c166a2e3 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.493048 Aug 29 10:40:31.285560 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 702/1523] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:30 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:31.291020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:31.291837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:31.299169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.299876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.300727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.301585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.302921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.303363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.587325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:31.599549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90e34912-8bf8-4317-adf6-aa37afeb1eea tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.311977 Aug 29 10:40:31.600977 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 703/1524] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:31 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:31.620432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:31.626179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:31.638105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.638610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.639049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.639763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.640271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.640957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.682613 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dca1f58c-8094-4bdf-b411-1ef6ae6dc707 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067257 Aug 29 10:40:31.686187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 704/1525] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:31 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:31.850716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b5215faa-042d-49df-974b-b8df7ad7b8cb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e3fa60>, body: {"keypair": {"name": "tempest-keypair-1135609828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuTLMf5F5uE9y3YWjBLsaJ54TqSCKHOsePW0gkfmWGwoqt6M8U5JOnEoh1IvKtUipdA+4W3cjneygYE2Di/YXc/4fjYKpqa4mY3A5yZ4W2LXFGezE9DxSSP7HfQQlpNsA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:31.873009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b5215faa-042d-49df-974b-b8df7ad7b8cb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:31.879947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b5215faa-042d-49df-974b-b8df7ad7b8cb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:31.913580 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b5215faa-042d-49df-974b-b8df7ad7b8cb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.226070 Aug 29 10:40:31.914746 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 705/1526] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:40:31.921748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:31.922953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:31.925650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:31.933264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.934085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.934708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:31.935663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:31.936238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:31.936961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.185616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:32.195242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b9a8ddf-89a0-4d58-bd87-457690b3e8eb tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1537 microversion: 2.1 time: 0.278648 Aug 29 10:40:32.205790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 706/1527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:31 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1537 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:32.205790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75f00844-6039-41d8-8f6f-b937686b6f8c tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6d8a820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.213323 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75f00844-6039-41d8-8f6f-b937686b6f8c tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1135609828" status: 200 len: 513 microversion: 2.2 time: 0.014852 Aug 29 10:40:32.217354 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 707/1528] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Aug 29 10:40:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1135609828 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:32.230496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99c425ff-e8b1-4aab-8d1e-634b35636ecb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e3f4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.282332 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99c425ff-e8b1-4aab-8d1e-634b35636ecb tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135609828" status: 204 len: 0 microversion: 2.2 time: 0.057763 Aug 29 10:40:32.283996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 708/1529] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Aug 29 10:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135609828 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:32.296048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49f6744d-537b-4386-af3a-c6188180c116 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e9c1f0>, body: {"keypair": {"name": "tempest-keypair-1455512128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGheM5ZPgGa3txoud10ftF+4UmmeqJm3rGTuYQUgvJ9WbUconjCtlJ5VtXK34+K2ICmjQw7pquXgJvABWGVA6CbEY38pGiAb/kyhZiUF9j4RQFlZu9kN/dE3DkQ0S+ud4g=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:32.313420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-49f6744d-537b-4386-af3a-c6188180c116 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:32.319369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-49f6744d-537b-4386-af3a-c6188180c116 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:32.350552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49f6744d-537b-4386-af3a-c6188180c116 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.058356 Aug 29 10:40:32.352416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 709/1530] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 10:40:32.365678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.366341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:32.374101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.374755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.375279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.377225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.378116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.379563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.713831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a7e880c-29e9-4ddd-905d-0471f2d5f53a tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.660999 Aug 29 10:40:32.714439 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 822/1531] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:40:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:32.718027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:32.720859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d5b412b-fec8-45f3-84d6-72b0f66cadd7 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6fe94c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.730240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:32.731871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:32.733556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-afc7dd53-61b4-4d70-bb4a-0a0ab93ce6b0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.379725 Aug 29 10:40:32.734975 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 710/1532] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:32 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:32.742817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.743148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:32.750927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.751427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.751903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.752642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.753201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.754084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.754833 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d5b412b-fec8-45f3-84d6-72b0f66cadd7 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455512128" status: 204 len: 0 microversion: 2.2 time: 0.038306 Aug 29 10:40:32.760015 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 823/1533] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Aug 29 10:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455512128 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:32.765528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:32.767811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:32.774843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.774999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.775351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.776064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.778127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.778731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.814502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25d7630f-8115-43af-ac91-b5339d024200 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055176 Aug 29 10:40:32.820457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 824/1534] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:32 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:32.825631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: .version_select at 0x7f66c952cca0>, body: {"addFloatingIp": {"address": "172.25.3.226"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:32.828420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:32.835294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.836242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.836904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.838267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:32.838267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:32.838574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:32.912057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:40:32.912845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquired lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:40:32.923676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:32.932320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40bfb337-4126-4948-ada0-d71e2415be0b tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.196203 Aug 29 10:40:32.933617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 711/1535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:32 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:32.938906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c73cb2c4-8b3a-48ca-9436-f5efddeadf2f tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6ebd4c0>, body: {"keypair": {"name": "tempest-keypair-472748868", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:32.957168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c73cb2c4-8b3a-48ca-9436-f5efddeadf2f tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:32.962750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c73cb2c4-8b3a-48ca-9436-f5efddeadf2f tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:33.014888 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c73cb2c4-8b3a-48ca-9436-f5efddeadf2f tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.079847 Aug 29 10:40:33.015579 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 712/1536] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:32 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:40:33.026817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7649fd2d-dd3e-4348-942e-fd373c1731fe tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6ed01f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.055395 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7649fd2d-dd3e-4348-942e-fd373c1731fe tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472748868" status: 204 len: 0 microversion: 2.2 time: 0.032719 Aug 29 10:40:33.064062 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 713/1537] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Aug 29 10:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472748868 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:33.070719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-351c16b5-0f37-4584-a961-6d4991e8d046 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e4cb80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-828185135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDH8AGI7Fc7r2HsV7Jf8RnkInpdZefC42ojnw8xCTAWVb2ueO0NI4oFj9SV8Ox9VrhJXlT+hXvb34Za1v8rzmtWVskV5AMZ7Uknx96HQHxf7PFLVRVH+5KmaRk7O1X/PA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:33.105407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-351c16b5-0f37-4584-a961-6d4991e8d046 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:33.111333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-351c16b5-0f37-4584-a961-6d4991e8d046 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:33.147839 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-351c16b5-0f37-4584-a961-6d4991e8d046 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.081561 Aug 29 10:40:33.148982 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 714/1538] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 10:40:33.164284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-546aadd1-c15f-4bee-af02-2016f4248b3a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e60d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-860807591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKscWa1TCYrfqlfF0krkMAsQ25tUnhA5jyCfOI3oRJY7jMHlMr1QTgXcWRYWo0FsOko21yZ41DDhEP0xGsgPU8oWhMEZaztecw5j43Dyg/vADlbDiBeEJ0otf4ND0sjmfQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:33.184527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-546aadd1-c15f-4bee-af02-2016f4248b3a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:33.191212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-546aadd1-c15f-4bee-af02-2016f4248b3a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:33.224044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-546aadd1-c15f-4bee-af02-2016f4248b3a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.065223 Aug 29 10:40:33.225136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 715/1539] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:40:33.230981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.235284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:33.243245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:33.244208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:33.244757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:33.245863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:33.246653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:33.247151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:33.525454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:33.536156 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-299521ef-cc5e-4433-9cba-f3ea5baae9d7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.309510 Aug 29 10:40:33.536817 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 716/1540] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:33 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:33.541571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-39f3facc-1bea-498d-9120-7c8bf9c57767 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e9ca60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1396429351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfUArhajDC0or1lec4LXyvohm1EyGUxRbdxJOApmgjavQA10Su7vNiwUUqOW1Lo6p1iadTpF344/yuldIeIVte6cjIsGMAVDI1RjToJsbR09NBn0G7BIac97XxPS0VnjA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:33.560750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-39f3facc-1bea-498d-9120-7c8bf9c57767 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:33.566952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-39f3facc-1bea-498d-9120-7c8bf9c57767 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:33.599799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-39f3facc-1bea-498d-9120-7c8bf9c57767 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.061893 Aug 29 10:40:33.601440 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 717/1541] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:40:33.615085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cf934bb-8223-432f-bdd4-8774444e394d tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e745e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.619469 n-d-854121-10 devstack@n-api.service[128682]: WARNING oslo_db.sqlalchemy.utils [None req-6cf934bb-8223-432f-bdd4-8774444e394d tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:40:33.629860 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cf934bb-8223-432f-bdd4-8774444e394d tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.021068 Aug 29 10:40:33.631027 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 718/1542] 10.222.0.47 () {60 vars in 1177 bytes} [Mon Aug 29 10:40:33 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:40:33.647088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0f7e230-8fa8-4788-81ec-ac8530124169 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e60670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.668273 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0f7e230-8fa8-4788-81ec-ac8530124169 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1396429351" status: 204 len: 0 microversion: 2.2 time: 0.029776 Aug 29 10:40:33.672359 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 719/1543] 10.222.0.47 () {60 vars in 1321 bytes} [Mon Aug 29 10:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1396429351 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:40:33.678285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75de928b-8331-4036-84ee-f8e091e243a3 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e35160>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.701597 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75de928b-8331-4036-84ee-f8e091e243a3 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-860807591" status: 204 len: 0 microversion: 2.2 time: 0.027778 Aug 29 10:40:33.702612 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 720/1544] 10.222.0.47 () {60 vars in 1318 bytes} [Mon Aug 29 10:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-860807591 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:33.715348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6fd638e6-1588-4ce8-8860-d21281494b74 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6ebda60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.740941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6fd638e6-1588-4ce8-8860-d21281494b74 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-828185135" status: 204 len: 0 microversion: 2.2 time: 0.032732 Aug 29 10:40:33.742144 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 721/1545] 10.222.0.47 () {60 vars in 1318 bytes} [Mon Aug 29 10:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-828185135 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:40:33.757483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f891c7b-2e38-4dfb-8fae-2cd241313f7a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6f04700>, body: {"keypair": {"name": "tempest-keypair-1216972579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnGo/XFAdH2yzMo5YvZoAhHth+BmHZ/X0HL1OZMrLXXes39BeLbC4BHnapzBL4MUnr6Gpj/qcWvQkPhtMI/2UZ4qv1davelrqq1Klk/n7IxzbAw6lHbazgFYJiytedgog=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:33.782359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4f891c7b-2e38-4dfb-8fae-2cd241313f7a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:33.788795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4f891c7b-2e38-4dfb-8fae-2cd241313f7a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:33.800465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:33.822977 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f891c7b-2e38-4dfb-8fae-2cd241313f7a tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.071297 Aug 29 10:40:33.825816 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 722/1546] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Aug 29 10:40:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:40:33.835636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:33.836352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:33.842696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:33.843266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:33.843778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:33.844557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:33.845081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:33.845578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.116270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:34.129565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:34.129565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:34.138489 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77697376-6300-46f1-b246-d26fa0680ce1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.299962 Aug 29 10:40:34.139192 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 723/1547] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:33 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:34.157075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:34.160446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:34.172735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.173989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.175785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.176911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.177617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.178418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.216429 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02aab54d-f969-45a1-8859-003f1199d704 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069655 Aug 29 10:40:34.217014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 724/1548] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:34 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:34.222565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a641d28e-be19-41ea-87d1-21d6dd8e2977 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e74af0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:34.231541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a641d28e-be19-41ea-87d1-21d6dd8e2977 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1216972579" status: 200 len: 513 microversion: 2.2 time: 0.013497 Aug 29 10:40:34.240535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 725/1549] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Aug 29 10:40:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1216972579 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:34.240535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:34.240535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:34.245784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.246343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.246787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.247499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.247962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.248491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.519513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:34.529284 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-201474ed-e745-4a80-b359-8031259739c6 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.295194 Aug 29 10:40:34.530629 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 726/1550] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:34 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:34.548777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bbfef77-0921-4748-8ef0-348bc6120a78 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e740d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:34.575688 n-d-854121-10 devstack@n-api.service[128682]: WARNING oslo_db.sqlalchemy.utils [None req-3bbfef77-0921-4748-8ef0-348bc6120a78 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:40:34.580134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:40:34.582506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bbfef77-0921-4748-8ef0-348bc6120a78 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.048799 Aug 29 10:40:34.585870 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 727/1551] 10.222.0.47 () {60 vars in 1177 bytes} [Mon Aug 29 10:40:34 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:34.590895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:34.591631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:34.600762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.601359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.601922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:34.602713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:34.603246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:34.603749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:35.462037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:35.469997 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51da08de-4959-4f6b-8318-2fece7cc4eed tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.883006 Aug 29 10:40:35.470798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 728/1552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:34 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:35.491305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73bb8d5-65ee-4179-8f1a-30d97276a727", "tag": "c16fab9c-1289-4323-97f4-6f87daebbab4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:35.506032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:35.506513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:35.506944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:35.520972 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] Creating event network-changed:c16fab9c-1289-4323-97f4-6f87daebbab4 for instance d73bb8d5-65ee-4179-8f1a-30d97276a727 on n-h2-854121-10 Aug 29 10:40:35.534377 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-96fd4930-a0e5-4b53-9bf9-df05d2693a52 req-6011f6b1-0100-4a6d-b0b0-455405878eb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Aug 29 10:40:35.546882 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 729/1553] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:35.561770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5d0d05b-8249-471e-a1a5-b708fe7a045c tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e3fee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:35.597835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5d0d05b-8249-471e-a1a5-b708fe7a045c tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216972579" status: 204 len: 0 microversion: 2.2 time: 0.050284 Aug 29 10:40:35.602512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 730/1554] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Aug 29 10:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216972579 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:35.615760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:35.616451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:35.638189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:35.638788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:35.639229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:35.640229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:35.645751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:35.645751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.164333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:36.177465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:36.181422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:36.183926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6652a7aa-a9da-4b51-8e7f-d6647d338b2c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.580158 Aug 29 10:40:36.185610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 731/1555] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:35 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:36.192208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:36.195175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:36.203901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.204750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.206571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.208599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.209531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.210364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.255551 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-258625a7-929e-4130-a099-7f23e2f8a97a tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068501 Aug 29 10:40:36.257463 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 732/1556] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:40:36 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:40:36.273459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:36.276964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:36.289958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.294239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.299722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.302385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.303296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.307543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.579397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Updating instance_info_cache with network_info: [{"id": "c16fab9c-1289-4323-97f4-6f87daebbab4", "address": "fa:16:3e:91:72:b8", "network": {"id": "4ce7087a-e7e6-464c-800e-ebc499b2a8b5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-898290662-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "75c4e9e2642c49ca91e44474dc29a2a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc16fab9c-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:40:36.601689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Releasing lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:40:36.604069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ea0cbe5-1853-43e7-93e3-f97457f90a9c tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 202 len: 0 microversion: 2.1 time: 3.781400 Aug 29 10:40:36.605981 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 825/1557] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:32 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 0 bytes in 3785 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:40:36.631492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Action: 'create', calling method: .version_select at 0x7f66c6e30820>, body: {"keypair": {"name": "tempest-keypair-1754983459", "type": "x509"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:36.661016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:36.669836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:36.693338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.processutils [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmnsoyr74/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmnsoyr74/temp.key -subj /CN=8f68af959176491aa5fd671046d7faf4 -extensions v3_req_client {{(pid=128681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 10:40:36.719242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:36.742706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-461791d5-202f-4336-9b2f-2006717eb469 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.483844 Aug 29 10:40:36.757184 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 733/1558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:36 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:36.762061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:36.762872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:36.769730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.770460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.770603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:36.771238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:36.771694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:36.772221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:37.020777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.processutils [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmnsoyr74/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmnsoyr74/temp.key -subj /CN=8f68af959176491aa5fd671046d7faf4 -extensions v3_req_client" returned: 0 in 0.327s {{(pid=128681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 10:40:37.022476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.processutils [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmnsoyr74/temp.key -password pass: {{(pid=128681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 10:40:37.087995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.processutils [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmnsoyr74/temp.key -password pass:" returned: 0 in 0.065s {{(pid=128681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 10:40:37.163144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:37.178468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Getting quotas for user 8f68af959176491aa5fd671046d7faf4 and project da9bb065a4c74abdb6742465b54724aa. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:37.223481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a554548-7a22-4ed3-947f-80d343f95f04 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.611606 Aug 29 10:40:37.225552 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 826/1559] 10.222.0.47 () {62 vars in 1198 bytes} [Mon Aug 29 10:40:36 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 619 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:37.241168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1680154083", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bc24b41b-5dcc-4207-a850-f4f50c947735"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:37.349483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] validate_networks() for [('bc24b41b-5dcc-4207-a850-f4f50c947735', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:40:37.602079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:37.621992 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3274b93a-aa14-4f3f-a14d-692566c879f5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.862407 Aug 29 10:40:37.624441 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 734/1560] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:36 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:37.632891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1708a975-9795-4095-80fd-42d7f4a210c6 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'create', calling method: .version_select at 0x7f66c6d8a1f0>, body: {"pool": "7b4815eb-0686-4480-b1c1-43f6f902729a"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:38.603681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:40:38.604788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:40:38.605481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:40:38.606174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:40:38.606942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:40:38.620300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:38.620827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:38.621362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:38.622260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:38.622798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:38.623310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:38.646670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:38.655756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Getting quotas for user 2789020d0cef4674be08b8aaa391ded6 and project 1ec0ce49b59d416e9b630418b307fcd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:38.672649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:40:38.676938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:40:38.692196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:38.732312 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12e6f921-01f1-4bd6-8059-518de693462b tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505167 Aug 29 10:40:38.734457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 827/1561] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:40:38.740670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:38.741589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:38.750628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:38.751463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:38.752174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:38.754496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:38.755240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:38.755903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.000078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:39.012986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:39.014575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:39.015668 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24f91ff5-85e7-41bb-98e4-fe63a7e44d34 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.279979 Aug 29 10:40:39.016393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 828/1562] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:38 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:39.042731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0e5223b6-3c57-47f0-b388-4a2cb121943e tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c74a6670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:39.054049 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0e5223b6-3c57-47f0-b388-4a2cb121943e tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1754983459" status: 200 len: 1534 microversion: 2.2 time: 0.017393 Aug 29 10:40:39.054797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 829/1563] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Aug 29 10:40:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1754983459 => generated 1534 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:39.060502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b60670e-e446-465f-9682-785bf357a149", "name": "network-vif-plugged", "status": "completed", "tag": "8d8b40ab-28c2-4510-9ce3-43aba828a5dc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:39.072387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.073135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.073583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.087048 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] Creating event network-vif-plugged:8d8b40ab-28c2-4510-9ce3-43aba828a5dc for instance 2b60670e-e446-465f-9682-785bf357a149 on n-h2-854121-10 Aug 29 10:40:39.093624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-70a6a511-00a5-4208-ab39-44979c3da214 req-282a079d-afbf-467d-9c37-fe5fbac4753f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036602 Aug 29 10:40:39.094764 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 830/1564] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:39.101673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ae5faf-832a-4a32-9fa1-6c8faa805d70", "name": "network-vif-unplugged", "status": "completed", "tag": "de6638be-9318-49a6-992d-99a3ea048be1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:39.115480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.116246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.116927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.131951 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] Creating event network-vif-unplugged:de6638be-9318-49a6-992d-99a3ea048be1 for instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 on n-h1-854121-10 Aug 29 10:40:39.140208 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-aba08ae2-d880-4930-b8f3-c0cc59227951 req-6f24b96b-99a9-4c6e-9b9b-afd0e02d9e95 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043897 Aug 29 10:40:39.142771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 831/1565] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:39.152794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:39.153752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:39.161550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.162715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.163469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.164358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.164988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.165584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.848967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:39.857817 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ab6bc7cb-7173-4f55-b9c8-77c008c5823a tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.712675 Aug 29 10:40:39.858982 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 832/1566] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:39 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:39.866949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:39.868675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:39.875808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.876385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.877044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:39.877792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:39.878809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:39.879357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.133657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:40.141870 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ba791576-0296-492d-9b12-468e2ba2f174 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.281528 Aug 29 10:40:40.142477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 833/1567] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:39 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:40.147854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:40.148471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:40.157137 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1708a975-9795-4095-80fd-42d7f4a210c6 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.531091 Aug 29 10:40:40.158315 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 735/1568] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:40:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:40.159067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.160123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.160625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.161411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.161967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.162461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.164172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58a3a5e9-0935-41bb-bc40-7292235dbd75 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6e605e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:40.170008 n-d-854121-10 devstack@n-api.service[128682]: WARNING oslo_db.sqlalchemy.utils [None req-58a3a5e9-0935-41bb-bc40-7292235dbd75 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:40:40.176078 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58a3a5e9-0935-41bb-bc40-7292235dbd75 tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015621 Aug 29 10:40:40.177290 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 736/1569] 10.222.0.47 () {60 vars in 1177 bytes} [Mon Aug 29 10:40:40 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:40.183495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:40.184399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:40.196799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.197302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.197795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.198531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.199000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.199429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.244311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:40.256472 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff9d51c4-1a88-44fe-848b-0ce9a107c959 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1270 microversion: 2.1 time: 0.112659 Aug 29 10:40:40.257107 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 834/1570] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:40 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:40.267309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.148"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:40.271813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:40.281312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.282173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.284333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.286436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.286937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.287898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.331796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:40:40.332500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquired lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:40:40.415412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:40.429993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:40.431802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:40.433322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d1201e3-1c17-44fd-b052-6f6a93d80fc1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.254860 Aug 29 10:40:40.446812 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 737/1571] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:40 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:40.457913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40709283-1939-4684-92df-e5412ab08bbd tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] Calling method '.version_select at 0x7f66c6ebddc0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:40.497721 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40709283-1939-4684-92df-e5412ab08bbd tempest-KeyPairsV22TestJSON-566961970 tempest-KeyPairsV22TestJSON-566961970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754983459" status: 204 len: 0 microversion: 2.2 time: 0.049269 Aug 29 10:40:40.499651 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 738/1572] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Aug 29 10:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754983459 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:40:40.880959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:40.888837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:40.898641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.899575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.900398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.901457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:40.902068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:40.902874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:40.907812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:41.137815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a.", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:40:41.139394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Releasing lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:40:41.140427 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.140427 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Request method failure captured: Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action HTTP/1.1 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 46 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJeJV1BRVEr0w522jfzRftJ5qwmxIkKp9ZVgzYDtob4La2BA4yYPyVKUYMoFz9hq6m0BV4CVQ4FYo8_YdstPjXLNT5kOrBWHL7NjfFjC4qFR8aufXEMAltBtt6vmcHQJ1FPCvZ3xpVxTN7CaPsLt8YX9gOOoASB3UCqqrqolSIsjfBs Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 53f12313264d4d2faa86f19e1e8c4059 Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: {"addFloatingIp": {"address": "172.25.3.148"}} Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd73bb8d5-65ee-4179-8f1a-30d97276a727', 'body': {'addFloatingIp': {'address': '172.25.3.148'}}} Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:40:41.182641 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] Aug 29 10:40:41.187707 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:41.196596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Returning 400 to user: Cannot associate floating IP 172.25.3.148 (ad71556c-1949-44d2-ab2f-5f230eb4b2f2) with port c16fab9c-1289-4323-97f4-6f87daebbab4 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 7b4815eb-0686-4480-b1c1-43f6f902729a. Aug 29 10:40:41.196596 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ae6097be-2201-4f97-9081-c81fed6d2e94'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:41.197522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-667243d1-650a-43f4-bce5-43aa8561b2f7 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 400 len: 382 microversion: 2.1 time: 0.934736 Aug 29 10:40:41.204739 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 835/1573] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:40 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 382 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:40:41.209450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:41.209980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ae5faf-832a-4a32-9fa1-6c8faa805d70", "tag": "de6638be-9318-49a6-992d-99a3ea048be1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:41.218558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4989f83f-5693-46a3-8ebb-61fecab622ed tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1292 microversion: 2.1 time: 0.343384 Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 739/1574] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:40 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1292 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:41.232618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:41.234082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:41.234803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:41.235331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:41.241228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:41.241228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:41.241228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:41.261246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] Creating event network-changed:de6638be-9318-49a6-992d-99a3ea048be1 for instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 on n-h1-854121-10 Aug 29 10:40:41.267468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-44f0e6ec-bd3f-4e7f-a520-24794d5e4f9b req-e92473a3-20fd-441c-96ee-d272973b4d00 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061457 Aug 29 10:40:41.269256 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 836/1575] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:41.274830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-932f6193-b622-431b-8ca2-a60dd198d2a2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '.version_select at 0x7f66c7505f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:41.982578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:41.994716 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50bbe80d-40ae-4c8d-ad96-9b67052f6ed0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.774019 Aug 29 10:40:41.995656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 740/1576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:41 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:42.005644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:42.006325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:42.018026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.018556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.019265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.019871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.020327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.020780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.162829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:42.180257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64a2e00d-c2a5-4dca-b0de-6dd4b72f82f3 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1276 microversion: 2.1 time: 0.182775 Aug 29 10:40:42.181641 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 741/1577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:41 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:42.187424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:42.198584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:42.211312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.212519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.213202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.214199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.215040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.215717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.554921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:42.569192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:42.571476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:42.573918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6121772d-4a2c-4c46-854f-9507994d96e2 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.389949 Aug 29 10:40:42.575302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 742/1578] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:42 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:42.595807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:42.598042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:42.607118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.608061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.608837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.610371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:42.611456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:42.613400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:42.995422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:43.005520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-069f4572-463f-4330-a335-1c72a1cfb695 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1484 microversion: 2.1 time: 0.428869 Aug 29 10:40:43.006771 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 743/1579] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:42 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1484 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:43.022647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-824504208", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a0ef28b9-57a1-4ef0-9645-ec05cf810a01"}], "block_device_mapping_v2": [{"uuid": "3ab6dff3-7057-409a-bb90-4952fe6955a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:43.146582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] validate_networks() for [('a0ef28b9-57a1-4ef0-9645-ec05cf810a01', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:40:43.293627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-932f6193-b622-431b-8ca2-a60dd198d2a2 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/ad71556c-1949-44d2-ab2f-5f230eb4b2f2" status: 202 len: 0 microversion: 2.1 time: 2.022448 Aug 29 10:40:43.298485 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 837/1580] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:40:41 2022] DELETE /compute/v2.1/os-floating-ips/ad71556c-1949-44d2-ab2f-5f230eb4b2f2 => generated 0 bytes in 2028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:43.307100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:43.309320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:43.323329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:43.324719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:43.325771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:43.327022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:43.327738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:43.329431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:43.775309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:43.789267 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-105e2a03-a94b-478a-ad63-da5de8f0822b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.488393 Aug 29 10:40:43.790890 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 838/1581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:43 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:43.803491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=28 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:43.804190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:43.807467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:43.821181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:43.821809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:43.822693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:43.825159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:43.826633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:43.827091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:43.838579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:44.372062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78b3ee65-b822-4d30-adc2-619556641701 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.579329 Aug 29 10:40:44.372786 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 839/1582] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:40:43 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149/os-interface => generated 285 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:44.385012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:44.386229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:44.394552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.395373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.398283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:44.399580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.400281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.400890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:44.445033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:40:44.445973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:40:44.446532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:40:44.447015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:40:44.447439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:40:44.464331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.465430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.466431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:44.468135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.469151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.470641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:44.526557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:40:44.535194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Getting quotas for user 30e7715efc824e0d9dc68fc5eb4b398b and project af9408db02324de389c1364747169f4e. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:40:44.644895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:40:44.647191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ab6dff3-7057-409a-bb90-4952fe6955a1',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:40:44.754688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:44.767611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27d67bf3-6dff-48b0-b653-bc0164166660 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1318 microversion: 2.1 time: 0.393761 Aug 29 10:40:44.768808 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 840/1583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:44 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:44.782472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: .version_select at 0x7f66c9452c10>, body: {"removeFloatingIp": {"address": "172.25.3.226"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:44.940431 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd6d6a8e-306b-423d-b69d-3dba2212f3e7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.931206 Aug 29 10:40:44.941289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 744/1584] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:40:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:40:44.946231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:44.948015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:44.979576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.980342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.980978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:44.981944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:44.982569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:44.983319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:45.172298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:45.182627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:45.185313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:45.186580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:45.191104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:45.194757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:45.195355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:45.464429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:45.482778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:45.503220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:45.505398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-827514e7-a4f0-43c1-8822-fab949d2f2ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.562740 Aug 29 10:40:45.506389 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 745/1585] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:44 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:45.516465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:45.517490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:45.532622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:45.537536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:45.539195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:45.540244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:45.541593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:45.542471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.012718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:40:46.013516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquired lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:40:46.073167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:46.082606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b64f562-c3ac-43bb-9302-c1e5d4d2dd7c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.574494 Aug 29 10:40:46.087124 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 746/1586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:45 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:46.092402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:46.097445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:46.107414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.109562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.110191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.111289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.111948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.112534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.397061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:46.419108 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-39d8005f-0384-40fe-ba3f-2d3079e42d1e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1094 microversion: 2.1 time: 0.328512 Aug 29 10:40:46.436912 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 747/1587] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:46 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1094 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:46.448762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:46.454490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:46.463976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.464819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.466272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.468014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.468747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.469410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.525089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'flavor' on Instance uuid d10989fe-e7ee-401e-b4cd-9acb94caf42c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:46.838346 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62aa873e-993e-46f9-aa7d-6ba7390852db tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/action" status: 200 len: 32 microversion: 2.1 time: 0.399434 Aug 29 10:40:46.839662 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 748/1588] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:46 2022] POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:40:46.859585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c43f71a-1025-46d8-89ba-321bba5cee91", "tag": "a5d5a385-8c17-4182-9891-94d504e585c2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:46.882053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.886018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.886907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.907729 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] Creating event network-changed:a5d5a385-8c17-4182-9891-94d504e585c2 for instance 4c43f71a-1025-46d8-89ba-321bba5cee91 on n-h1-854121-10 Aug 29 10:40:46.919379 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7aa7e888-7a56-4915-a1c8-f0c4a16015db req-8b6ec23b-e021-4d5f-a208-28668aa1e687 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077057 Aug 29 10:40:46.921083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 749/1589] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:46.930022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:46.931333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:46.955154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.959768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.960847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:46.970509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:46.975353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:46.976145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:47.481797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:47.492553 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af7ecbb7-6adc-4ec4-a69b-e77dbfc84485 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1318 microversion: 2.1 time: 0.569130 Aug 29 10:40:47.494401 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 750/1590] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:46 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:47.508119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:47.509108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:47.524609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:47.525975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:47.527158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:47.528266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:47.529099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:47.529948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:47.983034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:48.002589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:48.005036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:48.008942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bcefe71d-4a37-4bee-b2a9-34bace8f5bb7 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1486 microversion: 2.25 time: 0.511598 Aug 29 10:40:48.010229 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 751/1591] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:47 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1486 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:48.015274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:48.016165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:48.045211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:48.046256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:48.047976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:48.048991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:48.050591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:48.051882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:48.635309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:48.664662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=14 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:49.125440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:40:49.187809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:49.198525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a30265b-5ee1-4c74-a689-12756f858c1e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 1.186923 Aug 29 10:40:49.201143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 752/1592] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:48 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:49.210464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:49.211356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:49.229924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:49.230683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:49.231298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:49.232239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:49.232863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:49.233463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:49.721158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:49.729787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9678c06f-a95a-4626-b56f-6c763adca254 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.527484 Aug 29 10:40:49.730390 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 753/1593] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:49 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:49.743939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:49.744787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:49.762286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:49.763657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:49.764301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:49.765428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:49.767067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:49.767790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:50.076652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:50.090662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5a58387-116d-4702-b471-26d8cf95a3ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1168 microversion: 2.1 time: 0.350626 Aug 29 10:40:50.110119 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 754/1594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:49 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1168 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:50.119407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:50.120038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:50.133299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:50.133836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:50.134283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:50.135018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:50.135464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:50.138294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:50.188451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:50.584063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:50.592921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8460b7f5-6c47-47d0-8bbe-21e0884a2737 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1484 microversion: 2.1 time: 0.481334 Aug 29 10:40:50.597387 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 755/1595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:50 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1484 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:50.602556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b60670e-e446-465f-9682-785bf357a149", "tag": "8d8b40ab-28c2-4510-9ce3-43aba828a5dc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:50.632186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:50.632950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:50.633495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:50.681967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] Creating event network-changed:8d8b40ab-28c2-4510-9ce3-43aba828a5dc for instance 2b60670e-e446-465f-9682-785bf357a149 on n-h2-854121-10 Aug 29 10:40:50.699500 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0eff3a29-6089-4545-9cc0-1c19d8a7b3a7 req-7f4d5f62-5039-49eb-b0e4-46044887ca59 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100391 Aug 29 10:40:50.700193 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 756/1596] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:50.725604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:50.732151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:50.749895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:50.750330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:50.750784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:50.751677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:50.752661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:50.757130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:51.641345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:51.655647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ad09716-e329-4a36-8de9-123d78bcd302 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1318 microversion: 2.1 time: 0.953310 Aug 29 10:40:51.657351 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 757/1597] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:50 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:51.665526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:51.673299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:51.690687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:51.691514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:51.692170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:51.693080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:51.693770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:51.694391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.162231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Updating instance_info_cache with network_info: [{"id": "c16fab9c-1289-4323-97f4-6f87daebbab4", "address": "fa:16:3e:91:72:b8", "network": {"id": "4ce7087a-e7e6-464c-800e-ebc499b2a8b5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-898290662-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "75c4e9e2642c49ca91e44474dc29a2a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc16fab9c-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:40:52.186934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Releasing lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:40:52.187992 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-255a3225-7d4c-4aaa-8981-7c722a2bc503 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 202 len: 0 microversion: 2.1 time: 7.415925 Aug 29 10:40:52.188610 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 841/1598] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:44 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 0 bytes in 7417 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:40:52.206138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73bb8d5-65ee-4179-8f1a-30d97276a727", "tag": "c16fab9c-1289-4323-97f4-6f87daebbab4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:52.273073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.273571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.274038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.314175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:52.326821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:52.328748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] Creating event network-changed:c16fab9c-1289-4323-97f4-6f87daebbab4 for instance d73bb8d5-65ee-4179-8f1a-30d97276a727 on n-h2-854121-10 Aug 29 10:40:52.343671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:52.345245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ab96f95-877f-4c57-a134-c572ae4062fd tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1476 microversion: 2.25 time: 0.686583 Aug 29 10:40:52.347387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-29996a9f-89fc-409a-9040-0ba98e35604a req-40001305-3801-422c-a813-a814ed1914c6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157194 Aug 29 10:40:52.348484 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 842/1599] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:52.354441 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 758/1600] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:51 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1476 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:52.362660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:52.363821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:52.383806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.384792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.385481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.386532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.387169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.387521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:52.388020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.390908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:52.412449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.421056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.421637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.426755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.427340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.427791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.915245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:52.931628 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a035305-7042-4264-9d0e-35d1797f5a10 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 0.579196 Aug 29 10:40:52.932241 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 843/1601] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:52 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:52.946441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:52.947155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:52.954169 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e756bcb8-d6e9-473f-a6b6-478b75fc43b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1542 microversion: 2.1 time: 0.598104 Aug 29 10:40:52.954854 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 759/1602] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:52 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:52.969645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:52.969645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.969645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.970077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.970767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:52.971732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:52.972173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:52.975252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-438e16a7-7e99-4989-9912-1444b93ef85f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '.version_select at 0x7f66c6f04550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:54.009502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:54.020141 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b935983-eae7-441e-a4ac-522270a651a9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1210 microversion: 2.1 time: 1.086763 Aug 29 10:40:54.021813 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 844/1603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:52 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1210 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:54.033833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0988d89-b164-471a-a336-bd46c23af2f9 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '.version_select at 0x7f66c71f5f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:54.051120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0988d89-b164-471a-a336-bd46c23af2f9 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.051627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0988d89-b164-471a-a336-bd46c23af2f9 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.052058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0988d89-b164-471a-a336-bd46c23af2f9 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.086244 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0988d89-b164-471a-a336-bd46c23af2f9 tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 4263 microversion: 2.25 time: 0.052553 Aug 29 10:40:54.109100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 845/1604] 10.222.0.47 () {60 vars in 1184 bytes} [Mon Aug 29 10:40:54 2022] GET /compute/v2.1/os-migrations => generated 4263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:54.116462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:54.135426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:54.153847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.159740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.160188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.162664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.163147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.163577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.493592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:54.503494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:54.514702 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c69b217-cc7d-4d72-ad94-62cb38fa0e26 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1318 microversion: 2.1 time: 0.401869 Aug 29 10:40:54.515301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 846/1605] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:54 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:54.529345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c43f71a-1025-46d8-89ba-321bba5cee91", "name": "network-vif-plugged", "status": "completed", "tag": "a5d5a385-8c17-4182-9891-94d504e585c2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:54.547646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:54.558572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.559065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.559587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.591640 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] Creating event network-vif-plugged:a5d5a385-8c17-4182-9891-94d504e585c2 for instance 4c43f71a-1025-46d8-89ba-321bba5cee91 on n-h1-854121-10 Aug 29 10:40:54.604892 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c7e2b938-901e-423f-a730-29d73c5a2b67 req-a6b532c3-a1d2-4504-b705-dbc12b344f91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080554 Aug 29 10:40:54.605678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 847/1606] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:54.620211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2d8c61-fa9b-482a-895f-529ef179c89d", "tag": "05d73088-a615-435f-9feb-a9acb37872e0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:54.643703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.644530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.645250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.672611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] Creating event network-changed:05d73088-a615-435f-9feb-a9acb37872e0 for instance 6a2d8c61-fa9b-482a-895f-529ef179c89d on n-h1-854121-10 Aug 29 10:40:54.683397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d409efe6-c984-4445-94ea-fd1ad67e0646 req-eccead85-dd5c-43dd-a407-23a6d560c7eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076240 Aug 29 10:40:54.687978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 848/1607] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:54.703092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:54.706143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:54.725033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.726150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.727460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:54.728504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:54.732250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:54.732951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:55.444242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:55.467005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f2c20f81-c50d-488b-9860-fee85c88aa64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 0.775882 Aug 29 10:40:55.468910 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 849/1608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:54 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:55.479253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:55.484123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:55.502711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:55.505070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:55.505774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:55.506874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:55.508865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:55.511185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:56.061628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:56.078022 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-85779cd6-9344-4a62-afa6-47511af448ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1541 microversion: 2.1 time: 0.606797 Aug 29 10:40:56.079006 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 850/1609] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:55 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1541 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:56.088376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:56.089030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:56.106402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:56.107205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:56.109167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:56.114287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:56.121619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:56.123905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:56.644682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-438e16a7-7e99-4989-9912-1444b93ef85f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/61d9c827-3050-47bd-91a5-aa25bffbdecd" status: 202 len: 0 microversion: 2.1 time: 3.686163 Aug 29 10:40:56.646017 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 760/1610] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:40:52 2022] DELETE /compute/v2.1/os-floating-ips/61d9c827-3050-47bd-91a5-aa25bffbdecd => generated 0 bytes in 3691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:40:56.668243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:56.670068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:56.688072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:56.692888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:56.693404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:56.694186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:56.694662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:56.704042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.056674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] Lazy-loading 'services' on Instance uuid 73ae5faf-832a-4a32-9fa1-6c8faa805d70 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:40:57.077583 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-042abcf2-5c93-4062-9642-d35dba0254af tempest-LiveAutoBlockMigrationV225Test-1436957962 tempest-LiveAutoBlockMigrationV225Test-1436957962-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1970 microversion: 2.25 time: 0.996767 Aug 29 10:40:57.099553 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 851/1611] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:56 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1970 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:40:57.123878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:57.125981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:57.139069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.139969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.140774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.142011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.143293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.144172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.766256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:57.774934 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce35b245-f4f6-451b-a959-293b74dd52be tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1210 microversion: 2.1 time: 1.127613 Aug 29 10:40:57.775514 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 761/1612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:56 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1210 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:57.780352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:57.782524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:57.796347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.796835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.797268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.797999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.798452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.799602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.836177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:57.845471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15f3f870-2586-4b2d-a1fa-a11389077525 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1507 microversion: 2.1 time: 0.746327 Aug 29 10:40:57.846861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 852/1613] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:57 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:57.851828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0df3ea7-60d1-4c65-b1f2-0120cbc28c62 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0df3ea7-60d1-4c65-b1f2-0120cbc28c62 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Request method failure captured: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action HTTP/1.1 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 34 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJeJV1BRVEr0w522jfzRftJ5qwmxIkKp9ZVgzYDtob4La2BA4yYPyVKUYMoFz9hq6m0BV4CVQ4FYo8_YdstPjXLNT5kOrBWHL7NjfFjC4qFR8aufXEMAltBtt6vmcHQJ1FPCvZ3xpVxTN7CaPsLt8YX9gOOoASB3UCqqrqolSIsjfBs Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 53f12313264d4d2faa86f19e1e8c4059 Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: {"addFloatingIp": {"address": ""}} Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd73bb8d5-65ee-4179-8f1a-30d97276a727', 'body': {'addFloatingIp': {'address': ''}}} Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '' Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:40:57.856081 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0df3ea7-60d1-4c65-b1f2-0120cbc28c62 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0df3ea7-60d1-4c65-b1f2-0120cbc28c62 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 400 len: 142 microversion: 2.1 time: 0.009744 Aug 29 10:40:57.862449 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 853/1614] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:57 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:40:57.864613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-unplugged", "status": "completed", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}, {"name": "network-changed", "server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:57.874973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.875452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.875888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.898188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Creating event network-vif-unplugged:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h1-854121-10 Aug 29 10:40:57.898722 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Creating event network-changed:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h1-854121-10 Aug 29 10:40:57.912645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:40:57.930682 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3f01e388-e1e0-426e-96be-1075164b42e5 req-67f65193-2c02-4ab2-8ad1-b1113a5e290a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071110 Aug 29 10:40:57.932326 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 854/1615] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:40:57.943861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:57.944828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:57.952529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.954039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.956621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:57.958234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:57.958884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:57.960560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:58.898705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:58.910380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-616d1bd5-7c99-48fe-83eb-699dabe0f206 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1541 microversion: 2.1 time: 0.975058 Aug 29 10:40:58.925973 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 855/1616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:57 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1541 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:58.941535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:58.942321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:58.956071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:58.958739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:58.959541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:58.960485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:58.961240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:58.962017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:58.995443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:40:59.070336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:59.086616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dece7bea-210d-4d72-8415-34686574d6bf tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 1.308716 Aug 29 10:40:59.088455 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 762/1617] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:57 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:59.126874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: .version_select at 0x7f66c952cca0>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:59.131660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:59.145162 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83aa2549-05ea-4a29-8859-f8d735b85aec tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 204 len: 0 microversion: 2.25 time: 0.216624 Aug 29 10:40:59.145807 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 856/1618] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:40:58 2022] DELETE /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:40:59.146033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.147040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.147737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.149141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.149997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.150752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.152659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:59.153364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:59.168603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.169130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.169560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.176537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.177282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.177805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.185155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:59.284437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:40:59.286177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquired lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:40:59.674846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Releasing lock "refresh_cache-d73bb8d5-65ee-4179-8f1a-30d97276a727" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:40:59.676149 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] HTTP exception thrown: floating IP not found Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Request method failure captured: Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action HTTP/1.1 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 41 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJeJV1BRVEr0w522jfzRftJ5qwmxIkKp9ZVgzYDtob4La2BA4yYPyVKUYMoFz9hq6m0BV4CVQ4FYo8_YdstPjXLNT5kOrBWHL7NjfFjC4qFR8aufXEMAltBtt6vmcHQJ1FPCvZ3xpVxTN7CaPsLt8YX9gOOoASB3UCqqrqolSIsjfBs Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 53f12313264d4d2faa86f19e1e8c4059 Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: exception: floating IP not found Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd73bb8d5-65ee-4179-8f1a-30d97276a727', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 29 10:40:59.680375 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Returning 404 to user: floating IP not found {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b59b16e2-2f8c-42eb-9859-ded75072bdd3 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 404 len: 67 microversion: 2.1 time: 0.579907 Aug 29 10:40:59.692823 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 763/1619] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:59 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 67 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:40:59.694096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:59.694950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:59.696970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:40:59.703474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.703971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.704425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.705166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.705629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.706210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.730472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:40:59.739733 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c3975ae-1bfc-4271-8548-bf80d5ce1acf tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.591672 Aug 29 10:40:59.740329 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 857/1620] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:40:59 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:40:59.745345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b97e9d1-7466-42dc-9829-71b6a4bd3e2d tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:40:59.896756 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2b97e9d1-7466-42dc-9829-71b6a4bd3e2d tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b97e9d1-7466-42dc-9829-71b6a4bd3e2d tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Request method failure captured: Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action HTTP/1.1 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 44 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJeJV1BRVEr0w522jfzRftJ5qwmxIkKp9ZVgzYDtob4La2BA4yYPyVKUYMoFz9hq6m0BV4CVQ4FYo8_YdstPjXLNT5kOrBWHL7NjfFjC4qFR8aufXEMAltBtt6vmcHQJ1FPCvZ3xpVxTN7CaPsLt8YX9gOOoASB3UCqqrqolSIsjfBs Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 53f12313264d4d2faa86f19e1e8c4059 Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: exception: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd73bb8d5-65ee-4179-8f1a-30d97276a727', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 29 10:40:59.900380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b97e9d1-7466-42dc-9829-71b6a4bd3e2d tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b97e9d1-7466-42dc-9829-71b6a4bd3e2d tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action" status: 404 len: 88 microversion: 2.1 time: 0.162811 Aug 29 10:40:59.907678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 858/1621] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:40:59 2022] POST /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727/action => generated 88 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:40:59.914772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:40:59.915466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:40:59.924525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.925358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.925936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.927003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:40:59.927918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:40:59.928441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:40:59.957240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:00.056410 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c373bda-8658-4ab6-aecc-e6cf53b7d110 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 204 len: 0 microversion: 2.1 time: 0.145304 Aug 29 10:41:00.057804 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 859/1622] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:40:59 2022] DELETE /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:41:00.064917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:00.066487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:00.074911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.075673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.076350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.077967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.078607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.079222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.219164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.235990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.242521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.245002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ea9c36e-5bb1-43a3-959a-ea61bcf9b1d4 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1482 microversion: 2.25 time: 0.557134 Aug 29 10:41:00.247029 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 764/1623] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:40:59 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1482 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:00.258089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:00.260803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:00.268242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.268973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.269610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.270548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.271169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.271963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.539819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.550471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e2649e4c-e7ce-431a-aede-bcca929e3395 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1473 microversion: 2.1 time: 0.491065 Aug 29 10:41:00.551069 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 860/1624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:00 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1473 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:00.555480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:00.556157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:00.562027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.562524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.562968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.563661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.564649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.565100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.705224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.713231 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe074fdd-6cbf-4869-8fc1-a1e5b4371004 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1542 microversion: 2.1 time: 0.464902 Aug 29 10:41:00.713863 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 765/1625] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:00 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1542 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:00.718636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2d462636-6d1b-4b47-8d0e-5c26b31013d9"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:00.721912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:00.728185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.728659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.729134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.729871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.730332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.730781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.780845 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] HTTP exception thrown: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Request method failure captured: Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91/os-volume_attachments/480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 HTTP/1.1 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 74 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJc2tvm2XVYBr0GaVZTPB13BjJsaQ-J2MZO2lpM7iCZxBJPJYvNOnjNszPDvkxE6d9F044f7gMmE987yyGXGhn3KSUpDlCDDKc98HBFfdNqKQjODEJgIP7Cfmz20vsFucKdLe-bMEMF7vqmMwccSl3oosOIKHTTq1c4niUSilLgieV0 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 04c678a3336e4328a494ec8a7520715f Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_04c678a3336e4328a494ec8a7520715f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/04c678a3336e4328a494ec8a7520715f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 04c678a3336e4328a494ec8a7520715f Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-15076440 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesAdminNegativeTest-15076440-project-admin Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4259d7be5acd4427b000ef2b5c0b0e14 Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesAdminNegativeTest-15076440-project-admin Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: {"volumeAttachment": {"volumeId": "2d462636-6d1b-4b47-8d0e-5c26b31013d9"}} Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '4c43f71a-1025-46d8-89ba-321bba5cee91', 'id': '480b1061-7d9a-4aa4-aa00-1bcf5f126cd5', 'body': {'volumeAttachment': {'volumeId': '2d462636-6d1b-4b47-8d0e-5c26b31013d9'}}} Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. (HTTP 404) (Request-ID: req-fd8e0d1e-ca9f-4189-a327-96781d7507db) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:41:00.784309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] Returning 404 to user: Volume 480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7162822f-28f0-45be-bcac-47e1ae4e3564 tempest-VolumesAdminNegativeTest-15076440 tempest-VolumesAdminNegativeTest-15076440-project-admin] 10.222.0.47 "PUT /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91/os-volume_attachments/480b1061-7d9a-4aa4-aa00-1bcf5f126cd5" status: 404 len: 109 microversion: 2.1 time: 0.071061 Aug 29 10:41:00.793033 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 766/1626] 10.222.0.47 () {60 vars in 1433 bytes} [Mon Aug 29 10:41:00 2022] PUT /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91/os-volume_attachments/480b1061-7d9a-4aa4-aa00-1bcf5f126cd5 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:00.799453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:00.800171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:00.807220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.807705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.808142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.808834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:00.809283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:00.809758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:00.953240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:00.963261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aeddb3db-4a0c-4b89-9b96-0f0512af8d75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 0.411152 Aug 29 10:41:00.964070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 861/1627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:00 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:01.174418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:01.182199 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e192857-fb1a-467d-a333-3f519323c124 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.389431 Aug 29 10:41:01.182763 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 767/1628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:00 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:01.273432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:01.275495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:01.285587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:01.286410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:01.287032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:01.287940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:01.288409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:01.288838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:01.571638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:01.573061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:01.580193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:01.580684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:01.581120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:01.594053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:01.594693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:01.595146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.279297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:02.293300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:02.296516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:02.301056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4134d32a-06c2-46e5-a8e7-572f22f3eeaf tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1482 microversion: 2.25 time: 1.033481 Aug 29 10:41:02.301999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 862/1629] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:01 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1482 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:02.307362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:02.308089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:02.315856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.316742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.317480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.318458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.319089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.319520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.351648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:02.364853 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b30d8c60-01fe-49d6-8ce8-a8448dbadbb9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1470 microversion: 2.1 time: 0.797078 Aug 29 10:41:02.366203 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 768/1630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:01 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1470 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:02.373675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:02.374654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:02.382342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.383078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.384037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.385024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.385595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.386357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.954411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:02.965053 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-092fdfbd-784d-4dd0-932b-2fdd7302ffcd tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1542 microversion: 2.1 time: 0.661642 Aug 29 10:41:02.965920 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 863/1631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:02 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1542 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:02.972489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:02.973870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:02.985831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.988329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.988897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:02.990038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:02.990745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:02.992355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.035571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:03.052828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2453660b-5a1e-4b02-91b7-b2244c03b3f5 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 0.684608 Aug 29 10:41:03.054012 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 769/1632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:02 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:03.058959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:03.065391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:03.077187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.085669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.086212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.086965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.087591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.088029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.161112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.162429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.164219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.165408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.166283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.166875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.209987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:41:03.221117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:41:03.393375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2384a35-1883-4d9d-ac23-901f1076d14d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e/action" status: 202 len: 0 microversion: 2.1 time: 0.337793 Aug 29 10:41:03.397665 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 770/1633] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:41:03 2022] POST /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:03.405428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:03.406195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:03.413673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.414668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.415234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.429911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.430456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.431682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.440885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:03.476778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:03.479024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:03.496825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-889f266f-c6a1-4cdd-96ef-d7ac919dd536 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.524962 Aug 29 10:41:03.499998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 864/1634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:02 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:03.516061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:03.516680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:03.537795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.540315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.541116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.542805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.544621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.545590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.653238 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-efdee9c2-0c31-4ecf-9aa7-6d4aa71c95ea tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 204 len: 0 microversion: 2.1 time: 0.251998 Aug 29 10:41:03.653981 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 771/1635] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:41:03 2022] DELETE /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:41:03.667006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:03.667789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:03.683913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.684416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.684863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.685583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.686072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.686504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.769805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:03.781975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:03.792145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:03.795929 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ee74ec4-b23d-4d68-881d-8d8dd2aa47e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1440 microversion: 2.25 time: 0.294440 Aug 29 10:41:03.800489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 865/1636] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:03 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1440 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:03.809422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:03.825483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:03.844738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.846686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.848265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:03.849241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:03.851636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:03.854515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.283214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:04.296310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d8b3207-9431-4d96-bf29-c4756441a15f tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1513 microversion: 2.1 time: 0.492702 Aug 29 10:41:04.302566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:04.307311 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 866/1637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:03 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:04.315827 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-855527c8-1a58-44c4-9061-d9693edbf48e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1469 microversion: 2.1 time: 0.659918 Aug 29 10:41:04.322485 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 772/1638] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:03 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1469 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:04.327260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ae5faf-832a-4a32-9fa1-6c8faa805d70", "name": "network-vif-deleted", "tag": "de6638be-9318-49a6-992d-99a3ea048be1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:04.341673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:04.343303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:04.357659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.358530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.359162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.370455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.376095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.376617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.379434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.379924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.380365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.388962 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] Creating event network-vif-deleted:de6638be-9318-49a6-992d-99a3ea048be1 for instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 on n-h2-854121-10 Aug 29 10:41:04.402227 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-95f1aff5-cb85-4036-a9da-9a8e37111e66 req-8eb10870-a6b2-4fa7-8ab4-cb6776db2c0a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087137 Aug 29 10:41:04.420159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 867/1639] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:04.437770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:04.451516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:04.466417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.467307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.468028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.468946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.469604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.472700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.525175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.525679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.526173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.526639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lazy-loading 'fault' on Instance uuid d73bb8d5-65ee-4179-8f1a-30d97276a727 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:04.726431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:04.740793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6acb27e2-c972-4291-96ee-b39d4011cb6b tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1322 microversion: 2.1 time: 0.415222 Aug 29 10:41:04.743388 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 773/1640] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:04 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:04.760853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:04.761473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:04.768515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:04.769083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.769336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.769812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.774711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.775244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.775699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.780565 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd9928d3-71a3-470c-b1b4-118af5f0c72a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 0.353578 Aug 29 10:41:04.781878 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 868/1641] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:04 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:04.787207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-plugged", "status": "completed", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:04.797117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.798017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.799549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.816199 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Creating event network-vif-plugged:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h1-854121-10 Aug 29 10:41:04.824152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:41:04.853551 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-328b8613-1c83-4a7e-854a-a888ede16f2d req-bf9779b6-86a6-4d3d-8b4c-42f225ac1309 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069933 Aug 29 10:41:04.854594 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 869/1642] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:04.859804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:04.864226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:04.883331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.884389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.885198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:04.888675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:04.889603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:04.890423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:05.049754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:05.062559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:05.064489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:05.066354 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d6458d4-08b7-4e3f-bf81-5d299ffde571 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.210369 Aug 29 10:41:05.092925 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 870/1643] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:04 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:05.121408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:05.131225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-713d26df-32df-4569-a7ee-b17c788f9c9f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.384574 Aug 29 10:41:05.142537 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 774/1644] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:04 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:05.336057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:05.336856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:05.344784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:05.345555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:05.356934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:05.357574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:05.359033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:05.359527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:05.359965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:05.360682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:05.362208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:05.362946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:05.363414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:05.365801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:05.371190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:05.371791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:05.979083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:05.991338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1bdecc54-575d-46a7-a161-f60a54471d70 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1469 microversion: 2.1 time: 0.650770 Aug 29 10:41:05.993028 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 775/1645] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:05 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1469 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:06.003166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:06.006759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:06.020390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.024780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.025376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.026371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.028239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.029116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.109342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.110148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.111620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.113469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lazy-loading 'fault' on Instance uuid d73bb8d5-65ee-4179-8f1a-30d97276a727 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:06.194949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:06.203879 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a58b6e15-567e-4ed1-84e4-b3e727e73eb4 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1513 microversion: 2.1 time: 0.873805 Aug 29 10:41:06.206698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 871/1646] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:05 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1513 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:06.222618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:06.223352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:06.233484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.239706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.241343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.252598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.253432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.253987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.409023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f12313264d4d2faa86f19e1e8c4059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c4e9e2642c49ca91e44474dc29a2a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:06.420923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14813846-7afc-41cc-99c0-5e5ad49cbc0e tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 200 len: 1322 microversion: 2.1 time: 0.425985 Aug 29 10:41:06.422597 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 776/1647] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:05 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:06.432889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:06.441278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:06.472524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.474460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.481026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.484629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.485065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.486793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.668510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:06.682735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:06.686652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:06.690477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ac0754d-6d14-4ce8-8fba-8e18c14077aa tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.264956 Aug 29 10:41:06.693189 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 777/1648] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:06 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:06.701423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:06.702084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:06.727128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.727740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.728245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:06.728998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:06.729633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:06.730286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.514988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:07.527123 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43c85e16-2ffd-449a-bb77-f1cdbf7536b4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1735 microversion: 2.1 time: 1.318600 Aug 29 10:41:07.528421 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 872/1649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:06 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1735 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:07.551827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bb8d5-65ee-4179-8f1a-30d97276a727", "name": "network-vif-deleted", "tag": "c16fab9c-1289-4323-97f4-6f87daebbab4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:07.580156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.581717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.582553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.611283 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] Creating event network-vif-deleted:c16fab9c-1289-4323-97f4-6f87daebbab4 for instance d73bb8d5-65ee-4179-8f1a-30d97276a727 on n-h2-854121-10 Aug 29 10:41:07.619686 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d1ae00e6-13f7-43d2-a1d9-188235583f2e req-c26477e0-1176-47bc-8aad-ebdcf39ed787 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089625 Aug 29 10:41:07.620929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 873/1650] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:07.628653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c43f71a-1025-46d8-89ba-321bba5cee91", "name": "network-vif-deleted", "tag": "a5d5a385-8c17-4182-9891-94d504e585c2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:07.638341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:07.643288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.644145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.644759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.662034 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] Creating event network-vif-deleted:a5d5a385-8c17-4182-9891-94d504e585c2 for instance 4c43f71a-1025-46d8-89ba-321bba5cee91 on n-h1-854121-10 Aug 29 10:41:07.668610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8962d2ae-a32b-4232-a819-78d042eb7873 req-b71d112f-9008-49b3-bf2d-235ba6c930c0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045801 Aug 29 10:41:07.669929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 874/1651] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:07.678209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:07.679194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:07.692300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.692985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.693611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.694517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.695143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.695817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.733969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:07.907477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:07.917281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d3bc29fc-31d7-4e2e-a1bd-f10d053e67d5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 1.222418 Aug 29 10:41:07.932037 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 778/1652] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:06 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:07.937894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:07.938788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:07.955210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.956235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.956899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:07.958296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:07.959191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:07.959854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.023994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.024616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.025328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.026050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lazy-loading 'fault' on Instance uuid 4c43f71a-1025-46d8-89ba-321bba5cee91 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:08.097634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.112294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de42f51f-9d81-40aa-8709-bdf8f9c5c976 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1469 microversion: 2.1 time: 0.440702 Aug 29 10:41:08.126730 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 875/1653] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:07 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:08.142198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:08.143343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] [instance: d73bb8d5-65ee-4179-8f1a-30d97276a727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:08.150713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.151458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.152217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.153115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.153796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.154392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.177613 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] HTTP exception thrown: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Request method failure captured: Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 HTTP/1.1 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJeJV1BRVEr0w522jfzRftJ5qwmxIkKp9ZVgzYDtob4La2BA4yYPyVKUYMoFz9hq6m0BV4CVQ4FYo8_YdstPjXLNT5kOrBWHL7NjfFjC4qFR8aufXEMAltBtt6vmcHQJ1FPCvZ3xpVxTN7CaPsLt8YX9gOOoASB3UCqqrqolSIsjfBs Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/75c4e9e2642c49ca91e44474dc29a2a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 75c4e9e2642c49ca91e44474dc29a2a2 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 53f12313264d4d2faa86f19e1e8c4059 Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd73bb8d5-65ee-4179-8f1a-30d97276a727'} Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. Aug 29 10:41:08.184588 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. Aug 29 10:41:08.191328 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:08.195299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] Returning 404 to user: Instance d73bb8d5-65ee-4179-8f1a-30d97276a727 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:08.197245 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e3feea10-5532-422a-a77d-9cbaa2bf337f tempest-FloatingIPsAssociationNegativeTestJSON-1314895238 tempest-FloatingIPsAssociationNegativeTestJSON-1314895238-project] 10.222.0.47 "GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727" status: 404 len: 111 microversion: 2.1 time: 0.062524 Aug 29 10:41:08.203129 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 876/1654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:08 2022] GET /compute/v2.1/servers/d73bb8d5-65ee-4179-8f1a-30d97276a727 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:08.218253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:08.219598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:08.221198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.235183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.236077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.236575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.237026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a102005b-b778-44f5-9341-3b93a6367d21 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 200 len: 1308 microversion: 2.1 time: 0.303119 Aug 29 10:41:08.237435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.238455 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 779/1655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:07 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:08.242431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.244746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.374690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.396217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.402479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.403790 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dff78b40-63e3-49b9-923e-9f68f6377f4f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.197643 Aug 29 10:41:08.421669 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 877/1656] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:08 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:08.432694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2d8c61-fa9b-482a-895f-529ef179c89d", "name": "network-vif-plugged", "status": "completed", "tag": "05d73088-a615-435f-9feb-a9acb37872e0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:08.461037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.461580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.462041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.479061 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] Creating event network-vif-plugged:05d73088-a615-435f-9feb-a9acb37872e0 for instance 6a2d8c61-fa9b-482a-895f-529ef179c89d on n-h1-854121-10 Aug 29 10:41:08.484181 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9ad5e378-04f4-4ba9-a41c-954335642bcc req-eee09cab-741f-4cb6-b6a6-01e9f7f80e59 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056947 Aug 29 10:41:08.485160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 780/1657] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:08.551614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:08.552820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:08.566920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.567533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.568049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.568785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.569285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.572006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.821401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:08.840329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acb52fe6-a013-4da8-a02d-7e9fc9ef5505 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1715 microversion: 2.1 time: 0.293899 Aug 29 10:41:08.843025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 878/1658] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:08 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1715 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:08.961656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:08.961656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:08.961656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.961656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.967121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:08.968282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:08.969114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:08.969762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.021554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:09.022132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.033818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.036516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.037379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.043031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.043747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.044383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.190719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:09.199178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fbb182d8-b5f6-42bb-bbb3-aa8608e79ef9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.264237 Aug 29 10:41:09.215146 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 781/1659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:08 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:09.222011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:09.223125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.230509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.231355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.233136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.234177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.235032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.235842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.265357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Cannot 'detach_volume' instance d10989fe-e7ee-401e-b4cd-9acb94caf42c while it is in vm_state rescued Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments/7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f HTTP/1.1 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: exception: Cannot 'detach_volume' instance d10989fe-e7ee-401e-b4cd-9acb94caf42c while it is in vm_state rescued Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': 'd10989fe-e7ee-401e-b4cd-9acb94caf42c', 'id': '7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f'} Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d10989fe-e7ee-401e-b4cd-9acb94caf42c while it is in vm_state rescued Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.270690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d10989fe-e7ee-401e-b4cd-9acb94caf42c while it is in vm_state rescued Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 409 to user: Cannot 'detach_volume' instance d10989fe-e7ee-401e-b4cd-9acb94caf42c while it is in vm_state rescued {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:09.276784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a166a8e-08f1-4eec-baf7-17186cb0cdff tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments/7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f" status: 409 len: 152 microversion: 2.1 time: 0.258163 Aug 29 10:41:09.278607 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 879/1660] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:41:09 2022] DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments/7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f => generated 152 bytes in 263 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:41:09.295440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:09.296074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: 4c43f71a-1025-46d8-89ba-321bba5cee91] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.305761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.307071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.311139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.312363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.313093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.313770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.332654 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] HTTP exception thrown: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Request method failure captured: Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 HTTP/1.1 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJctm_igUzcuk3z0blosrF86i60FROPwnCRsagPdCzfnYG-ghppu_QHzMq7Kfe_TqAKml853XTw-mSCLUGHpd0L9hzn0-Nkh6dtoRfwhigLkOQzPInTw8kUHtbAyZ4j4pC08dD11tXtC0ZachGtbkwJVBY-1PyWqozKXCrequOpe6Ao Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1ec0ce49b59d416e9b630418b307fcd7 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1ec0ce49b59d416e9b630418b307fcd7 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesAdminNegativeTest-980765167-project Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2789020d0cef4674be08b8aaa391ded6 Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesAdminNegativeTest-980765167-project Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '4c43f71a-1025-46d8-89ba-321bba5cee91'} Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:09.334682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. Aug 29 10:41:09.341533 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:09.344688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Returning 404 to user: Instance 4c43f71a-1025-46d8-89ba-321bba5cee91 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:09.347548 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8cda75b-f91f-43ba-98ef-352c715ed16c tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91" status: 404 len: 111 microversion: 2.1 time: 0.065885 Aug 29 10:41:09.353319 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 880/1661] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:09 2022] GET /compute/v2.1/servers/4c43f71a-1025-46d8-89ba-321bba5cee91 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:09.362386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:09.363271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.371476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.372300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.373013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.374789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.375545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.376283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.493472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:09.498799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79645b0c-ffdd-41bc-ad47-fa040eaed2ce tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/action" status: 202 len: 0 microversion: 2.1 time: 0.142828 Aug 29 10:41:09.502521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c30b8460-2c90-43e7-846a-9b7459223310 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1469 microversion: 2.1 time: 0.285655 Aug 29 10:41:09.505685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 782/1662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:09 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:09.514351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:09.520617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.528107 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 881/1663] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:41:09 2022] POST /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:09.534296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.538493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.539309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.540334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.541041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.542005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:09.543720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.546490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:09.578070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.583839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.585926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.587151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:09.588954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:09.591472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:09.804600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:09.824441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:09.832228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:09.833680 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c605fec2-82ef-4a6a-a8f9-a70983ce21a0 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.326751 Aug 29 10:41:09.852075 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 783/1664] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:09 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:10.222469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:10.223850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:10.236012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.237512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.238873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.244318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.245013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.246210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.248544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:10.274900 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef162480-563e-43ad-a56a-8537581fbea4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1723 microversion: 2.1 time: 0.740598 Aug 29 10:41:10.287065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 882/1665] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:09 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1723 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:10.533566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:10.534409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:10.549500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.553259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.557544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.558785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.561155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.568641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.908398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:10.923541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f137ff77-6e21-48ff-8596-f1e437ec92ea tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1198 microversion: 2.1 time: 0.702958 Aug 29 10:41:10.926274 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 784/1666] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:10 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1198 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:10.944343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:10.945353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:10.956900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.958341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.959095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.960152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:10.960907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:10.961583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:10.989153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:11.000612 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69af4feb-ee31-4be2-ab23-1ed56ede0d8a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1469 microversion: 2.1 time: 0.474113 Aug 29 10:41:11.001908 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 883/1667] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:10 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:11.086904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:11.091145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:11.103152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:11.105118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:11.106693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a0bf128-0673-4f5c-82c4-921339195129 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.179185 Aug 29 10:41:11.126545 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 785/1668] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:10 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:11.302872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:11.303717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:11.324240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:11.327845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:11.328845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:11.331619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:11.334127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:11.339867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:11.748454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:11.760311 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc6a2c87-11b4-417c-95ed-4621621f8601 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1723 microversion: 2.1 time: 0.463685 Aug 29 10:41:11.765911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 884/1669] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:11 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:11.946862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:11.948445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:11.963416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:11.965931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:11.966612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:11.968819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:11.971586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:11.972227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.028711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:12.030198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:12.043513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.045341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.047713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.065444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.067839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.074671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.424972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:12.440304 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68d8424a-710d-4c5c-881a-82e652281718 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1535 microversion: 2.1 time: 0.419217 Aug 29 10:41:12.444093 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 885/1670] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:12 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1535 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:12.449561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:12.450418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:12.466911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:12.481282 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-646303eb-f317-461a-85ac-30e8f7eb3075 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1382 microversion: 2.1 time: 0.538577 Aug 29 10:41:12.484397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.484881 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 786/1671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:11 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1382 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:12.485652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.486818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.487724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.489017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.489938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.507823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:12.509008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:12.526595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.528245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.532852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.534475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.537861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.540074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.693371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:12.709061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:12.711504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:12.732155 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66819b5b-88da-4e29-b34d-b04238295e3a tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1265 microversion: 2.25 time: 0.286463 Aug 29 10:41:12.732828 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 886/1672] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:12 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:12.790065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:12.791516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:12.804421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.806778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.807957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.811572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.814435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.815464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.853002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5c63d85-07c6-4f93-a04a-53abfcc07abb tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1535 microversion: 2.1 time: 0.348813 Aug 29 10:41:12.854078 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 787/1673] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:12 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1535 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:12.877326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:12.879046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:12.941175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.951075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.955938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:12.957759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:12.959198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:12.961379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.182877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:13.346799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-048a53d1-f429-4661-9468-788b5c71aa61 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1535 microversion: 2.1 time: 0.475432 Aug 29 10:41:13.351934 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 788/1674] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:12 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1535 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:13.371520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:13.379481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.386553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.390902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.392092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.392843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.393530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.475757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a17d881-73ed-44c9-83f0-31f16dc9dabd tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.107698 Aug 29 10:41:13.483374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:13.493596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6bfd504-4e27-4567-aa2b-2a22e4eeb43a tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1723 microversion: 2.1 time: 0.708294 Aug 29 10:41:13.494702 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 789/1675] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:41:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:41:13.498432 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 887/1676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:12 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1723 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:13.506515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:13.511155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-10", "block_migration": false, "disk_over_commit": false}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:13.512216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:13.522036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:13.530593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.537610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.538472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.542910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.543659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.546887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.553519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.557754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.558509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.559546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:13.560449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:13.561113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:13.633922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lazy-loading 'flavor' on Instance uuid 6a2d8c61-fa9b-482a-895f-529ef179c89d {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:13.671913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Going to try to live migrate instance to n-h2-854121-10 {{(pid=128681) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 10:41:14.224418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:14.255501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aacc0638-a386-4050-af7a-12df2e640271 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1535 microversion: 2.1 time: 0.759325 Aug 29 10:41:14.256104 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 790/1677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:13 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1535 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:14.278100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:14.278718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:14.329212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:14.331943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:14.336130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:14.341217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:14.343283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:14.346256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:14.417455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:14.419264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:14.419677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:14.420149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lazy-loading 'fault' on Instance uuid 73ae5faf-832a-4a32-9fa1-6c8faa805d70 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:14.775803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:14.786609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:14.794743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:14.803750 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0becfeee-5e61-460a-bf4d-424362433c0d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 200 len: 1270 microversion: 2.25 time: 0.535645 Aug 29 10:41:14.811149 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 791/1678] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:14 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 1270 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:14.823713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:14.824661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:14.855325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:14.861108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:14.862558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:14.866467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:14.873931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:14.875497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:15.238242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:15.256560 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a77b11ee-b050-4773-aab6-5e863f438261 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1729 microversion: 2.1 time: 0.443825 Aug 29 10:41:15.279797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 792/1679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:14 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1729 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:15.294485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-unplugged", "status": "completed", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:15.320055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:15.320553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:15.321008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:15.370694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Creating event network-vif-unplugged:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:41:15.389915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:41:15.425414 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-346e661d-c081-4a6d-824e-223f41483b59 req-217a709d-d5f8-454b-b24c-9f5335876ce3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143568 Aug 29 10:41:15.426699 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 793/1680] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:15.445780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:15.447395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:15.466409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:15.467243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:15.471230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:15.472682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:15.473416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:15.474116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:16.076474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:16.092491 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88f3adbb-a50f-4485-b322-6ff5b351049a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1535 microversion: 2.1 time: 0.664189 Aug 29 10:41:16.103428 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 794/1681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:15 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1535 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:16.125251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:16.130002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:16.157044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:16.158135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:16.166571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:16.167511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:16.168096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:16.168553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:16.378753 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4857071b-a73d-401d-a439-5a729b328de4 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272811 Aug 29 10:41:16.379874 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 795/1682] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:41:16 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:16.384684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:16.385574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 73ae5faf-832a-4a32-9fa1-6c8faa805d70] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:16.408514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:16.409283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:16.409945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:16.414204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:16.414928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:16.415586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:16.462658 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] HTTP exception thrown: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Request method failure captured: Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 HTTP/1.1 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZPFVLBzC6_4eYeoXVZL-5RCV7OnHZCKgpZhYyzmYAFhqNsHaN3CNz0iBNh9R4gIC8c1SBLNOrW5COsAvQxiKLiDdhg7WDz-kEklaseedX93fZszMxV7CL2chodbaAmb2-vrRNoXe299iTvgP1tErG_8kYS6sOWTMWLuizwafbyn7U Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: ad7622f1f2834d1e9171f6525f0e6481 Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '73ae5faf-832a-4a32-9fa1-6c8faa805d70'} Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. Aug 29 10:41:16.467368 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. Aug 29 10:41:16.472753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:16.479935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Returning 404 to user: Instance 73ae5faf-832a-4a32-9fa1-6c8faa805d70 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:16.482719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8e644a6-8b19-4b4f-8d9b-04a91e83dcd1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70" status: 404 len: 111 microversion: 2.25 time: 0.101875 Aug 29 10:41:16.486370 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 796/1683] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:16 2022] GET /compute/v2.1/servers/73ae5faf-832a-4a32-9fa1-6c8faa805d70 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:41:17.125298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:17.127015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:17.150663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e726de7c-dcdf-42d1-adda-58e3dea5871b tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d/action" status: 202 len: 0 microversion: 2.1 time: 3.642824 Aug 29 10:41:17.154922 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 888/1684] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:41:13 2022] POST /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d/action => generated 0 bytes in 3647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:17.155141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:17.160991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:17.161624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:17.164112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:17.164775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:17.167866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:17.171047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:17.175275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:17.185218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:17.186215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:17.188987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:17.191651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:17.194796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:17.198075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:17.846739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:17.850365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:17.867530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4fac23e9-9cdd-44cb-ac10-623105749c60 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1535 microversion: 2.1 time: 0.746991 Aug 29 10:41:17.880482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 797/1685] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:17 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1535 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:17.882344 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2187d8d-2850-4c79-9df8-f1a5215eea68 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.717997 Aug 29 10:41:17.896350 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 889/1686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:17 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:17.906223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:17.937259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:17.942434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:17.945276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:17.945996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:17.984632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Creating event network-changed:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:41:17.998966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:41:18.028216 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-893e2e78-7d7e-4ced-a07f-482508bebc50 req-0d0ba423-53cb-47a7-9121-7a3eb7244b92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146008 Aug 29 10:41:18.033079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 798/1687] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:18.892801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:18.893434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:18.908849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:18.910555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:18.927216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:18.927732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:18.928162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:18.928888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:18.929348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:18.931758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:18.932489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:18.933192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:18.933889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:18.937734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:18.939010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:18.939687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:19.027872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:19.923892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:19.942056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1adc9604-4bda-4b5d-8126-62d4de3af6a7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1535 microversion: 2.1 time: 1.047530 Aug 29 10:41:19.960780 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 890/1688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:18 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1535 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:19.982253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:19.989027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:20.011539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:20.014256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:20.015788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:20.018201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:20.021132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:20.021734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:20.168815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:20.354364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-751e8a26-4a62-4609-8509-8ade16896e38 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 204 len: 0 microversion: 2.1 time: 0.387806 Aug 29 10:41:20.361872 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 891/1689] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:41:19 2022] DELETE /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:41:20.386621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:20.388822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:20.406036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:20.411625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:20.413091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:20.420421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:20.422555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:20.424281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:20.709963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:20.720974 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da1a6d49-1788-4986-8797-8117ddd91c3f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.817317 Aug 29 10:41:20.721517 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 799/1690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:18 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:20.972423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:20.973377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:21.006010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:21.006906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:21.008139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:21.021434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:21.030964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:21.034157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:22.412191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:22.451439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43ec22ca-5939-4067-85fe-6abdf9e57449 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1680 microversion: 2.1 time: 2.068449 Aug 29 10:41:22.476052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 892/1691] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:20 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1680 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:22.495996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:22.496715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:22.531246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:22.541447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:22.542109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:22.544246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:22.544724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:22.550191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:22.734603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:22.756288 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cec79b6a-ce52-4db6-8656-f6018956c9a8 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1528 microversion: 2.1 time: 1.789149 Aug 29 10:41:22.771900 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 800/1692] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:20 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1528 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:22.785172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:22.786211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:22.797299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:22.799245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:22.799896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:22.803080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:22.803852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:22.804970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:23.415719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:24.623157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:24.638961 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54dc757e-ffbd-45b1-aa53-c21732f9ab65 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 2.158798 Aug 29 10:41:24.642603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 893/1693] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:22 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:24.665751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:24.684046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:24.722792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:24.729551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:24.752308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:24.753398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:24.761066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:24.767995 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1e6d98b-e900-468d-9641-5caf77c8c985 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1528 microversion: 2.1 time: 1.986119 Aug 29 10:41:24.768489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:24.772022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:24.774041 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 801/1694] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:22 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1528 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:24.825334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:24.877828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:24.880933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:24.883098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:24.916897 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] Creating event network-changed:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:41:24.929104 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-98b34823-f3a5-4005-bc64-7e5271fbac59 req-c7e7f58b-6a4e-4191-bf23-3a83b26e4e5a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145584 Aug 29 10:41:24.930395 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 802/1695] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:24.965082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:24.966753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:24.976887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:24.977822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:24.978675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:24.979743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:24.980796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:24.999082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:25.117097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:25.292605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:25.433460 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ff0e445-8ea5-4648-bc69-1bf59cc42092 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 204 len: 0 microversion: 2.25 time: 0.497097 Aug 29 10:41:25.441509 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 803/1696] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:41:24 2022] DELETE /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:41:25.474194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57286209-fefd-4c5d-87d1-b9bed20c4ada tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:25.506504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-57286209-fefd-4c5d-87d1-b9bed20c4ada tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] HTTP exception thrown: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57286209-fefd-4c5d-87d1-b9bed20c4ada tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Request method failure captured: Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/flavors/0911103d-e88a-453b-a1f7-69f08bcc878f HTTP/1.1 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbXcnjpOfwPJBAyLFLcM98o3Ydl2DcXO1ZXk6RWBfFhNujf2ZBJvucMb_jjkZ-jIikscqBrfZLUNUWkaNXmqEOkUePX0AWvCQSzAPbpXHl-O_qm5AY79sZYmNPsxJBiok_OrXBppkzvqghCfK8jAVMktVbbuxlLNk7odbCw_taVCwE Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: bba3a732e4c7409888a4b49a119ef887 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MigrationsAdminTest-1804262607 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bba3a732e4c7409888a4b49a119ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bba3a732e4c7409888a4b49a119ef887"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bba3a732e4c7409888a4b49a119ef887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bba3a732e4c7409888a4b49a119ef887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MigrationsAdminTest-1804262607 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: bba3a732e4c7409888a4b49a119ef887 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MigrationsAdminTest-1804262607 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MigrationsAdminTest-1804262607-project-admin Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6b36bc0577ae4eeb83f37e1498dd1026 Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MigrationsAdminTest-1804262607-project-admin Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: exception: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '0911103d-e88a-453b-a1f7-69f08bcc878f'} Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:25.515309 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57286209-fefd-4c5d-87d1-b9bed20c4ada tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Returning 404 to user: Flavor 0911103d-e88a-453b-a1f7-69f08bcc878f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-57286209-fefd-4c5d-87d1-b9bed20c4ada tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/0911103d-e88a-453b-a1f7-69f08bcc878f" status: 404 len: 109 microversion: 2.1 time: 0.057466 Aug 29 10:41:25.524802 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 804/1697] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:41:25 2022] DELETE /compute/v2.1/flavors/0911103d-e88a-453b-a1f7-69f08bcc878f => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:25.534962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:25.535938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:25.546834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:25.547423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:25.548670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:25.554517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:25.555203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:25.555510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:25.750133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:25.762886 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf30af4b-51e7-4ac3-a164-51623c1edab0 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1680 microversion: 2.1 time: 1.115652 Aug 29 10:41:25.805157 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 894/1698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:24 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1680 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:25.848924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:25.849934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:25.875579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:25.877584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:25.886708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:25.887546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:25.894190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:25.894919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:27.116637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:27.138854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:27.140417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:27.142023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6408036b-0e04-4933-adcd-ddd6c0353b80 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1731 microversion: 2.25 time: 1.622111 Aug 29 10:41:27.142798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 805/1699] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:25 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1731 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:27.153584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1576654759", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:27.251765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:41:27.369844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:27.379833 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c36d003c-ea08-46fe-be98-c7030d625f8b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.573167 Aug 29 10:41:27.384484 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 895/1700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:25 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:27.397793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d319a64e-826c-4f51-8fb7-bb4993be9a7f", "name": "network-vif-deleted", "tag": "a4c764c3-9259-454a-b92a-f18da93414ee"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:27.436274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:27.440161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:27.441256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:27.478048 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] Creating event network-vif-deleted:a4c764c3-9259-454a-b92a-f18da93414ee for instance d319a64e-826c-4f51-8fb7-bb4993be9a7f on n-h1-854121-10 Aug 29 10:41:27.493676 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9e8f058e-948d-400d-a8a3-d82c7a62ad21 req-2a6efb12-23f7-4776-9113-9b9ac1719b69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107780 Aug 29 10:41:27.495918 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 896/1701] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:27.514493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:27.515904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:27.532384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:27.539104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:27.541082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:27.542576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:27.544722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:27.547022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:27.726472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:27.727037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:27.727463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:27.728001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lazy-loading 'fault' on Instance uuid d319a64e-826c-4f51-8fb7-bb4993be9a7f {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:28.001154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2789020d0cef4674be08b8aaa391ded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec0ce49b59d416e9b630418b307fcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:28.018720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64122f62-9341-46ec-b6fc-af2e87f32d15 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 200 len: 1332 microversion: 2.1 time: 0.517898 Aug 29 10:41:28.019522 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 897/1702] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:27 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 1332 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:28.034164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:28.058658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.059824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.061106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.086798 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] Creating event network-changed:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:41:28.099485 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-dfa5d073-1a58-4da3-a2b4-5e4b5d625897 req-a30c5870-1a9e-4f48-98fa-f3ea4853a29f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074756 Aug 29 10:41:28.104902 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 898/1703] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:28.115841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-plugged", "status": "completed", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:28.150384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.152214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.156074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.190634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:41:28.192015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:41:28.192930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:41:28.193582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:41:28.194294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:41:28.201294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] Creating event network-vif-plugged:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:41:28.223993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e6b8bce0-6f50-48eb-a77a-c6f2e7e8d431 req-bbaa23c8-e5f0-44ef-8c43-12087172c1a7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114553 Aug 29 10:41:28.226793 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 899/1704] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:28.228362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.229498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.231340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.233894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.235874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.237371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.249261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:28.250484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:28.275096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.276046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.277535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.280487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.281225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.283730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.286424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:41:28.299653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Getting quotas for user 356590f9c0644b3695c6b3f321dd1275 and project 901105749eb4402d9a630487d32d7e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:41:28.336875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:41:28.339276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:41:28.449740 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9dded3cf-d4bf-4b5d-812d-346574a52a50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305591 Aug 29 10:41:28.457821 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 806/1705] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:41:28.463658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:28.464470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:28.474109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.474897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.475847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:28.477275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:28.478329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:28.479652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:29.734372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:29.745108 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd8321a8-cad0-4be3-ac09-4ecac06d8149 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.285539 Aug 29 10:41:29.752940 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 807/1706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:28 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:29.766616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:29.779406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:29.781189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:29.795258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:29.797493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:29.802222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:29.805542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:29.810356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:29.812145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:29.812326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:29.813874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:29.814026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef536f7f-f14d-4f6d-80dd-236142aba9ba tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1731 microversion: 2.25 time: 1.585679 Aug 29 10:41:29.826189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 900/1707] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:28 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1731 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:29.840162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:29.845491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] [instance: d319a64e-826c-4f51-8fb7-bb4993be9a7f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:29.868758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:29.869502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:29.870159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:29.871231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:29.877735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:29.880484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:29.934147 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] HTTP exception thrown: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Request method failure captured: Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f HTTP/1.1 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJctm_igUzcuk3z0blosrF86i60FROPwnCRsagPdCzfnYG-ghppu_QHzMq7Kfe_TqAKml853XTw-mSCLUGHpd0L9hzn0-Nkh6dtoRfwhigLkOQzPInTw8kUHtbAyZ4j4pC08dD11tXtC0ZachGtbkwJVBY-1PyWqozKXCrequOpe6Ao Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1ec0ce49b59d416e9b630418b307fcd7 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1ec0ce49b59d416e9b630418b307fcd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1ec0ce49b59d416e9b630418b307fcd7 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-980765167 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesAdminNegativeTest-980765167-project Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 2789020d0cef4674be08b8aaa391ded6 Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesAdminNegativeTest-980765167-project Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd319a64e-826c-4f51-8fb7-bb4993be9a7f'} Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:29.936230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. Aug 29 10:41:29.942589 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:29.944083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Returning 404 to user: Instance d319a64e-826c-4f51-8fb7-bb4993be9a7f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:29.945297 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24d3f188-b304-40f3-858f-913d9fd0b58d tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f" status: 404 len: 111 microversion: 2.1 time: 0.117594 Aug 29 10:41:29.946530 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 901/1708] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:29 2022] GET /compute/v2.1/servers/d319a64e-826c-4f51-8fb7-bb4993be9a7f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:29.956350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11edcaa8-c8a5-4997-a639-90081b8321a9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] Calling method '.version_select at 0x7f66c7166160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:30.075759 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11edcaa8-c8a5-4997-a639-90081b8321a9 tempest-VolumesAdminNegativeTest-980765167 tempest-VolumesAdminNegativeTest-980765167-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269583699" status: 202 len: 0 microversion: 2.1 time: 0.124392 Aug 29 10:41:30.081840 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 902/1709] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269583699 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:41:30.215450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:30.228333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c05d09bb-1351-4967-b3ec-80bae4d02cd5 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1265 microversion: 2.1 time: 0.468812 Aug 29 10:41:30.232418 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 808/1710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:29 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1265 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:30.780726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:30.785915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:30.818442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:30.821470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:30.831420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:30.836271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:30.838316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:30.839032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:30.843185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:30.845230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:30.858325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:30.859192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:30.860863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:30.861897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:30.862586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:30.863356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:31.231785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:31.249100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:31.255101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:31.261337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c464495-49ac-44ff-9e20-418f0f6f272d tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1664 microversion: 2.25 time: 0.419550 Aug 29 10:41:31.262746 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 809/1711] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:30 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1664 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:31.274939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:31.275933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:31.291932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:31.298739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:31.299799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:31.301401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:31.304005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:31.305448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:31.961287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:31.975893 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-92cbbe72-764a-4489-ad3e-122ba348d7f2 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1271 microversion: 2.1 time: 0.710728 Aug 29 10:41:31.978045 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 810/1712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:31 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1271 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:32.288415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:32.289309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:32.306344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:32.315105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:32.315701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:32.316482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:32.316959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:32.317391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:32.352146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:32.367176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-767800a7-6263-4db6-a281-77e0c56e0c4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.593416 Aug 29 10:41:32.370152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 903/1713] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:30 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:32.595182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-245829774", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "f0e277bb-7983-4d32-9041-e842f755bb17"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:32.669261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] validate_networks() for [('f0e277bb-7983-4d32-9041-e842f755bb17', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:41:33.071395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:33.085327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:33.087149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:33.088818 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ac26b754-d9a3-468a-9d85-0acfdc005ccc tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1664 microversion: 2.25 time: 0.807322 Aug 29 10:41:33.090166 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 811/1714] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:32 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1664 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:33.095475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:33.096327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:33.113593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:33.114653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:33.114653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:33.118001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:33.118494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:33.120089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:33.344751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:33.360570 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8d025c52-3188-4345-9425-624bb6493764 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1271 microversion: 2.1 time: 0.269061 Aug 29 10:41:33.361542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 812/1715] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:33 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:33.394876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:33.395655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:33.415464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:33.417154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:33.417614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:33.421220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:33.421750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:33.423901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.333042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:34.345485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55feec46-26d6-4b9e-abb7-26daa12f733a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.955398 Aug 29 10:41:34.364679 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 813/1716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:33 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:34.369998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1fda2-c093-45df-801f-098da414fee9", "name": "network-vif-deleted", "tag": "a5499b38-33b6-4bc9-b4f1-ad75f83221c1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:34.390492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.391608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.392994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.409816 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] Creating event network-vif-deleted:a5499b38-33b6-4bc9-b4f1-ad75f83221c1 for instance 7ea1fda2-c093-45df-801f-098da414fee9 on n-h1-854121-10 Aug 29 10:41:34.418249 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-befc8942-fbf5-468a-88d0-0a92bfc3853f req-842e6091-2d04-4dfd-84fa-45c8fac6ac33 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053042 Aug 29 10:41:34.419635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 814/1717] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:34.428026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:34.430988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:34.450642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.452576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.455599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.456895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.457795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.459459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.520418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.521210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.522065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.523025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lazy-loading 'fault' on Instance uuid 7ea1fda2-c093-45df-801f-098da414fee9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:34.658858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:34.683804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:34.687088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:34.689508 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa52970f-b2b2-4e11-b746-21236bc481e5 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 200 len: 1375 microversion: 2.25 time: 0.268411 Aug 29 10:41:34.690804 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 815/1718] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:34 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 1375 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:34.697974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:34.705818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:34.707014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Searching by: {'deleted': False, 'project_id': 'bf9acc70e7f746889c1533b615510465'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:41:34.716406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.717549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.718876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.720657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.721384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.723090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.850114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:41:34.936238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:41:34.936840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:41:34.938702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:41:34.940641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:41:34.941571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:41:34.971551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.972412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.972746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4620a0fc-5185-4c34-b934-cc8516e10d3f tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.280713 Aug 29 10:41:34.973473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.974281 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 816/1719] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:41:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:34.975718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.976449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.979148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.979285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:34.981629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:34.989891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.990659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.990881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:34.991585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:34.992042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:34.992471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:35.102043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:41:35.117552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for user e2bcddcae75e410786962c142abebf34 and project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:41:35.169577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:41:35.174143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:41:35.394039 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a630c88-60a3-452c-99a5-aa6106d0af2d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982315 Aug 29 10:41:35.410126 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 904/1720] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:41:35.432909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:35.455548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:35.462608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Searching by: {'deleted': False, 'project_id': 'bf9acc70e7f746889c1533b615510465'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:41:35.487757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:35.493025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:35.493788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:35.495829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:35.496822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:35.500113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:35.602750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:41:35.654558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:35.673404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22c081f5-e654-4777-bcdf-4ea32cc6e96a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.696261 Aug 29 10:41:35.676003 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 817/1721] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:34 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:35.688793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:35.690605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:35.693744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:35.709489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:35.710012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:35.713092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:35.713266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:35.717299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:35.720572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:35.722884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:35.724824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:35.726696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.272915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:36.290382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-066e2ce8-3781-4e7f-bcaa-5f890954555a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.604825 Aug 29 10:41:36.304702 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 818/1722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:35 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:36.304702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c19f4a0-6ebe-4090-976e-3536f3a8fd9a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.304702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c19f4a0-6ebe-4090-976e-3536f3a8fd9a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:36.377388 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a12722c6-c66d-4940-a11d-5c34421a59a1 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.965561 Aug 29 10:41:36.379276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 905/1723] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:41:35 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:36.384357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.399897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 7ea1fda2-c093-45df-801f-098da414fee9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:36.415773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.416614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.417061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.417852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.418316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.418781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.460699 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] HTTP exception thrown: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. Aug 29 10:41:36.460952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c19f4a0-6ebe-4090-976e-3536f3a8fd9a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:36.468555 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c19f4a0-6ebe-4090-976e-3536f3a8fd9a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1207 microversion: 2.1 time: 0.175975 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Request method failure captured: Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 HTTP/1.1 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZPFVLBzC6_4eYeoXVZL-5RCV7OnHZCKgpZhYyzmYAFhqNsHaN3CNz0iBNh9R4gIC8c1SBLNOrW5COsAvQxiKLiDdhg7WDz-kEklaseedX93fZszMxV7CL2chodbaAmb2-vrRNoXe299iTvgP1tErG_8kYS6sOWTMWLuizwafbyn7U Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: ad7622f1f2834d1e9171f6525f0e6481 Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7ea1fda2-c093-45df-801f-098da414fee9'} Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. Aug 29 10:41:36.469933 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. Aug 29 10:41:36.488552 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:36.489523 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 819/1724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:36 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1207 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:36.489523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-69bee7e4-6089-4369-a37d-fda44e29eb8e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.490759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Returning 404 to user: Instance 7ea1fda2-c093-45df-801f-098da414fee9 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:36.491813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e3f01e6e-4610-491e-9d08-13a22aeb9f9b tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9" status: 404 len: 111 microversion: 2.25 time: 0.111390 Aug 29 10:41:36.492556 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 906/1725] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:36 2022] GET /compute/v2.1/servers/7ea1fda2-c093-45df-801f-098da414fee9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:41:36.506827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0db0e385-717b-4577-8c88-4b1482e3050f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '.version_select at 0x7f66c6f1c310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.514397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-69bee7e4-6089-4369-a37d-fda44e29eb8e tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039297 Aug 29 10:41:36.518182 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 820/1726] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:41:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:36.544455 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0db0e385-717b-4577-8c88-4b1482e3050f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418215228" status: 204 len: 0 microversion: 2.25 time: 0.043175 Aug 29 10:41:36.546477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 907/1727] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418215228 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:41:36.694506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.695120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:36.705728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.706282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.706725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.707708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.708453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.708905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.851292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:36.851800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:36.868176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.868813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.869265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.870477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:36.870602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:36.871054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:36.937343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:37.105402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:37.140400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:37.197419 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fa21a0c-5744-43a8-bfc4-53add6493339 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 204 len: 0 microversion: 2.1 time: 0.349716 Aug 29 10:41:37.198826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 908/1728] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:41:36 2022] DELETE /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:41:37.208985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:37.210202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:37.214965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:37.222579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.223536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.224282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:37.225792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.226837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.226967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b99f927c-0fd4-438e-95d9-1980b996e6cf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.536271 Aug 29 10:41:37.227610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 821/1729] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:36 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:37.228082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:37.315634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:37.316593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:37.333866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.335901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.336483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:37.338555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.339607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.342677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:37.765489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:37.777741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3cdcc908-aba1-48aa-bcc3-cf4f98a9edf7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1609 microversion: 2.1 time: 0.574405 Aug 29 10:41:37.788848 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 909/1730] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:37 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1609 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:37.800244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:37.801121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:37.823493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.830511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.831260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:37.832198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:37.832832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:37.833433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.031869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:38.033489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:38.045329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-34f17ef3-c1e8-41f4-92e1-c27358dafff7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1277 microversion: 2.1 time: 0.254838 Aug 29 10:41:38.050081 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 910/1731] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:37 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:38.064945 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80721c74-c46c-47ae-b0a1-bd2ecb231190 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.756159 Aug 29 10:41:38.066859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 822/1732] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:37 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:38.248723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:38.249718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:38.258219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.268997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.271738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.285258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.285984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.286736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.364343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:38.387010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.387010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.387485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.421971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] Creating event network-changed:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:41:38.442038 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6bfa3df5-05fc-4617-b8da-565fa8ac47e7 req-0ddfd3da-b95a-4240-ab9f-bf34f15edcc9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082341 Aug 29 10:41:38.442716 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 823/1733] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:41:38.713579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:38.714215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:38.725096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.725591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.726071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.726804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.730273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.730835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.749889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:38.762240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0ca86ed-85f6-4202-a4aa-c4328379bd90 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.517579 Aug 29 10:41:38.763161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 911/1734] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:38 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:38.776611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:38.797453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:38.812157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:38.813621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:38.823176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.828706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.829420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.830426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:38.831904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:38.832555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:38.976639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b7e7171-e8cc-418d-8a20-74a6560aa2ce tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 204 len: 0 microversion: 2.25 time: 0.267463 Aug 29 10:41:38.981105 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 824/1735] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:41:38 2022] DELETE /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:41:38.993840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:38.997250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:39.011761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.018071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.018646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.019544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.020118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.020816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.290526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:39.304884 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87951a2f-1329-46b0-8923-0067ab5aac9c tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1609 microversion: 2.1 time: 0.497244 Aug 29 10:41:39.305488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 912/1736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:38 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1609 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:39.316413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:39.319165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:39.336151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.336651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.337096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.340352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.342086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.344282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.515416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:39.520126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:39.528196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:39.530452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:39.532414 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-13054d75-02d3-45fe-824c-586936a7771d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1265 microversion: 2.1 time: 0.223445 Aug 29 10:41:39.533131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c41ba568-f535-495f-9baf-af4b89ab907c tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1548 microversion: 2.25 time: 0.550293 Aug 29 10:41:39.534074 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 825/1737] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:38 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1548 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:39.541450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:39.542341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:39.549972 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 913/1738] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:39 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:39.564264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.565122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.566015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.567075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.567692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.568268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.786740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:39.787732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:39.798543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.799249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.799821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:39.800700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:39.801265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:39.801873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:40.575482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:40.593679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8162e5ec-af15-4d59-9ee2-e25ac97021d7 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.058137 Aug 29 10:41:40.597316 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 826/1739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:39 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:40.612586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:40.614610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:40.634056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:40.634855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:40.637014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:40.638426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:40.647255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:40.648227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:41.455473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:41.467075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e126b201-3aaa-438e-92db-427016015de7 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 1.685131 Aug 29 10:41:41.471951 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 914/1740] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:39 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:41.485385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:41.491560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:41.504357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:41.504776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:41.506284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:41.509084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:41.509780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:41.511321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:41.957644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:41.980605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8d6a759-f781-474a-8990-df7e0221c548 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1609 microversion: 2.1 time: 1.377189 Aug 29 10:41:41.987754 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 827/1741] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:40 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1609 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:42.006673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:42.007636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:42.017212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.017933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.018569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.019639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.020268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.020878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.077463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.078325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.078928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.079541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lazy-loading 'fault' on Instance uuid 449f4a7d-8051-43bf-9939-a14a19e0f895 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:42.244895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:42.258694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:42.262083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:42.264809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ec3039ce-a02e-460d-8b98-3ba2f82b1320 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 200 len: 1351 microversion: 2.25 time: 0.275652 Aug 29 10:41:42.268456 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 828/1742] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:41 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:42.275858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:42.279742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f4a7d-8051-43bf-9939-a14a19e0f895", "name": "network-vif-deleted", "tag": "4e1f978f-971b-41b8-9a23-fcc311e906e5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:42.284587 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d766ab7f-fa5b-4540-b551-c10421da4310 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.811282 Aug 29 10:41:42.294137 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 915/1743] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:41 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:42.294137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:42.294137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:42.305940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.306824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.307391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.311042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.311588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.312159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.324720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] Creating event network-vif-deleted:4e1f978f-971b-41b8-9a23-fcc311e906e5 for instance 449f4a7d-8051-43bf-9939-a14a19e0f895 on n-h1-854121-10 Aug 29 10:41:42.325801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.326751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.329234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.352918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d1c5747b-89a8-4351-946a-a53dc3e53844 req-8c039d49-e126-473b-b82c-553e5532ef99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081147 Aug 29 10:41:42.355081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 829/1744] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:42.492343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:42.493202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:42.501020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.501640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.502256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.503061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:42.503683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:42.504209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:42.817675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:42.827252 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c7dd797-f7c8-44c8-8bea-785053caeb0b tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.541042 Aug 29 10:41:42.828430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 916/1745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:42 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:42.985329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:43.004793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:43.005928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:43.011785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f201b55-d264-4c94-a118-80a25284599e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.523728 Aug 29 10:41:43.016701 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 830/1746] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:42 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:43.019289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.020011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.020652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.021381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.021874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.022308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.070587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2d8c61-fa9b-482a-895f-529ef179c89d", "name": "network-vif-unplugged", "status": "completed", "tag": "05d73088-a615-435f-9feb-a9acb37872e0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:43.116679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.121039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.122430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.158645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] Creating event network-vif-unplugged:05d73088-a615-435f-9feb-a9acb37872e0 for instance 6a2d8c61-fa9b-482a-895f-529ef179c89d on n-h1-854121-10 Aug 29 10:41:43.165301 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-cdd7b7fa-736d-40e7-9d79-fe6320a3f838 req-2da33982-e294-49a7-b19d-50efcfb80ecf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106922 Aug 29 10:41:43.167426 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 831/1747] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:43.228634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:43.245149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-57ec2741-efe3-42c9-b842-ca97193157e7 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1542 microversion: 2.1 time: 0.246847 Aug 29 10:41:43.245994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 917/1748] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:42 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:43.293688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:43.294854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 449f4a7d-8051-43bf-9939-a14a19e0f895] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:43.301580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:43.315202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.317032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.317903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:43.318708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.319179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:43.320215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.321515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.323463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.358510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.363060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.363981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.367516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.368431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.369676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.370615 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] HTTP exception thrown: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Request method failure captured: Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 HTTP/1.1 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJZPFVLBzC6_4eYeoXVZL-5RCV7OnHZCKgpZhYyzmYAFhqNsHaN3CNz0iBNh9R4gIC8c1SBLNOrW5COsAvQxiKLiDdhg7WDz-kEklaseedX93fZszMxV7CL2chodbaAmb2-vrRNoXe299iTvgP1tErG_8kYS6sOWTMWLuizwafbyn7U Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: ad7622f1f2834d1e9171f6525f0e6481 Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '449f4a7d-8051-43bf-9939-a14a19e0f895'} Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. Aug 29 10:41:43.373668 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. Aug 29 10:41:43.379858 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:43.381642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Returning 404 to user: Instance 449f4a7d-8051-43bf-9939-a14a19e0f895 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:43.382811 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30c834cd-dfa3-479c-9dd9-3b7055e2f5e1 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895" status: 404 len: 111 microversion: 2.25 time: 0.094565 Aug 29 10:41:43.384147 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 832/1749] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:43 2022] GET /compute/v2.1/servers/449f4a7d-8051-43bf-9939-a14a19e0f895 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:41:43.395277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:43.396517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:43.403369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.404300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.404996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.406518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.407243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.407970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.475195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:41:43.605837 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97e01414-3c85-4aa5-a716-97c82488e16f tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "DELETE /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 204 len: 0 microversion: 2.25 time: 0.214298 Aug 29 10:41:43.615830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 833/1750] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:41:43 2022] DELETE /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:41:43.622094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:43.623340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:43.635541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.636660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.637611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:43.639164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:43.650653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:43.654752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:44.616233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:44.631782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:44.638651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:44.641781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b45ba58-b358-4c61-b704-749277cd3045 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1562 microversion: 2.25 time: 1.024236 Aug 29 10:41:44.644740 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 834/1751] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:43 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1562 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:44.653775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:44.655171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:44.670588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:44.672563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:44.673795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:44.675294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:44.677647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:44.678137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:44.799236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:45.526915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:45.690304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:45.825086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:45.845866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f37ccce4-69e9-44c1-b492-384e5039b7db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 2.535622 Aug 29 10:41:45.848611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 918/1752] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:43 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:45.888165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:45.893827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:45.929260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:45.929794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:45.932111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:45.933107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:45.937829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:45.938524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:46.470341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:46.824797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:46.834983 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2d76637-684b-4659-981c-e1137c6b571a tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 2.189144 Aug 29 10:41:46.839116 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 835/1753] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:44 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:46.850689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:46.851388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:46.867422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:46.870732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:46.874128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:46.875816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:46.876406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:46.878518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.044382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:47.089775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53409457-a0fc-4bff-b272-df066c050a26 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 1.234616 Aug 29 10:41:47.095982 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 919/1754] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:45 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:47.106001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:47.122878 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdc72b00-7139-4a80-8c50-1ecf09a8d722 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1252 microversion: 2.1 time: 0.282027 Aug 29 10:41:47.127032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b60670e-e446-465f-9682-785bf357a149", "name": "network-vif-deleted", "tag": "8d8b40ab-28c2-4510-9ce3-43aba828a5dc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:47.128422 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 836/1755] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:46 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1252 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:47.152865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:47.154628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:47.175498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.175715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.176449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.176674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.177236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.178783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.179726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.182847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.183535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.216969 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] Creating event network-vif-deleted:8d8b40ab-28c2-4510-9ce3-43aba828a5dc for instance 2b60670e-e446-465f-9682-785bf357a149 on n-h2-854121-10 Aug 29 10:41:47.230484 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-926b7d73-3483-4538-a419-6e21291f72e9 req-047f3e72-de30-4c05-8edd-8ea0ecbd805f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133109 Aug 29 10:41:47.236061 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 920/1756] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:47.252268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d08942-c152-4c43-a806-61ad692ed714", "name": "network-vif-deleted", "tag": "c3ae8e87-ef11-4e59-a485-916ea3de6d7c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:47.267002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.267935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.269290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.270379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lazy-loading 'fault' on Instance uuid 13d08942-c152-4c43-a806-61ad692ed714 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:47.281047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.281529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.281993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.322571 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] Creating event network-vif-deleted:c3ae8e87-ef11-4e59-a485-916ea3de6d7c for instance 13d08942-c152-4c43-a806-61ad692ed714 on n-h2-854121-10 Aug 29 10:41:47.342201 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-61c0d0ea-56f1-44bd-86cb-e48b41a8a46f req-7a25ad48-5d41-4df5-b162-53312036e110 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099600 Aug 29 10:41:47.343983 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 921/1757] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:47.356092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:47.360261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:47.406589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.411997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.413187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.415232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.415730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.416161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.586207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:47.607410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:47.617360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad7622f1f2834d1e9171f6525f0e6481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4d81dd195c4af6b439b88f621def9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:47.620158 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a9019bd3-7199-45a1-952c-95e4ed683929 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 200 len: 1350 microversion: 2.25 time: 0.489806 Aug 29 10:41:47.623872 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 837/1758] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:47 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 1350 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:41:47.859965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:47.860830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:47.877904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.877904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.878289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:47.878876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:47.888234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:47.889198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.009037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:48.022061 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-097d363f-eacc-438f-9eae-85faea39a604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.675920 Aug 29 10:41:48.034930 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 922/1759] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:47 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:48.125244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:48.127037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:48.139756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.140603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.141201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.142067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.142582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.142962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.564344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:48.574121 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8d30c995-443d-4b5d-9bcc-22cc7aa61f54 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.718115 Aug 29 10:41:48.574722 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 838/1760] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:47 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:48.584947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:48.590728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:48.591961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:48.595357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96b77026-9f91-488f-9d41-fd0a8c8ddc92 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.474673 Aug 29 10:41:48.597570 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 923/1761] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:48 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:48.614041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.614826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.615473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.616752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.617459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.618096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.650272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:48.651551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:48.653277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] [instance: 13d08942-c152-4c43-a806-61ad692ed714] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:48.665304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.666159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.667588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.669069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:48.669986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:48.670717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:48.689858 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] HTTP exception thrown: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Request method failure captured: Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 HTTP/1.1 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJZPFVLBzC6_4eYeoXVZL-5RCV7OnHZCKgpZhYyzmYAFhqNsHaN3CNz0iBNh9R4gIC8c1SBLNOrW5COsAvQxiKLiDdhg7WDz-kEklaseedX93fZszMxV7CL2chodbaAmb2-vrRNoXe299iTvgP1tErG_8kYS6sOWTMWLuizwafbyn7U Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4c4d81dd195c4af6b439b88f621def9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4c4d81dd195c4af6b439b88f621def9c Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: ad7622f1f2834d1e9171f6525f0e6481 Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1764775466-project Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '13d08942-c152-4c43-a806-61ad692ed714'} Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. Aug 29 10:41:48.692172 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. Aug 29 10:41:48.698605 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:41:48.701548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] Returning 404 to user: Instance 13d08942-c152-4c43-a806-61ad692ed714 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:48.702766 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-735e29ec-2d88-4f94-a992-fdfeabd1a343 tempest-LiveAutoBlockMigrationV225Test-1764775466 tempest-LiveAutoBlockMigrationV225Test-1764775466-project] 10.222.0.47 "GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714" status: 404 len: 111 microversion: 2.25 time: 0.057961 Aug 29 10:41:48.708266 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 924/1762] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:41:48 2022] GET /compute/v2.1/servers/13d08942-c152-4c43-a806-61ad692ed714 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:41:48.736983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:48.747215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee568899-f84f-4080-b77d-d215f0be7b71 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1252 microversion: 2.1 time: 0.171445 Aug 29 10:41:48.747801 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 839/1763] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:48 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1252 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:49.043233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:49.044401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:49.051487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.052302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.052972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.053941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.054688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.055352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.278989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4c690b-cc07-4f8c-b5df-e84a85777ac2", "tag": "ab426510-178d-4751-b183-9927d1cfe590"}, {"name": "network-changed", "server_uuid": "6a2d8c61-fa9b-482a-895f-529ef179c89d", "tag": "05d73088-a615-435f-9feb-a9acb37872e0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:49.306107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.308488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.309414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.329491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:49.342917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c84e06a0-d354-4df2-bffb-37f238d802ec tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.304065 Aug 29 10:41:49.344362 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 925/1764] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:49 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:49.361237 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Creating event network-changed:ab426510-178d-4751-b183-9927d1cfe590 for instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 on n-h1-854121-10 Aug 29 10:41:49.361771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] Creating event network-changed:05d73088-a615-435f-9feb-a9acb37872e0 for instance 6a2d8c61-fa9b-482a-895f-529ef179c89d on n-h1-854121-10 Aug 29 10:41:49.370177 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-40395279-839c-4656-a79b-f6c81589ce51 req-587aea23-cf97-4ab0-af05-496ad0202cce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096678 Aug 29 10:41:49.372350 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 840/1765] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:41:49.599854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:49.601512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:49.619886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:49.620649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:49.631439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.635798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.639748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.642334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.643251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.644322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.646241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.647293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.648336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:49.651510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:49.652274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:49.653634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.278293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:50.290888 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46039bde-cd52-4b76-b413-239d0dbd4d37 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.675220 Aug 29 10:41:50.292984 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 841/1766] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:49 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:50.300404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:50.301012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:50.324442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:50.325785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:50.328588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.329822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:50.332408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:50.334483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.351962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:50.367227 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae65a74d-f16c-49cb-b18f-d116655fa896 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.772073 Aug 29 10:41:50.368468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 926/1767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:49 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:50.390843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:50.391716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:50.400815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:50.403006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:50.404474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.408800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:50.409481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:50.410172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.460780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:41:50.578828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:50.592695 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3248b55e-cee0-4293-9068-cb27c3bd5735 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1252 microversion: 2.1 time: 0.298456 Aug 29 10:41:50.613245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 842/1768] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:50 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1252 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:50.619097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-plugged", "status": "completed", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:50.633199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:50.634428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:50.636473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:50.649475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] Creating event network-vif-plugged:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:41:50.654900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5fba5da5-0cc9-46dc-90c2-8d9e35167c4c req-02564c13-2ba3-4ab8-9f2e-359184f3f2dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040055 Aug 29 10:41:50.656966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 843/1769] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:51.310726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:51.320874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:51.321579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:51.322923 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cda558a7-e7d7-42b6-8208-d3fd2f2febf9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.953077 Aug 29 10:41:51.323518 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 927/1770] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:50 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:51.336697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.337219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.337881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:51.340301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.345017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.345501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:51.395549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:51.396143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:51.403128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.404019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.404732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:51.405852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.406905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.407563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:51.955436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:51.971142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86cdfaaf-5cfb-4944-9402-7859a5ddb854 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1313 microversion: 2.1 time: 0.655233 Aug 29 10:41:51.981731 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 844/1771] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:51 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:51.981731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:51.981731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:51.983295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.984211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.985033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:51.986021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:51.986704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:51.987355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:52.012229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:52.051168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d43dc1a-fccf-4203-96bd-576a9e887814 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.654957 Aug 29 10:41:52.052080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 928/1772] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:51 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:52.181042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f952170d12540be9a74809c5607e5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf9acc70e7f746889c1533b615510465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:52.194973 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73544fcc-2052-49ad-8c11-9aba2d7e2588 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 200 len: 1252 microversion: 2.1 time: 0.222005 Aug 29 10:41:52.196110 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 845/1773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:51 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 1252 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:52.344764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:52.345379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:52.364207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:52.364704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:52.365143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:52.365892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:52.366462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:52.366774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:52.995762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:52.996640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:53.014794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.016649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.017311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.018482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.019036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.019835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.353572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:53.367957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ed5effc-8975-42ae-986c-8b71aeb39141 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 1.027604 Aug 29 10:41:53.386689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 929/1774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:52 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:53.403140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:53.404188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:53.410979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.411601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.412206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.413413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.414226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.414876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.857396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:53.876705 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88956953-aaeb-4292-bb00-dce74433352e tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1463 microversion: 2.1 time: 0.884986 Aug 29 10:41:53.878361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 846/1775] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:52 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1463 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:41:53.886557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:53.888592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] [instance: 2b60670e-e446-465f-9682-785bf357a149] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:53.899590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.900456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.901188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.902146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.902946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.903559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.927959 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] HTTP exception thrown: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Request method failure captured: Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 HTTP/1.1 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJdmp7-hVTgxjfay8LhWUrBTFp2MtFnzjkmOJilgrmWTvpVTUDB4TpDFrOzphygF43T3knitNj3IqQ6Y75hbWUJdXNO92y8AcFpd0ntd6kGz7uQIWXmklxtPhx-n-96ife1wzxP-9XMkLJMGSB9y1BhXlqoQGPYRvG75RIAO3zfwR2E Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: bf9acc70e7f746889c1533b615510465 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestBootFromVolume-150597850 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf9acc70e7f746889c1533b615510465"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bf9acc70e7f746889c1533b615510465"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bf9acc70e7f746889c1533b615510465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf9acc70e7f746889c1533b615510465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestBootFromVolume-150597850 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: bf9acc70e7f746889c1533b615510465 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestBootFromVolume-150597850 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestBootFromVolume-150597850-project Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6f952170d12540be9a74809c5607e5b7 Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestBootFromVolume-150597850-project Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '2b60670e-e446-465f-9682-785bf357a149'} Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:41:53.929648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. Aug 29 10:41:53.935016 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:41:53.939820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Returning 404 to user: Instance 2b60670e-e446-465f-9682-785bf357a149 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:41:53.941927 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf02bb19-205b-4d31-b401-a0dd3893d950 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149" status: 404 len: 111 microversion: 2.1 time: 0.061238 Aug 29 10:41:53.941927 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 847/1776] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:53 2022] GET /compute/v2.1/servers/2b60670e-e446-465f-9682-785bf357a149 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:41:53.949022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:53.949576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:53.964830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.965333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.965820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:53.966553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:53.967013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:53.967449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:54.165566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:54.179349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e32a1f5b-7e99-4c30-8a73-29d5fc7cc8ee tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.785687 Aug 29 10:41:54.181249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 930/1777] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:53 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:54.186857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae871ee4-8e4f-48b5-99a8-01152eabd788 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] Calling method '.version_select at 0x7f66cb198940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:54.229797 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae871ee4-8e4f-48b5-99a8-01152eabd788 tempest-ServersTestBootFromVolume-150597850 tempest-ServersTestBootFromVolume-150597850-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818058567" status: 202 len: 0 microversion: 2.1 time: 0.046991 Aug 29 10:41:54.233077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 931/1778] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818058567 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:54.396397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:54.397232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:54.424199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:54.429279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:54.429761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:54.430554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:54.431013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:54.433743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:55.147858 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-921d9137-8be8-42f3-8e40-b4846215f2f0 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1616 microversion: 2.1 time: 1.202399 Aug 29 10:41:55.151909 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 848/1779] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:53 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1616 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:55.174485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:41:55.175837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:55.192073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:55.194154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:55.196382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:55.198357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:55.200489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:55.202063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:55.224935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:55.236595 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b879a8f-8a53-464b-aba7-ee8aceded333 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.845626 Aug 29 10:41:55.260554 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 932/1780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:54 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:55.267582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:55.268504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:55.276681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:55.277619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:55.278256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:55.279367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:55.280000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:55.281263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:55.288484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6b36bc0577ae4eeb83f37e1498dd1026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba3a732e4c7409888a4b49a119ef887', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:55.293549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] flavor_id is None. Assuming migration. {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 10:41:55.294534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 10:41:56.007712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:56.031018 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9f88690-07be-4927-9a96-68f283610b56 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 0.766667 Aug 29 10:41:56.045089 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 933/1781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:55 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:56.071217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d65c72c4-7736-4d0e-addc-15557ddcbc9c tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0/action" status: 202 len: 0 microversion: 2.1 time: 0.903414 Aug 29 10:41:56.072503 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 849/1782] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:41:55 2022] POST /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0/action => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:56.082150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:56.082900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:56.102068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.102667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.103130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:56.110339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.110871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.111309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:56.264697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:56.266676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:56.276811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.283811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.284542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:56.285450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.292105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.292790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:56.762800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:56.772027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d451db5-7c92-45a7-a164-d66e7051ba51 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1472 microversion: 2.1 time: 0.695281 Aug 29 10:41:56.776891 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 934/1783] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:56 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1472 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:56.792114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:56.792856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:56.804061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.804574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.805021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:56.805769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:56.806239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:56.806666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.010124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'services' on Instance uuid d10989fe-e7ee-401e-b4cd-9acb94caf42c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:41:57.151946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:41:57.165606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-014ba5b7-878e-4d13-a1b5-f15e83728c7f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.905072 Aug 29 10:41:57.177060 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 850/1784] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:56 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:41:57.184925 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd21afa7-fa9b-4fe2-86a0-3de80cc9885b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments/7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f" status: 202 len: 0 microversion: 2.1 time: 0.406327 Aug 29 10:41:57.186445 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 935/1785] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:41:56 2022] DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments/7ad56ef4-ebcf-4ad5-8ec2-41a8212fa82f => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:41:57.190771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:57.198434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:57.198941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:57.204070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:57.216607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.219197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.220039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.221968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.222838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.223654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.224727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.227258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.227835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.228387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.229108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.229450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.356276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6df2d149-6bc4-4e8c-8950-92eb52e02e88 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165312 Aug 29 10:41:57.361474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 936/1786] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:41:57 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:41:57.798759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:41:57.799531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:41:57.814030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.814913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.815479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:41:57.822523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:41:57.826134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:41:57.826907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:00.001916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:00.018334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1589f6e-f70c-4a58-bdc1-d5bac2771a13 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 2.831730 Aug 29 10:42:00.022056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 851/1787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:57 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 2840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:00.037325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:00.038337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:00.058360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:00.059241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:00.059871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:00.060953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:00.064615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:00.067419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.491359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:01.505494 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00244529-10b3-40e5-aea7-ecd16a03cc01 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1472 microversion: 2.1 time: 3.706964 Aug 29 10:42:01.506254 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 937/1788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:41:57 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1472 bytes in 3713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:42:01.517165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:01.524864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:01.541530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:01.542746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:01.543478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.547064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:01.547887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:01.549163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.625485 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61ed5f45-da64-469f-9e38-ec687c4d9ad8 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115163 Aug 29 10:42:01.626516 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 938/1789] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:42:01 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:01.632706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c6c12f9f-5f5d-42df-8905-af52de3defca tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Action: 'create', calling method: .version_select at 0x7f66cb1680d0>, body: {"keypair": {"name": "tempest-keypair-1914786520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwFxyhVaar8nOmRzfseDFhZkvm9J1MlR0yDNmCplSvqOSazLcjs69hHE7B7l6APqwk7ZhD8A4LuaccZAkubk2Hw48Q+NDnrfJzkLhie3keUEdvErXaw3hNIu5xAwS3erg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:01.647051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:01.662802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c6c12f9f-5f5d-42df-8905-af52de3defca tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Getting quotas for project adf878bae1464083abe2ebea0b534c1c. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:42:01.663855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-999a8663-c313-4324-8426-55d68eba3283 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 1.640245 Aug 29 10:42:01.668195 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 852/1790] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:00 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:01.691852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c6c12f9f-5f5d-42df-8905-af52de3defca tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Getting quotas for user 2e6b9a6bbfcd45b19d5fd0eb07d1dccb and project adf878bae1464083abe2ebea0b534c1c. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:42:01.693508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4c690b-cc07-4f8c-b5df-e84a85777ac2", "name": "network-vif-plugged", "status": "completed", "tag": "ab426510-178d-4751-b183-9927d1cfe590"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:01.754359 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c6c12f9f-5f5d-42df-8905-af52de3defca tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.126361 Aug 29 10:42:01.761081 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 939/1791] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:42:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:42:01.761298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:01.761298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:01.761298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.767245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:01.771211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:01.791982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:01.793067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:01.793894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.798188 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] Creating event network-vif-plugged:ab426510-178d-4751-b183-9927d1cfe590 for instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 on n-h1-854121-10 Aug 29 10:42:01.799165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:01.802086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:01.805402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:01.807958 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c9ff2c73-6fc6-4879-8228-a01364a335bf req-eaf8c6d9-1a80-4c6e-94a2-0e10d08ce913 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137133 Aug 29 10:42:01.810737 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 853/1792] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:02.535141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:02.536381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:02.544253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:02.545203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:02.546580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:02.547508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:02.548187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:02.549403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:02.821003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:02.838084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44d9273e-ce0d-4583-b1bd-2a0df0d9825d tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1392 microversion: 2.1 time: 1.081357 Aug 29 10:42:02.853834 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 940/1793] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:01 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1392 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:02.872023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:02.881712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:02.889265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:02.894091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:02.894619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:02.895382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:02.895857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:02.896288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:03.048798 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ee7e6a4-18bb-407b-895e-df5d7dbd1066 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189302 Aug 29 10:42:03.054426 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 941/1794] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:42:02 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:03.076188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:03.078924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:03.116911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:03.119039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:03.119643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:03.121767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:03.122682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:03.124934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:03.237811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:03.276645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5952050e-5f09-4de4-a85a-8868397eab59 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1477 microversion: 2.1 time: 0.732745 Aug 29 10:42:03.278465 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 854/1795] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:02 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1477 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:03.718399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:03.731005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5875ce23-8bed-4a91-b5dd-043e36b02c0c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1307 microversion: 2.1 time: 0.675358 Aug 29 10:42:03.731923 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 942/1796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:03 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1307 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:03.862132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:03.862757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:03.877861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:03.878282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:03.878726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:03.879920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:03.880391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:03.880828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:04.064974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:04.067951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:04.083524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:04.090492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:04.091340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:04.092967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:04.094062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:04.094988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:04.207941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a008af6-3a17-4871-affc-3f573b2fac3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147165 Aug 29 10:42:04.210893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 943/1797] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:42:04 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:42:04.300917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:04.301728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:04.322046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:04.322885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:04.325302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:04.328810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:04.329612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:04.330360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.136813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:05.160055 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15f6fe90-5bef-4a85-9c76-1e49e6ae5e10 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1382 microversion: 2.1 time: 1.303719 Aug 29 10:42:05.178901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 855/1798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:03 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1382 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:05.189123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:05.190272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:05.198096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.199050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.199743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.200984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.202552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.203233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.262748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:05.277684 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9212f001-e35d-44a3-9602-3756a289fdf9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1477 microversion: 2.1 time: 0.982003 Aug 29 10:42:05.296252 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 944/1799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:04 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1477 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:42:05.315843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b066f85f-87bf-4b7b-a05d-6a045d95c828 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '.version_select at 0x7f66cb13eee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:05.329773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b066f85f-87bf-4b7b-a05d-6a045d95c828 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.332844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b066f85f-87bf-4b7b-a05d-6a045d95c828 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.333332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b066f85f-87bf-4b7b-a05d-6a045d95c828 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.361566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b066f85f-87bf-4b7b-a05d-6a045d95c828 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 3156 microversion: 2.1 time: 0.061521 Aug 29 10:42:05.362234 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 945/1800] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:42:05 2022] GET /compute/v2.1/os-migrations => generated 3156 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:05.375386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:05.389298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:05.402040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.402931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.403609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.404531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.405397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.406452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.412220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:05.476984 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2538a1f4-b622-4d77-bb19-7cdbc8c00c3b tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107013 Aug 29 10:42:05.489562 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 946/1801] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:42:05 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:05.503127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:05.505122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:05.524334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.534593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.535884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.536663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.538452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.538964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.845851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:05.849964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:05.857623 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1814eb5-d840-492c-842f-72965e73bbe4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1485 microversion: 2.1 time: 0.677428 Aug 29 10:42:05.866346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 856/1802] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:05 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1485 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:05.888341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:05.888874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:05.902635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.906606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.907286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:05.908330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:05.908960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:05.909578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.078572 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a020a26d-cce7-495b-b292-7e66d6b65c7c tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2/action" status: 202 len: 0 microversion: 2.1 time: 0.194402 Aug 29 10:42:06.079534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 857/1803] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:42:05 2022] POST /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:06.087768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:06.088754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:06.099648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.103939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.106150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.108860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.114324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.114887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.416528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d212b19-38a8-41c6-be42-5b6533081033 tempest-LiveMigrationTest-206644255 tempest-LiveMigrationTest-206644255-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1535 microversion: 2.1 time: 0.925756 Aug 29 10:42:06.417468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 947/1804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:05 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1535 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:06.431922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:06.432551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:06.455499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.456009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.456528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.465890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.470543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.471168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.701301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:06.732309 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0aa24d23-e54c-4d52-a25a-90f0e5c39604 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1490 microversion: 2.1 time: 0.648635 Aug 29 10:42:06.733872 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 858/1805] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:06 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1490 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:06.739671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:06.740396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:06.747820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.749628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.750492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.751467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.752144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.752803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.786533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:06.912288 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75e4ea3c-46ca-4506-a296-780e72050ce0 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 204 len: 0 microversion: 2.1 time: 0.176742 Aug 29 10:42:06.913809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 859/1806] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:06 2022] DELETE /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:06.923559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:06.926853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:06.936818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.937967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.938607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.939515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:06.940698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:06.943095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:06.976319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:06.998107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6fba7db7-dd02-408b-9a66-74c88c185080 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1477 microversion: 2.1 time: 0.579279 Aug 29 10:42:06.998717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 948/1807] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:06 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:07.019158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:07.019815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:07.027394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.027871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.028320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.029116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.029584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.030878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.044053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b4524cc7-d662-4111-b671-1ffbf78bb280 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127388 Aug 29 10:42:07.044655 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 860/1808] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:42:06 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:42:07.152062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:07.154327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:07.166217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.166795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.167946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.169664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.169664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.169664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.229546 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Cannot 'reboot' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action HTTP/1.1 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 28 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: {"reboot": {"type": "HARD"}} Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'reboot' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '8a330a56-f2f3-4471-91b5-86c3e850bc85', 'body': {'reboot': {'type': 'HARD'}}} Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:42:07.231294 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 409 to user: Cannot 'reboot' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:07.237789 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ebd0ac2-f286-4897-b1c3-6190da771c64 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action" status: 409 len: 145 microversion: 2.1 time: 0.085891 Aug 29 10:42:07.242755 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 861/1809] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:42:07 2022] POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action => generated 145 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:42:07.253489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:07.274146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:07.286870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.287368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.287805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.288777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.289400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.290049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.321643 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Cannot 'rebuild' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action HTTP/1.1 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 65 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'rebuild' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '8a330a56-f2f3-4471-91b5-86c3e850bc85', 'body': {'rebuild': {'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde'}}} Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:42:07.323614 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued Aug 29 10:42:07.330371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:07.332711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 409 to user: Cannot 'rebuild' instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 while it is in vm_state rescued {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:07.333774 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-741f587c-9d36-479a-a3bb-cb7808be0699 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action" status: 409 len: 146 microversion: 2.1 time: 0.089803 Aug 29 10:42:07.339089 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 862/1810] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:42:07 2022] POST /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85/action => generated 146 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:42:07.344802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:07.345551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:07.352693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.353437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.354103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.355001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.355624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.356236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.388516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:07.429422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:07.454860 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bb7f4f6-962f-4857-a5dc-55a0bf21feec tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1388 microversion: 2.1 time: 0.440431 Aug 29 10:42:07.455464 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 949/1811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:06 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1388 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:07.523522 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51ebee3a-7b58-41c9-b8e4-2bffff7e426c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 204 len: 0 microversion: 2.1 time: 0.182253 Aug 29 10:42:07.524617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 863/1812] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:07 2022] DELETE /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:07.534656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:07.535432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:07.537471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:07.556644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.557468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.558167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.559327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:07.559969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:07.560987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:07.564314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-963426960", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ccc1d11f-29a6-4dde-9add-95eb3a340e0e"}, {"port": "bd598a4e-a61e-46b1-930c-4d59792d1dcb", "tag": "port-1"}, {"port": "844cad02-b496-4a09-975b-2dc20d4c7f00", "tag": "port-2"}, {"uuid": "69d9e5c8-6620-4b45-8435-dc5b429f19a7", "tag": "net-1"}, {"uuid": "69d9e5c8-6620-4b45-8435-dc5b429f19a7"}, {"uuid": "c2b5ce10-115e-4c85-8772-6e5804317d56", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c2b5ce10-115e-4c85-8772-6e5804317d56", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9247858e-ffe2-42c9-90d3-850c1b220f2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "db12c08b-189c-4200-95ce-4afc9e37127d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b338e8bf-01bb-4cb4-9601-d75afbdb485d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--383305972"}], "key_name": "tempest-keypair-1914786520", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:07.860958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] validate_networks() for [('ccc1d11f-29a6-4dde-9add-95eb3a340e0e', None, None, None, None, None), (None, None, 'bd598a4e-a61e-46b1-930c-4d59792d1dcb', None, None, None), (None, None, '844cad02-b496-4a09-975b-2dc20d4c7f00', None, None, None), ('69d9e5c8-6620-4b45-8435-dc5b429f19a7', None, None, None, None, None), ('69d9e5c8-6620-4b45-8435-dc5b429f19a7', None, None, None, None, None), ('c2b5ce10-115e-4c85-8772-6e5804317d56', '10.2.2.100', None, None, None, None), ('c2b5ce10-115e-4c85-8772-6e5804317d56', '10.2.2.200', None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:42:07.992447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:08.008974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d36dfd4-efbc-46f4-9e69-2e625e87914c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1689 microversion: 2.1 time: 0.479507 Aug 29 10:42:08.033410 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 950/1813] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:07 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1689 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:08.065806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:08.069795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:08.110460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:08.111485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:08.113450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:08.124509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:08.125010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:08.125456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:08.636604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:08.651202 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7e28435a-9817-4888-86fa-a950e6fd25d2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 200 len: 1470 microversion: 2.1 time: 0.616225 Aug 29 10:42:08.654475 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 951/1814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:08 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 1470 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:08.666612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:08.667561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:08.683290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:08.684081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:08.686730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:08.689386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:08.691610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:08.692962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:09.401240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:09.417884 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47172776-8b44-4b86-a8ba-6d2b382f89db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1477 microversion: 2.1 time: 0.761265 Aug 29 10:42:09.433008 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 952/1815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:08 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1477 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:09.444560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:09.450642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:09.460932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:09.462169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:09.463072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:09.464526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:09.465026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:09.465596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:09.832473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:09.840813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15a8260b-c418-41fd-b369-e4da244146f3 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1388 microversion: 2.1 time: 0.406021 Aug 29 10:42:09.841404 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 953/1816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:09 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1388 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:09.856499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-756865331"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:09.859562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:09.868209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:09.869106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:09.869756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:09.870828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:09.871659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:09.872283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:10.212420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1501b39e-d461-4e1d-8a00-6926a9e009a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2/action" status: 202 len: 0 microversion: 2.1 time: 0.364539 Aug 29 10:42:10.213406 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 954/1817] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:42:09 2022] POST /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:42:10.581814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:10.582399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:10.588872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:10.589374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:10.589839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:10.590548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:10.591002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:10.591429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:11.169026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:11.180728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c28a16f9-6787-40fb-9bc3-df76abfccf0f tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 200 len: 1689 microversion: 2.1 time: 0.965044 Aug 29 10:42:11.181968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 955/1818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:10 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 1689 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:11.188534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d842fc9-3b52-4913-8835-ab266fa25756 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c7166e50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:11.256275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d842fc9-3b52-4913-8835-ab266fa25756 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.072273 Aug 29 10:42:11.257225 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 956/1819] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:11 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:11.264939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:11.266226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:11.273355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:11.274185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:11.274804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:11.275907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:11.276536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:11.277140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:11.710429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:12.272260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:12.285551 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea446211-220d-4f79-ab86-ecaaf0b77690 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1477 microversion: 2.1 time: 1.025939 Aug 29 10:42:12.301334 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 957/1820] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:11 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1477 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:12.307161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:12.308047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:12.317934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:12.318856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:12.319467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:12.321787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:12.322566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:12.324828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:12.887757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:12.897327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ef5fe2d-aea2-41ea-ba00-3fd2409bc772 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1388 microversion: 2.1 time: 0.594558 Aug 29 10:42:12.898289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 958/1821] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:12 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1388 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:13.371381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0087b434-6de1-47b5-995b-43cc3ff86e16 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Action: 'create', calling method: .version_select at 0x7f66cb1983a0>, body: {"pool": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:16.945407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:42:16.945934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:42:16.946316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:42:16.946980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:42:16.947410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:42:16.952540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:16.970764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:16.971237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:16.971676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:16.972487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:16.972949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:16.978775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:17.017710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Getting quotas for project adf878bae1464083abe2ebea0b534c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:42:17.030412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Getting quotas for user 2e6b9a6bbfcd45b19d5fd0eb07d1dccb and project adf878bae1464083abe2ebea0b534c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:42:17.497466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:42:17.503955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9247858e-ffe2-42c9-90d3-850c1b220f2c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='db12c08b-189c-4200-95ce-4afc9e37127d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b338e8bf-01bb-4cb4-9601-d75afbdb485d',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:42:18.597908 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9ce1388-75d6-4fe6-bf23-cab2a8ad7ef6 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.032816 Aug 29 10:42:18.599729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 864/1822] 10.222.0.47 () {62 vars in 1189 bytes} [Mon Aug 29 10:42:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 11043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 10:42:18.614120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:18.615241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: d10989fe-e7ee-401e-b4cd-9acb94caf42c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:18.652762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:18.662237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:18.663342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:18.665455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:18.666032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:18.668123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:18.747109 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c HTTP/1.1 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd10989fe-e7ee-401e-b4cd-9acb94caf42c'} Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:18.749207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 404 to user: Instance d10989fe-e7ee-401e-b4cd-9acb94caf42c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:18.754969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b14582df-a047-4fae-b279-5ce7f213cb75 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c" status: 404 len: 111 microversion: 2.1 time: 0.149543 Aug 29 10:42:18.760809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 865/1823] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:18 2022] GET /compute/v2.1/servers/d10989fe-e7ee-401e-b4cd-9acb94caf42c => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:18.771284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-945748e5-9574-47cd-add6-abb7e82d4bb6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6f6f160>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:18.899771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-945748e5-9574-47cd-add6-abb7e82d4bb6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.137579 Aug 29 10:42:18.900361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 866/1824] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:18 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:18.911708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2d8c61-fa9b-482a-895f-529ef179c89d", "name": "network-vif-deleted", "tag": "05d73088-a615-435f-9feb-a9acb37872e0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:18.963049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:18.967915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:18.968744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:19.021164 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] Creating event network-vif-deleted:05d73088-a615-435f-9feb-a9acb37872e0 for instance 6a2d8c61-fa9b-482a-895f-529ef179c89d on n-h2-854121-10 Aug 29 10:42:19.044585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-143b67ab-0ef7-4ace-ab6b-90adc4258d9e req-ffdbd1d8-3605-47d0-b381-5189f9200b7f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142977 Aug 29 10:42:19.055187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 867/1825] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:19.820095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:19.821634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:19.844093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:19.844978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:19.847276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:19.849232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:19.853282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:19.854589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.009476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0087b434-6de1-47b5-995b-43cc3ff86e16 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.108415 Aug 29 10:42:20.010719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 959/1826] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:42:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:20.016536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:20.017629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:20.042047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:20.043029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:20.043474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.044198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:20.045363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:20.045834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.231758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:20.239862 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aca1d9c4-95d0-41b0-a18a-c0f93d2bacf5 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1183 microversion: 2.1 time: 0.228519 Aug 29 10:42:20.240454 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 960/1827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:20 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:20.263596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4c690b-cc07-4f8c-b5df-e84a85777ac2", "name": "network-vif-plugged", "status": "completed", "tag": "ab426510-178d-4751-b183-9927d1cfe590"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:20.316525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:20.322704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:20.323174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.337532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:20.351816 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c71752da-2bf1-45fd-be65-266da370f8e0 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1476 microversion: 2.1 time: 1.294651 Aug 29 10:42:20.366111 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 868/1828] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:19 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1476 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:20.376600 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] Creating event network-vif-plugged:ab426510-178d-4751-b183-9927d1cfe590 for instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 on n-h1-854121-10 Aug 29 10:42:20.384051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:20.385391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:20.400205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-83f6bcf1-d167-4bc0-93d9-656c77b34ea3 req-d55119ed-b231-401c-912e-18334f784e16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152335 Aug 29 10:42:20.406468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 961/1829] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:20.415479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ebc1272-7ca7-4432-b72c-18445b03fbc0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '.version_select at 0x7f66cb142940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:20.513135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:20.517779 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ebc1272-7ca7-4432-b72c-18445b03fbc0 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953310974" status: 202 len: 0 microversion: 2.1 time: 0.108434 Aug 29 10:42:20.518452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 962/1830] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953310974 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:20.522258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:20.523713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:20.524852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a1ac81e-293b-4983-8545-ba104bb6349d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1285 microversion: 2.42 time: 0.157372 Aug 29 10:42:20.545798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 869/1831] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:20 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:20.550704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-862d9b22-84bf-408e-8230-e868160ba305 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c74feca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:20.707383 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-862d9b22-84bf-408e-8230-e868160ba305 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.158891 Aug 29 10:42:20.707987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 870/1832] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:20 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:20.730446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1556244326", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:20.737985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-014e122f-a9d0-4510-944a-163c3549e259 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66c77ed700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:20.845335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:42:20.845797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:42:20.846338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:42:20.846762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:42:20.847181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:42:20.872169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:20.873220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:20.873689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.874495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:20.880687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:20.881191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:20.955864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Getting quotas for project 12242044e58841fba2728ff392bdf656. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:42:20.964652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Getting quotas for user 85f98f930159499e96b573aed9cc9400 and project 12242044e58841fba2728ff392bdf656. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:42:20.987422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:42:20.991438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:42:21.132572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99b09d10-a981-42ef-96cb-d6ad4637c67e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.612401 Aug 29 10:42:21.133991 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 963/1833] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:42:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:42:21.144989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-unplugged", "status": "completed", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:21.199635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:21.201317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:21.202037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:21.252882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Creating event network-vif-unplugged:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h1-854121-10 Aug 29 10:42:21.283206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:42:21.363627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-58740866-f161-486f-9c09-9f2a3eb819a8 req-fee4b49b-c754-45b3-a339-69abba4d9f03 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.225497 Aug 29 10:42:21.366038 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 964/1834] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:21.368997 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-014e122f-a9d0-4510-944a-163c3549e259 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/fe6d523d-0d67-4605-a1a2-9a0eee5a377d" status: 200 len: 142 microversion: 2.1 time: 0.659900 Aug 29 10:42:21.370546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 871/1835] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:42:20 2022] GET /compute/v2.1/os-floating-ips/fe6d523d-0d67-4605-a1a2-9a0eee5a377d => generated 142 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:21.376911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:21.379229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:21.390807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:21.397015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:21.397149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:21.397748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:21.403848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:21.426181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:21.430504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:21.433428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:21.564819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:21.585392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:21.590297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:21.604209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-231d4314-731f-48a0-b9e8-7558dc822a31 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "PUT /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1359 microversion: 2.75 time: 0.236631 Aug 29 10:42:21.608068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 965/1836] 10.222.0.47 () {62 vars in 1297 bytes} [Mon Aug 29 10:42:21 2022] PUT /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:21.614201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:21.615168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:21.654493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:21.655625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:21.658226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:21.661640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:21.665353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:21.666559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:21.824142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:21.846096 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0aa24db5-d6ba-4c85-8a79-ee017ad5274f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1183 microversion: 2.1 time: 0.474004 Aug 29 10:42:21.852484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 872/1837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:21 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1183 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:21.861080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8a2297ff-8ca6-49a8-b9f5-95bade575ea0 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66c7570ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:22.877294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:22.887746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fbcd53da-d451-49d2-bb48-480332db2ee4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1476 microversion: 2.1 time: 1.278271 Aug 29 10:42:22.895761 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 966/1838] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:21 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1476 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:22.912628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10989fe-e7ee-401e-b4cd-9acb94caf42c", "name": "network-vif-deleted", "tag": "9d485d38-4661-467c-bbaf-c49060598f0f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:22.948918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:22.957311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:22.961346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:22.974817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:23.010091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] Creating event network-vif-deleted:9d485d38-4661-467c-bbaf-c49060598f0f for instance d10989fe-e7ee-401e-b4cd-9acb94caf42c on n-h2-854121-10 Aug 29 10:42:23.027486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7ee6fce9-cc7c-4ba9-91a9-1695348a295d req-1e0a7058-315e-47f9-a09d-7b6997ab64c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130032 Aug 29 10:42:23.028715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 967/1839] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:23.054188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:23.055520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:23.069281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.074574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.075671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.079390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.080112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.080764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.508574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:23.530858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:23.536585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:23.542010 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-317eceb2-29c0-4edf-b198-50343b53f491 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1593 microversion: 2.42 time: 0.506282 Aug 29 10:42:23.568161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 968/1840] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:23 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1593 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:23.575101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8a2297ff-8ca6-49a8-b9f5-95bade575ea0 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.721103 Aug 29 10:42:23.576542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 873/1841] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:42:21 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:23.582401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fe72aa7-5ea2-408e-8752-233792a8f5f9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6d01700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:23.597751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:23.602126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:23.620825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.623978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.624857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.631893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.632883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.633605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.668239 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9fe72aa7-5ea2-408e-8752-233792a8f5f9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.090182 Aug 29 10:42:23.670143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 874/1842] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:23 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:23.690876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:23.692214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:23.722317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.725952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.736878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.738090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.738991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.739974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.855424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:23.868694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:23.869324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:23.869825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lazy-loading 'fault' on Instance uuid 6a2d8c61-fa9b-482a-895f-529ef179c89d {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:42:24.023005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:24.037821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:24.040129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:24.062352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aba3f00c-ef36-4974-af59-cffb6dce1709 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1411 microversion: 2.75 time: 0.491362 Aug 29 10:42:24.067203 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 969/1843] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:23 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1411 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:24.074292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:24.092708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:24.093733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:24.094516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:24.115681 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Creating event network-changed:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h1-854121-10 Aug 29 10:42:24.123629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:42:24.139063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ff47eb27-208c-4b32-a6e4-edcb14058e1b req-238428da-1559-4337-b549-252680a847e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069639 Aug 29 10:42:24.140489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 970/1844] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:24.163716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fe9e937-ea88-49e0-a347-50a6d2845531 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66cb168670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:24.819510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:24.839692 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d80170a1-edc1-4fda-bdc1-8d29ed1dc027 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 200 len: 1142 microversion: 2.1 time: 1.166174 Aug 29 10:42:24.843130 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 875/1845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:23 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 1142 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:24.856724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:24.868329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:24.883623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:24.886358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:24.890335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:24.891465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:24.892271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:24.892894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:25.754823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:25.766426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aee9adef-a7a6-4738-8665-8cb959e7688a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1476 microversion: 2.1 time: 0.921799 Aug 29 10:42:25.768252 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 876/1846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:24 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1476 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:25.779660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:25.782206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:25.797500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:25.802373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:25.803882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:25.806828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:25.809718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:25.811463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:25.998887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:26.404546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:26.419965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:26.422568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:26.426448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2960a428-ec88-45a1-9bc6-1669b3df5498 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1593 microversion: 2.42 time: 0.656085 Aug 29 10:42:26.430853 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 877/1847] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:25 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1593 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:26.438513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf345777-7f61-420c-aa88-627d802f1817 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c77ed700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:26.524281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf345777-7f61-420c-aa88-627d802f1817 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.091891 Aug 29 10:42:26.532346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 878/1848] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:26 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:26.532346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:26.537748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:26.556255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:26.556943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:26.557487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:26.558596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:26.562579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:26.563193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:26.999176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:27.300090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:27.316852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:27.318455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:27.331965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d29facc-48a1-4e71-be6c-7ef8e73ec625 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1417 microversion: 2.75 time: 0.805791 Aug 29 10:42:27.337277 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 879/1849] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:26 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1417 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:27.349235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:27.351418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 6a2d8c61-fa9b-482a-895f-529ef179c89d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:27.363636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:27.368863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:27.375339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:27.376353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:27.377058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:27.377769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:27.398652 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] HTTP exception thrown: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Request method failure captured: Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d HTTP/1.1 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGCA-usGkbUN2e2KONV5_M--45Y-SH_Fxa9cGI6EWGAzMxvJjnCz17OduVFufy6-aUWUiFG7o8CudstobkDl9sEsZzSwvezwmQqTMqxFheNF2vj_nvzcJ6qI0AadJnbWHtQt9ml7R75Hd5F6arEk6JANpMcq_zanRNgPR6A_yqCok Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af9408db02324de389c1364747169f4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af9408db02324de389c1364747169f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 30e7715efc824e0d9dc68fc5eb4b398b Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6a2d8c61-fa9b-482a-895f-529ef179c89d'} Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:27.416519 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. Aug 29 10:42:27.422699 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:27.423670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Returning 404 to user: Instance 6a2d8c61-fa9b-482a-895f-529ef179c89d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:27.427347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d3405fa-fa07-4080-8571-2d846399c19c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d" status: 404 len: 111 microversion: 2.1 time: 0.086015 Aug 29 10:42:27.428230 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 880/1850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:27 2022] GET /compute/v2.1/servers/6a2d8c61-fa9b-482a-895f-529ef179c89d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:27.439853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:27.444199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:27.459253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:27.463933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:27.464715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:27.468208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:27.468903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:27.470730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:29.027459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:29.042746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eab4f8d8-b83a-4cfd-8722-c87fa189f57d tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1474 microversion: 2.1 time: 1.612097 Aug 29 10:42:29.059466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 881/1851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:27 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1474 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:29.082542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:29.083877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:29.099505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:29.100300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:29.100963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:29.102374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:29.103042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:29.103686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:29.287717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:29.308790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:29.314405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:29.319861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1adf6ca5-9277-478d-992e-64f41ff54bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1593 microversion: 2.42 time: 0.247320 Aug 29 10:42:29.342658 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 882/1852] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:29 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1593 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:29.354963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7ae8e06-31ad-481d-9098-a8f683235502 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6d01550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:29.416801 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7ae8e06-31ad-481d-9098-a8f683235502 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.070865 Aug 29 10:42:29.417963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 883/1853] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:29 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:29.423439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:29.429283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:29.442177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:29.445572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:29.446269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:29.471986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:29.473939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:29.475038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:29.973602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.005351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.007411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.023061 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a4eeaf8-a125-4da4-9a68-a2535135e47a tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1438 microversion: 2.75 time: 0.603704 Aug 29 10:42:30.023656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 884/1854] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:29 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1438 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:30.051899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:30.072906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:30.099229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.100016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.100719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.103755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.107923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.110222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.262386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:42:30.263257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:42:30.263986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:42:30.264649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:42:30.265323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:42:30.405889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:30.418085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.418590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.419048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.420525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.420988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.421420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.520060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:30.631935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.648506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.658927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:30.676049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0bbbc16e-7897-418c-acb5-3ef12a0a5545 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "POST /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c/action" status: 202 len: 1495 microversion: 2.75 time: 0.628003 Aug 29 10:42:30.692957 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 885/1855] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:42:30 2022] POST /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c/action => generated 1495 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 29 10:42:30.713588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:30.715245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:30.732688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.733188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.733628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.738652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.739268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.739728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.768406 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fe9e937-ea88-49e0-a347-50a6d2845531 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/fe6d523d-0d67-4605-a1a2-9a0eee5a377d" status: 202 len: 0 microversion: 2.1 time: 6.625792 Aug 29 10:42:30.769074 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 971/1856] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:42:24 2022] DELETE /compute/v2.1/os-floating-ips/fe6d523d-0d67-4605-a1a2-9a0eee5a377d => generated 0 bytes in 6628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:30.776853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:30.778216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:30.817187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.817767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.818225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.835655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:30.853604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:30.854263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:30.943716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:31.526942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:31.542166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb74c3de-e7ba-4bf0-a2f5-9f1944ecae50 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1471 microversion: 2.1 time: 0.844003 Aug 29 10:42:31.543685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 886/1857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:30 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1471 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:31.560371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08db7b83-566f-4c29-aaf7-c11083e25296 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0d3700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:31.575789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:31.659932 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-08db7b83-566f-4c29-aaf7-c11083e25296 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.110991 Aug 29 10:42:31.687073 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 887/1858] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:31 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:31.705128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:31.705693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:31.734738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:31.737237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:31.737722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:31.738488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:31.738953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:31.744488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:31.823306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:31.870686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:31.903005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:31.906872 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ad3464b-d1d4-4039-a9bc-9b0d99d73c9e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1660 microversion: 2.42 time: 1.136269 Aug 29 10:42:31.932075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 972/1859] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:30 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1660 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:31.963690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-416c8701-745a-4b23-beeb-5f16bccdf060 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Action: 'create', calling method: .version_select at 0x7f66c71f5940>, body: {"pool": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:32.357598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:32.368269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:32.376142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:32.386651 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc228427-1122-41c8-81d6-5571928cb33f tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.698401 Aug 29 10:42:32.407797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 888/1860] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:31 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:32.416907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:32.424781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:32.438463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:32.445064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:32.445914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:32.446933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:32.452059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:32.452815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:32.737822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c4c6f02a-0c3d-449a-a5e5-3277e3a1e124 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "POST /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0/action" status: 202 len: 0 microversion: 2.1 time: 0.327907 Aug 29 10:42:32.739314 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 889/1861] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:42:32 2022] POST /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:32.746001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-20f1c260-af9a-43e3-8c6d-b0a963d6e58f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e608b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:32.867089 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-20f1c260-af9a-43e3-8c6d-b0a963d6e58f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.126562 Aug 29 10:42:32.867705 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 890/1862] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:32 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:32.888981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:32.889759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:32.925762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:32.935669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:32.942653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:32.950771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:32.984641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:32.984641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:34.132173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:34.146428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16533ef6-b2b7-49df-a708-cca653fc2b61 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1470 microversion: 2.1 time: 1.265674 Aug 29 10:42:34.147879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 891/1863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:32 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1470 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:34.157437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:34.160302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:34.174052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:34.179905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:34.180838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:34.182445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:34.183270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:34.183897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:34.812047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:34.827092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:34.834711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:34.836243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4603ca03-9cb6-4cb2-8f0b-047a6dce9001 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1706 microversion: 2.42 time: 0.687216 Aug 29 10:42:34.837340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 892/1864] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:34 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1706 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:34.846496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-plugged", "status": "completed", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:34.872142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:34.873944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:34.874570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:34.907080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Creating event network-vif-plugged:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h1-854121-10 Aug 29 10:42:34.926810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:42:34.956248 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b82899c3-ef29-4099-b384-5e7e14d9eef3 req-51e3c751-a710-403f-b17c-5dcdc1120496 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117450 Aug 29 10:42:34.957124 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 893/1865] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:34.964313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:34.971178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:34.987913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:34.991760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:34.992523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:35.000291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:35.001034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:35.001679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:35.210421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:35.227041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:35.228437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:35.235471 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ab90c80-fff8-46a1-bafb-e96a512fe1a9 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.276645 Aug 29 10:42:35.265605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 894/1866] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:34 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:35.270547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1904ea87-ca8a-4758-945d-8d6015490f35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c71d53a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:35.389305 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1904ea87-ca8a-4758-945d-8d6015490f35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.121221 Aug 29 10:42:35.389929 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 895/1867] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:35 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:35.408842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:35.409464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:35.435545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:35.437179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:35.437637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:35.438392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:35.445085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:35.445811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:35.449003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:36.500144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:36.508354 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c66fa207-7c4c-4c89-a8eb-aacd8e2ba6de tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1470 microversion: 2.1 time: 1.103260 Aug 29 10:42:36.522118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 896/1868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:35 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1470 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:36.522118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:36.522118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:36.539877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:36.540156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:36.540868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:36.542282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:36.542853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:36.543681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.006624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.025292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.029957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.034866 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89118474-1ea8-497f-ac69-31bf575ca572 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1752 microversion: 2.42 time: 1.522479 Aug 29 10:42:38.037840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 897/1869] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:36 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1752 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:38.045570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:38.046432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:38.055345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.056112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.056726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.057626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.058395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.059054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.339496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.348164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.369124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:38.376687 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6f38856-d801-4842-b41d-7845d2791d95 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.337466 Aug 29 10:42:38.386774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 898/1870] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:38 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:38.398187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-489daea8-8e8f-431b-af16-dea61b55fbaa tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c7625820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:38.489068 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-416c8701-745a-4b23-beeb-5f16bccdf060 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.554986 Aug 29 10:42:38.491308 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 973/1871] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:42:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:38.496360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:38.497855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:38.504011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:38.521250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.522052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.522617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.523484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.524045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.530321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.534978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-489daea8-8e8f-431b-af16-dea61b55fbaa tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1413 microversion: 2.1 time: 0.146194 Aug 29 10:42:38.536073 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 899/1872] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:38 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:38.629131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:38.815516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-30703955", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "3071b3c4-a7b6-4ff3-98df-897c7d7ae45a"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:38.851460 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5276b85b-d6dc-4a68-b6a1-538471771c6c tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 204 len: 0 microversion: 2.1 time: 0.358437 Aug 29 10:42:38.855613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 974/1873] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:38 2022] DELETE /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:38.861771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:38.866050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:38.881001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.881763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.882458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:38.886806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:38.888204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:38.888877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:39.038349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] validate_networks() for [('3071b3c4-a7b6-4ff3-98df-897c7d7ae45a', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:42:40.920718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:40.930488 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-201401fa-8780-4b4c-bb6e-3b72d2664924 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1470 microversion: 2.1 time: 2.072880 Aug 29 10:42:40.937610 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 975/1874] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:38 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1470 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:40.953181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c061ec59-b57e-452d-886a-ef69cffadac6 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66cb08fe50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:43.773131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:42:43.773677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:42:43.774683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:42:43.775242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:42:43.775767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:42:43.799855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:43.800769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:43.801549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:43.802750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:43.803534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:43.804224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:43.840537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Getting quotas for project 518789a1d4c94615a57231569c98b6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:42:43.852386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Getting quotas for user 49f66ab4526a49adb61f9faa5163e9d2 and project 518789a1d4c94615a57231569c98b6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:42:43.872993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:42:43.875886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:42:43.910968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:43.947394 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89177771-c41f-4b20-b81e-811e96a5361f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.409788 Aug 29 10:42:43.949023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 900/1875] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 5412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:42:43.956983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:43.958028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 635c5b3a-b42f-4389-900b-5fd986b96a5e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:43.967266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:43.968237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:43.970289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:43.971469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:43.972551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:43.974218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:44.030781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] HTTP exception thrown: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Request method failure captured: Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e HTTP/1.1 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGCA-usGkbUN2e2KONV5_M--45Y-SH_Fxa9cGI6EWGAzMxvJjnCz17OduVFufy6-aUWUiFG7o8CudstobkDl9sEsZzSwvezwmQqTMqxFheNF2vj_nvzcJ6qI0AadJnbWHtQt9ml7R75Hd5F6arEk6JANpMcq_zanRNgPR6A_yqCok Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af9408db02324de389c1364747169f4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af9408db02324de389c1364747169f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 30e7715efc824e0d9dc68fc5eb4b398b Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '635c5b3a-b42f-4389-900b-5fd986b96a5e'} Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:44.036352 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. Aug 29 10:42:44.041189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:44.048425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Returning 404 to user: Instance 635c5b3a-b42f-4389-900b-5fd986b96a5e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:44.050717 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83b4ddbb-1f2d-48b7-91cf-bff7da86bb4f tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e" status: 404 len: 111 microversion: 2.1 time: 0.098984 Aug 29 10:42:44.052343 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 901/1876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:43 2022] GET /compute/v2.1/servers/635c5b3a-b42f-4389-900b-5fd986b96a5e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:44.069238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:44.072796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:44.089464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:44.091052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:44.092928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:44.094581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:44.096915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:44.099372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.154669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.176773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.181752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.188554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eff7a894-f0d3-41e7-893a-b34d9300a889 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1798 microversion: 2.42 time: 1.133591 Aug 29 10:42:45.191051 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 902/1877] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:44 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1798 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:45.205386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-unplugged", "status": "completed", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:45.227453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.227940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.228372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.270402 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Creating event network-vif-unplugged:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:42:45.285547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 10:42:45.323491 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1f1041c8-efa5-4781-9b60-3b6ee4ec432e req-c9923abe-9245-40b9-a573-0bc21e2e79d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130401 Aug 29 10:42:45.325614 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 903/1878] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:45.343576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:45.344556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:45.367471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.368189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.368637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.369429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.372391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.372895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.591631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.606436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.608155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:45.624765 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b06020ac-7fbe-4109-9f18-5a8b4687cdac tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.295466 Aug 29 10:42:45.625665 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 904/1879] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:45 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:45.638061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a7d7b71-0062-4bcc-9313-4d13506bd58b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0e68b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:45.712761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a7d7b71-0062-4bcc-9313-4d13506bd58b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1422 microversion: 2.1 time: 0.081883 Aug 29 10:42:45.713525 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 905/1880] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:45 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:45.722654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635c5b3a-b42f-4389-900b-5fd986b96a5e", "name": "network-vif-deleted", "tag": "20001fee-eafc-4b62-a4dd-84ea42202a75"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:45.743386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.743841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.744278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.786903 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] Creating event network-vif-deleted:20001fee-eafc-4b62-a4dd-84ea42202a75 for instance 635c5b3a-b42f-4389-900b-5fd986b96a5e on n-h1-854121-10 Aug 29 10:42:45.795976 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bb18d3e9-8224-4f6c-88d2-ded04d6ff4ed req-c395e077-c67a-4f1d-a6fc-4908a65cd0e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081100 Aug 29 10:42:45.796962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 906/1881] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:45.804284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:45.814078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:45.823182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.823677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.824379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:45.835997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:45.836697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:45.837161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.052526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c061ec59-b57e-452d-886a-ef69cffadac6 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535" status: 202 len: 0 microversion: 2.1 time: 5.113341 Aug 29 10:42:46.056733 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 976/1882] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:42:40 2022] DELETE /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535 => generated 0 bytes in 5118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:46.062123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.062917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:46.069482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.070153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.070712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.071611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.072125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.072672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.196638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:46.205305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80df7818-3dd9-4f20-9b25-4f8a5208e50f tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1267 microversion: 2.1 time: 0.147355 Aug 29 10:42:46.207430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 977/1883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:46 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:46.211292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8a80a80-b263-458d-98e3-d4899d13fbdc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '.version_select at 0x7f66cb1530d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.232743 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8a80a80-b263-458d-98e3-d4899d13fbdc tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281157705" status: 202 len: 0 microversion: 2.1 time: 0.025118 Aug 29 10:42:46.237183 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 978/1884] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281157705 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:42:46.242469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.243389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:46.251013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.251763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.252465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.253376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.254039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.254646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.275694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:46.284335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:46.286303 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b7b4a72-309c-4cb4-8a75-c36540247c43 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1470 microversion: 2.1 time: 0.486902 Aug 29 10:42:46.287356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 907/1885] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:45 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:46.292787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b93e480f-8542-471d-a838-8200ee5f90ba tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0a5e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.362437 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b93e480f-8542-471d-a838-8200ee5f90ba tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 200 len: 1422 microversion: 2.1 time: 0.073509 Aug 29 10:42:46.369221 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 908/1886] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:42:46 2022] GET /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 1422 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:46.369221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66c7424ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.406943 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1a62ef6b-b309-4869-8cad-36498e3d6326 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 204 len: 0 microversion: 2.1 time: 0.168055 Aug 29 10:42:46.407781 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 979/1887] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:46 2022] DELETE /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:46.415235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.416277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:46.427287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.428236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.429585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.430653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.431460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.432749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.441948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e6877507-9736-4495-ac2b-2bc5a8a4f535 could not be found", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:42:46.442931 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] HTTP exception thrown: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Request method failure captured: Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535 HTTP/1.1 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJgDnW8Ua09326wp-QwbGNn5TMo2BtVTFEUqGzl4wXHJv7CzalzJNwCU9cuk0C410GJDzctUeWOrPJmojlMl3aqwDBcqlgbETUNx4hFxIrnIcvaitHpr5GIeQQeC-bP3yQwbaZBZfUeGzRiJ-VGJRO9N7JvhX6owgVdQgiB63IUGdIg Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 77ccd07c62b646b18a2c90369be7b143 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 77ccd07c62b646b18a2c90369be7b143 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsTestJSON-41085768-project Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d47ba4db53554813994df99533746528 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsTestJSON-41085768-project Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: exception: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e6877507-9736-4495-ac2b-2bc5a8a4f535'} Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e6877507-9736-4495-ac2b-2bc5a8a4f535 could not be found Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2ab5b57-98fe-42de-ad07-1e043d4b8392'] Aug 29 10:42:46.448968 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535. Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:46.455981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:46.463687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Returning 404 to user: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:46.464133 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c4e0596-07fa-4a57-aad2-38d38d4700f1 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535" status: 404 len: 111 microversion: 2.1 time: 0.096098 Aug 29 10:42:46.465378 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 909/1888] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:42:46 2022] GET /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:46.473723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1094820-af79-447b-8f11-52764fc7c735 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c72d9e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.791812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:46.807872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:46.811408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:46.815075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16b76c7c-2439-41f4-a76c-f3ffea2aa81e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1844 microversion: 2.42 time: 0.404923 Aug 29 10:42:46.834121 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 980/1889] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:46 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1844 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:46.839172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:46.839920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:46.847931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.848764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.849742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:46.850727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:46.851718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:46.852384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.436662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1094820-af79-447b-8f11-52764fc7c735 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 204 len: 0 microversion: 2.1 time: 0.969819 Aug 29 10:42:47.437662 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 910/1890] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:46 2022] DELETE /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 0 bytes in 972 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:47.445879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Calling method '.version_select at 0x7f66c77ed700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:47.719610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e6877507-9736-4495-ac2b-2bc5a8a4f535 could not be found", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:42:47.720307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] HTTP exception thrown: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Request method failure captured: Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535 HTTP/1.1 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJgDnW8Ua09326wp-QwbGNn5TMo2BtVTFEUqGzl4wXHJv7CzalzJNwCU9cuk0C410GJDzctUeWOrPJmojlMl3aqwDBcqlgbETUNx4hFxIrnIcvaitHpr5GIeQQeC-bP3yQwbaZBZfUeGzRiJ-VGJRO9N7JvhX6owgVdQgiB63IUGdIg Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 77ccd07c62b646b18a2c90369be7b143 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77ccd07c62b646b18a2c90369be7b143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 77ccd07c62b646b18a2c90369be7b143 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsTestJSON-41085768 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsTestJSON-41085768-project Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d47ba4db53554813994df99533746528 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsTestJSON-41085768-project Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: exception: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e6877507-9736-4495-ac2b-2bc5a8a4f535'} Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e6877507-9736-4495-ac2b-2bc5a8a4f535 could not be found Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fb0bea0-3334-4ac1-ae88-5d01570fc45a'] Aug 29 10:42:47.722732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535. Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 Aug 29 10:42:47.727226 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:47.731854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] Returning 404 to user: Floating IP not found for ID e6877507-9736-4495-ac2b-2bc5a8a4f535 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:47.732728 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1af42d9b-f292-43d6-a29b-e01a16671430 tempest-FloatingIPsTestJSON-41085768 tempest-FloatingIPsTestJSON-41085768-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535" status: 404 len: 111 microversion: 2.1 time: 0.290751 Aug 29 10:42:47.738079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 911/1891] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:42:47 2022] DELETE /compute/v2.1/os-floating-ips/e6877507-9736-4495-ac2b-2bc5a8a4f535 => generated 111 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:47.747288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:47.748160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:47.757254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.758090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.758786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.759730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.761178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.761927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.799497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:47.809599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbc9c467-4e08-4c07-8fe4-27e6be06de56 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1508 microversion: 2.1 time: 0.973642 Aug 29 10:42:47.823888 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 981/1892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:46 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1508 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:47.830072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:47.831107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:47.839793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.841532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.842397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.843351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.844377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.847293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.891932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:47.913783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:47.916986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:47.935369 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-39859331-5c89-4a43-b25b-fd5a500028d0 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.191016 Aug 29 10:42:47.938535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 912/1893] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:47 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:47.944301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:47.945375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:47.954949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.956154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.956880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:47.958257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:47.959022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:47.959646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.001123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:48.011590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:48.012803 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-26519ce4-060e-4f1f-82ef-1cf01b0b078b tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1273 microversion: 2.1 time: 0.185822 Aug 29 10:42:48.015070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 982/1894] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:47 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:48.025621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:48.031216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:48.050378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.051686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.053798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.055050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.056552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.058158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.140745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-797dcd7b-d504-4c7e-b7a0-7b2d903bf8f6 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 204 len: 0 microversion: 2.1 time: 0.200495 Aug 29 10:42:48.142728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 913/1895] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:47 2022] DELETE /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:48.149408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:48.150330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:48.158953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.159839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.160491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.162008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.162929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.164930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.199726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:48.320698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db4a5d97-e506-41bc-9eca-073bb8863907 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 204 len: 0 microversion: 2.1 time: 0.176299 Aug 29 10:42:48.321220 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 914/1896] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:48 2022] DELETE /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:48.327504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}, {"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "3753f968-91c5-486f-a765-2dc4bc69f280"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:48.351731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.352837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.355041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.388909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Creating event network-changed:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:42:48.391006 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] Creating event network-changed:3753f968-91c5-486f-a765-2dc4bc69f280 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:42:48.412523 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f1ef8d69-947a-4272-9f20-36074bc9283d req-d57795c4-34a0-497e-bcaf-ea1e18ce0ec3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089434 Aug 29 10:42:48.416242 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 915/1897] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:48.425436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:48.432250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:48.444825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.451547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.452235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.453185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.453945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.454453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.471960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:48.493665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c410e805-b629-459f-a315-fb4eb78b291b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1463 microversion: 2.1 time: 0.469347 Aug 29 10:42:48.495959 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 983/1898] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:48 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1463 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:48.539711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:48.542375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:48.571088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.575932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.576458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:48.577207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:48.577673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:48.578155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:49.295559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:49.307736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:49.320573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:49.322296 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1550a59-567b-486a-9cc7-0cf26ed02af0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1844 microversion: 2.42 time: 0.903190 Aug 29 10:42:49.323214 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 916/1899] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:48 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1844 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:49.355171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:49.390771 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4f37a89-efd9-4790-8ab2-64dddfece411 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1484 microversion: 2.1 time: 0.883990 Aug 29 10:42:49.391378 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 984/1900] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:48 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1484 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:49.404535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-479259882", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "f0e277bb-7983-4d32-9041-e842f755bb17"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:49.534551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] validate_networks() for [('f0e277bb-7983-4d32-9041-e842f755bb17', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:42:49.593506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:49.594758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:49.614107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:49.614862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:49.615494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:49.616404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:49.617213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:49.617862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.354100 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-365efaa5-e9f8-43d6-bb1b-be4ec70ca908 tempest-MigrationsAdminTest-1804262607 tempest-MigrationsAdminTest-1804262607-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1616 microversion: 2.1 time: 1.029749 Aug 29 10:42:50.358393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 917/1901] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:49 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1616 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:50.380000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:50.381143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:50.397136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.397930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.398478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.399366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.400042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.401108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.426230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:50.439487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.446455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.447183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.451095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lazy-loading 'fault' on Instance uuid 8a330a56-f2f3-4471-91b5-86c3e850bc85 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:42:50.681457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:50.696019 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee2cf77d-6ed7-4467-99d0-aa82b3ba1712 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 200 len: 1312 microversion: 2.1 time: 0.336481 Aug 29 10:42:50.711881 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 918/1902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:50 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:50.728857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a330a56-f2f3-4471-91b5-86c3e850bc85", "name": "network-vif-deleted", "tag": "e772144e-bb4b-4a8d-849f-bbcf151239c4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:50.772003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.772768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.773216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.804681 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] Creating event network-vif-deleted:e772144e-bb4b-4a8d-849f-bbcf151239c4 for instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 on n-h1-854121-10 Aug 29 10:42:50.820028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dfcff5d9-4ca4-48e2-b6c9-634fb2702dc7 req-1b7e19a9-b5d5-4fe8-8987-d9b46b318ccf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106765 Aug 29 10:42:50.820653 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 919/1903] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:50.833902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:50.834602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:50.853619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.854146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.854582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:50.855503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:50.856765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:50.860333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:51.127229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:51.135650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:51.137115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:51.152794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6f2cbda-46d7-4160-955e-f87a6af54991 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.327179 Aug 29 10:42:51.153573 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 920/1904] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:50 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:51.170042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:51.170958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:51.177242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:51.179871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:51.180498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:51.186732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:51.187217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:51.187654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:51.954281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:42:51.955329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:42:51.956068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:42:51.956724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:42:51.957393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:42:51.979128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:51.979983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:51.981336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:51.982442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:51.984325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:51.988015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.023068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:42:52.057392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for user e2bcddcae75e410786962c142abebf34 and project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:42:52.080464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:42:52.082868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:42:52.100383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:52.114324 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54403e47-1acd-46b7-934e-d130b85c6f69 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.956046 Aug 29 10:42:52.132263 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 921/1905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:51 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:52.149943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4c690b-cc07-4f8c-b5df-e84a85777ac2", "name": "network-vif-unplugged", "status": "completed", "tag": "ab426510-178d-4751-b183-9927d1cfe590"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:52.188051 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad48c860-bee6-4775-95ee-b8af7fb18650 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.795581 Aug 29 10:42:52.189353 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 985/1906] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:42:52.198236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.203483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.205634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.206193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:52.206819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:52.223361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.226396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.227075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.227985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.234446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.236399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.251049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:52.257022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] Creating event network-vif-unplugged:ab426510-178d-4751-b183-9927d1cfe590 for instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 on n-h1-854121-10 Aug 29 10:42:52.291587 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e669b78b-ebce-4eaf-94a1-91fa89f37ea0 req-e37a529a-2946-4769-9187-8b743ddf7c5f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157914 Aug 29 10:42:52.298924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 922/1907] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:52.316998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:52.317609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:52.355711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.357933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.358375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.359362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.359552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.365254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.436048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:52.602928 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5d39bbb-7758-43e8-95b2-f11bb233299b tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 204 len: 0 microversion: 2.1 time: 0.302355 Aug 29 10:42:52.607962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 923/1908] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:52 2022] DELETE /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:52.614851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:52.615864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:52.629050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.630221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.630883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.632092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.632710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.633344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.673482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.674099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.674640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.674981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lazy-loading 'fault' on Instance uuid 660f8d07-1d21-44ca-a221-6846d139878e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:42:52.849809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:52.864862 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a8f858e-bcc6-42de-8522-32db11d2e018 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 200 len: 1300 microversion: 2.1 time: 0.255029 Aug 29 10:42:52.866277 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 924/1909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:52 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 1300 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:52.874500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "bd598a4e-a61e-46b1-930c-4d59792d1dcb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:52.905986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.906568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.907074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.958416 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] Creating event network-changed:bd598a4e-a61e-46b1-930c-4d59792d1dcb for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:42:52.967806 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2fd58829-b2bf-472b-ab5b-5b6c1820027c req-781cc468-71fb-404b-a829-f4768c7eb9e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098148 Aug 29 10:42:52.968370 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 925/1910] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:52.979500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:52.988012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 8a330a56-f2f3-4471-91b5-86c3e850bc85] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:52.994500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.995018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.995459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:52.996694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:52.997159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:52.997578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.012351 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 HTTP/1.1 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '8a330a56-f2f3-4471-91b5-86c3e850bc85'} Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:53.014176 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 404 to user: Instance 8a330a56-f2f3-4471-91b5-86c3e850bc85 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:53.022014 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64056317-4b60-4597-9ed5-05e7777f3e93 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85" status: 404 len: 111 microversion: 2.1 time: 0.046057 Aug 29 10:42:53.028480 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 926/1911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:52 2022] GET /compute/v2.1/servers/8a330a56-f2f3-4471-91b5-86c3e850bc85 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:53.033666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:53.036080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:53.052132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.052645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.053084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.053813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.054448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.055036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.263889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.280674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.282154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.287368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b050bc9-1e07-4700-8e48-fe839c0c6c63 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.257745 Aug 29 10:42:53.288145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 927/1912] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:53 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:53.292604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:53.293285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:53.299160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.299634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.300063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.300777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.301416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.301870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.440501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.451675 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-afb9075a-944d-4db3-9f62-a368910d3db9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1211 microversion: 2.1 time: 0.161582 Aug 29 10:42:53.453147 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 928/1913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:53 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1211 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:53.459553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:53.460596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:53.474110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.484374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.486338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.486975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.487632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.488778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.491180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:53.492784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.493111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b83acdf-d571-4330-b983-a879b492c77b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1865 microversion: 2.42 time: 1.302340 Aug 29 10:42:53.494015 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 986/1914] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:52 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1865 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:53.505955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.519106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660f8d07-1d21-44ca-a221-6846d139878e", "name": "network-vif-deleted", "tag": "39e1e053-2d0d-46aa-826d-dd550c63c13d"}, {"server_uuid": "7e4c690b-cc07-4f8c-b5df-e84a85777ac2", "name": "network-vif-deleted", "tag": "ab426510-178d-4751-b183-9927d1cfe590"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:53.534187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.534948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.535619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.575665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Creating event network-vif-deleted:39e1e053-2d0d-46aa-826d-dd550c63c13d for instance 660f8d07-1d21-44ca-a221-6846d139878e on n-h1-854121-10 Aug 29 10:42:53.576722 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] Creating event network-vif-deleted:ab426510-178d-4751-b183-9927d1cfe590 for instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 on n-h1-854121-10 Aug 29 10:42:53.595463 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-079393f4-d670-4454-bacb-db1e8c783466 req-fb1c05fa-ee3c-4571-af94-f24707730901 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083744 Aug 29 10:42:53.596751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 987/1915] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:53.607422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:53.608394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:53.615713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.617383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.618218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.624367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.625061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.626030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.675085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:53.818815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:53.865755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:53.914729 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2268c967-f5e2-4ec4-9634-c96fb69d73ac tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 204 len: 0 microversion: 2.1 time: 0.315848 Aug 29 10:42:53.915805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 988/1916] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:53 2022] DELETE /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:53.936306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:53.937330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:53.946226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.947095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.948058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:53.950018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:53.950720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:53.951367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.119945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.138882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ecc3693d-07fd-440a-b564-afda27139b2c tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1469 microversion: 2.1 time: 0.683720 Aug 29 10:42:54.151023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 929/1917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:53 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1469 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:54.156772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.157634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: 660f8d07-1d21-44ca-a221-6846d139878e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.168570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.169243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.169926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.170749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.171349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.171912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.188690 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] HTTP exception thrown: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Request method failure captured: Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e HTTP/1.1 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJaGCA-usGkbUN2e2KONV5_M--45Y-SH_Fxa9cGI6EWGAzMxvJjnCz17OduVFufy6-aUWUiFG7o8CudstobkDl9sEsZzSwvezwmQqTMqxFheNF2vj_nvzcJ6qI0AadJnbWHtQt9ml7R75Hd5F6arEk6JANpMcq_zanRNgPR6A_yqCok Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af9408db02324de389c1364747169f4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af9408db02324de389c1364747169f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 30e7715efc824e0d9dc68fc5eb4b398b Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '660f8d07-1d21-44ca-a221-6846d139878e'} Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:54.191095 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Returning 404 to user: Instance 660f8d07-1d21-44ca-a221-6846d139878e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:54.196703 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-273f34d8-eca9-4f4b-bcae-8694ea8659c9 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e" status: 404 len: 111 microversion: 2.1 time: 0.041384 Aug 29 10:42:54.199074 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 930/1918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:54 2022] GET /compute/v2.1/servers/660f8d07-1d21-44ca-a221-6846d139878e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:54.205275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.206727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.212870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.213565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.214329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.215968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.216454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.216887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.524677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.541787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9a67724b-c7ac-4a4d-a620-65b41e0bf22d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.624579 Aug 29 10:42:54.546773 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 989/1919] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:53 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:54.552256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.553091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.561002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.561989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.563014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.564950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.565739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.566395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.599083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:54.688869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c3cccef-def6-47e8-b996-8c6e20ccf3e1 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 204 len: 0 microversion: 2.1 time: 0.140695 Aug 29 10:42:54.697457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 990/1920] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:54 2022] DELETE /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:42:54.703565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-plugged", "status": "completed", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:54.713199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.713940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.714383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.726169 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] Creating event network-vif-plugged:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:42:54.732040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-188d80cc-de85-49a5-a955-625cc6866902 req-d2b107b4-b981-4fee-9f3e-5725d1a25f34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Aug 29 10:42:54.733226 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 991/1921] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:54.738725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.739135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.745401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.745855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.746535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.747299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.747709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.748437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.850281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.859747 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-212885f2-ada3-42f1-b580-9d928c01850c tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.658889 Aug 29 10:42:54.860324 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 931/1922] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:54 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:54.866220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.867017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.878097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.879301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.879781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.880671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.881257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.881720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.927245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.937429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.938929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:54.946091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b356b22-2d0b-4958-b8c3-b302b98be475 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.212242 Aug 29 10:42:54.954294 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 992/1923] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:54 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:54.964219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:54.965406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:54.972963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.973855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.974311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:54.976786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:54.976786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:54.976786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:55.034313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:55.043712 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdf29e62-aa1f-44e1-ac65-2a6ed706d1ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1259 microversion: 2.1 time: 0.181878 Aug 29 10:42:55.044788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 932/1924] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:54 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:55.050277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:55.051353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:55.063204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:55.063802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:55.064349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:55.065264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:55.066079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:55.066769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.037537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.048026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.052233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.054746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-081a40bc-acc2-43f6-bb18-3426a9839f36 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1886 microversion: 2.42 time: 1.096607 Aug 29 10:42:56.055818 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 993/1925] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:54 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1886 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:56.061801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b36e89-876f-4259-9edf-9b8fad86009e", "tag": "14a30729-9640-4767-ab4d-b3b9a76fbcc1"}, {"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "844cad02-b496-4a09-975b-2dc20d4c7f00"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:56.072649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.077076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.077523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.103397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Creating event network-changed:14a30729-9640-4767-ab4d-b3b9a76fbcc1 for instance b7b36e89-876f-4259-9edf-9b8fad86009e on n-h2-854121-10 Aug 29 10:42:56.104508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] Creating event network-changed:844cad02-b496-4a09-975b-2dc20d4c7f00 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:42:56.129557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c094b207-5ad1-4c51-8766-af71fc29b6a8 req-5e8d8a1e-3fe4-4e54-be0f-6ef6058df95b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069879 Aug 29 10:42:56.130390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 994/1926] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:56.137463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:56.138250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:56.145657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.146615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.147148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.148045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.148599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.149124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.151658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30e7715efc824e0d9dc68fc5eb4b398b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9408db02324de389c1364747169f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.162774 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e6c8596-be02-4c41-a8a9-817b47bc062e tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 200 len: 1500 microversion: 2.1 time: 1.116346 Aug 29 10:42:56.163617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 933/1927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:55 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 1500 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:56.170128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:56.177946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:56.200578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.201390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.202074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.202979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.203667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.204284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.830504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.855289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c23ac4d-2b9b-43df-b3ae-76c0b3e26941 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1469 microversion: 2.1 time: 0.723312 Aug 29 10:42:56.857239 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 995/1928] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:56 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:56.859849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:56.865633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:56.866894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:56.875074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.875929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.876806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.877966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.878980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.879423 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96208deb-384f-44b9-b8aa-e7ddd9d27643 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.707037 Aug 29 10:42:56.880358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.880751 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 934/1929] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:56 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:56.886177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:56.888067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:56.894930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.895830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.896523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:56.897479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:56.898205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:56.899633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.039660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.049350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.050806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.056150 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c024fec0-bab4-421d-9e14-7b190450ff9c tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1447 microversion: 2.75 time: 0.174118 Aug 29 10:42:57.056964 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 935/1930] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:56 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:57.061940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04c361b-6a45-4aa2-8151-d50603f0f59c", "name": "network-vif-deleted", "tag": "faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:57.073005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.074759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.075195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.078101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:57.089079 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] Creating event network-vif-deleted:faa6a7b8-12a3-43b9-8f9e-d45bc1b5f074 for instance c04c361b-6a45-4aa2-8151-d50603f0f59c on n-h2-854121-10 Aug 29 10:42:57.094757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1b1fa749-6f51-40c6-8599-21f56e2cdd19 req-b8e4f4d7-f7b7-489a-a7c2-3bcbfee03600 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036591 Aug 29 10:42:57.095318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 936/1931] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:57.101634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:57.102557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:57.110637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.111478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.111948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.112665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.113255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.113931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.213157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.227128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-92004807-cfdb-4ea7-b9b4-7a28cdd5d252 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1259 microversion: 2.1 time: 0.130290 Aug 29 10:42:57.244199 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 937/1932] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:57 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:57.250396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:57.251230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:57.261242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.263322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.264166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.265279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.265940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.266664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.279837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.289918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d958e8e9-e5ba-411d-a349-a10ce989214e tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1523 microversion: 2.1 time: 0.431154 Aug 29 10:42:57.291169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 996/1933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:56 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:57.297083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:57.298015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] [instance: c04c361b-6a45-4aa2-8151-d50603f0f59c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:57.311435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.312319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.313569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.314559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.315230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.319950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.356604 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] HTTP exception thrown: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Request method failure captured: Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c HTTP/1.1 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJaGCA-usGkbUN2e2KONV5_M--45Y-SH_Fxa9cGI6EWGAzMxvJjnCz17OduVFufy6-aUWUiFG7o8CudstobkDl9sEsZzSwvezwmQqTMqxFheNF2vj_nvzcJ6qI0AadJnbWHtQt9ml7R75Hd5F6arEk6JANpMcq_zanRNgPR6A_yqCok Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_af9408db02324de389c1364747169f4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/af9408db02324de389c1364747169f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/af9408db02324de389c1364747169f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: af9408db02324de389c1364747169f4e Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-LiveMigrationTest-1118533246 Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 30e7715efc824e0d9dc68fc5eb4b398b Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-LiveMigrationTest-1118533246-project Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c04c361b-6a45-4aa2-8151-d50603f0f59c'} Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:57.358563 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. Aug 29 10:42:57.367786 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:57.370060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] Returning 404 to user: Instance c04c361b-6a45-4aa2-8151-d50603f0f59c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:57.373369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a31fcc72-240c-4a43-b197-a72382d4fb82 tempest-LiveMigrationTest-1118533246 tempest-LiveMigrationTest-1118533246-project] 10.222.0.47 "GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c" status: 404 len: 111 microversion: 2.1 time: 0.078132 Aug 29 10:42:57.374955 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 997/1934] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:57 2022] GET /compute/v2.1/servers/c04c361b-6a45-4aa2-8151-d50603f0f59c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:57.732576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.750953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.753599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:57.756896 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64d78ff4-59ac-4e09-b9c5-e7592067206f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.511314 Aug 29 10:42:57.759667 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 938/1935] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:57 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:57.877986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:57.878614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:57.898195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.899261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.899975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.901168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.901943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.902669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.912216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:57.912834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:57.924995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:57.926531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.927024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.927463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.928170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.928624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.929049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.977533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:57.978080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:57.978501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:57.979134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lazy-loading 'fault' on Instance uuid 5f23dd77-2895-4387-a1a4-6a77eaf89de0 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:42:58.118635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.132481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2333782e-33f0-488a-9208-d45375ea07c3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 200 len: 1303 microversion: 2.1 time: 0.258965 Aug 29 10:42:58.134251 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 998/1936] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:57 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:42:58.140370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:58.141414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:58.148984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.151128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.151871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.153619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.154381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.155710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.320641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.336815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.338315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.345182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1bac9e6-32d1-4a5a-a429-4799889af466 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1453 microversion: 2.75 time: 0.209297 Aug 29 10:42:58.345984 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 999/1937] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:58 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:58.351946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23dd77-2895-4387-a1a4-6a77eaf89de0", "name": "network-vif-deleted", "tag": "b4b62083-5766-40f9-8087-09bbd3828f7e"}, {"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "79dfe7f0-b18b-4f2f-8bef-721aec20fe1e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:58.358707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.364392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.365496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.367441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.373667 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a152e377-d74e-4a7a-9246-d890a80ad622 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.464958 Aug 29 10:42:58.374099 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 939/1938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:57 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:42:58.378545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:58.379142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:58.400020 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Creating event network-vif-deleted:b4b62083-5766-40f9-8087-09bbd3828f7e for instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 on n-h2-854121-10 Aug 29 10:42:58.400665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] Creating event network-changed:79dfe7f0-b18b-4f2f-8bef-721aec20fe1e for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:42:58.401219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.402825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.405095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.408391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.410528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.412115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.445579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0dafd2f0-bb99-4db8-b3f9-d6f956989be5 req-808d16d0-6328-43de-9a61-6e09fe3435c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098072 Aug 29 10:42:58.446927 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1000/1939] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:58.455903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:58.460280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:58.472094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.472996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.473823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.486796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.487331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.488360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.695256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.704167 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f06f10e-a66d-4022-8604-bc1f1d8e2588 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1267 microversion: 2.1 time: 0.328926 Aug 29 10:42:58.766393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 940/1940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:58 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:58.768534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78cba28ccfd244dba6e46f23d7ef35f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be9d74a565a43c5987663c472a656ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:58.768534 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10ed7591-4497-4859-80a1-5b7de9452e37 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 200 len: 1481 microversion: 2.1 time: 0.320147 Aug 29 10:42:58.787352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:58.788448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1001/1941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:58 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 1481 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:42:58.788712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:58.800362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.806789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.808896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:58.818262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:58.818889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:58.819410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.137541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d50327c-ed07-477a-aec6-424b7178f0b4", "name": "network-vif-deleted", "tag": "75155c6a-0909-4a71-b9ab-a56eef4cd231"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:42:59.156746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:59.171966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.172467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.172914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.192132 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] Creating event network-vif-deleted:75155c6a-0909-4a71-b9ab-a56eef4cd231 for instance 3d50327c-ed07-477a-aec6-424b7178f0b4 on n-h1-854121-10 Aug 29 10:42:59.200514 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d7882b51-248d-4f61-b939-cd8566d93cb0 req-355daaa4-6baa-48f0-bd3d-58c38fd2cc49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079433 Aug 29 10:42:59.201148 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1002/1942] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:42:59.206763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:59.207404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 5f23dd77-2895-4387-a1a4-6a77eaf89de0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:59.214653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.215337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.215921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.216829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.217431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.218033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.223746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:42:59.238896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] HTTP exception thrown: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Request method failure captured: Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 HTTP/1.1 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbW4ATcydTu4hCqup4SagAH9e0qsjCmAvht9hErBhp4HQzJB7q9bFY7RG-OLQyne326cU9XE7ev5pL6NKnWTAprXTNJEHJlZ0-vrs31TzeU8E60aAvcBb_U7CGgZMqdiDwQCjx9eTvup4BgIsU8hgXfNocLVtj__-Zjp8Q-ox9UirA Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_901105749eb4402d9a630487d32d7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-MigrationsAdminTest-2110745247 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 356590f9c0644b3695c6b3f321dd1275 Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '5f23dd77-2895-4387-a1a4-6a77eaf89de0'} Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:42:59.241030 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Returning 404 to user: Instance 5f23dd77-2895-4387-a1a4-6a77eaf89de0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63e481f1-a58a-4be2-91de-ccb6a0318b16 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0" status: 404 len: 111 microversion: 2.1 time: 0.040168 Aug 29 10:42:59.245177 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1003/1943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:59 2022] GET /compute/v2.1/servers/5f23dd77-2895-4387-a1a4-6a77eaf89de0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:42:59.252743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:59.253607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:59.263934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.264591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.265504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.266500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.267808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.268470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.300776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:42:59.431036 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2268e330-d149-4c5d-a585-9ba4626c943a tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 204 len: 0 microversion: 2.1 time: 0.169288 Aug 29 10:42:59.435342 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1004/1944] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:42:59 2022] DELETE /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:42:59.443832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:59.446457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:59.454371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.455150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.467861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.468959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.470656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.471852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.815167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:59.827882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:59.829423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:42:59.843815 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-361f992f-95f7-4201-b31c-e31b07f0c0c4 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1453 microversion: 2.75 time: 0.406764 Aug 29 10:42:59.844386 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1005/1945] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:59 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1453 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:42:59.862576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:42:59.862576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:42:59.868762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.869626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.869948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.870869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:42:59.872243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:42:59.873091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:42:59.962594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.015326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.022357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.030667 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c098e18e-fc50-40c8-aba0-3b5065943b32 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 1.243963 Aug 29 10:43:00.034091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 941/1946] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:42:58 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:00.050824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:00.052686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:00.085007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.085463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.103820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.104672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.105251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.105951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.300315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.318417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-710e20ee-9133-4644-baf4-74573ac7a82e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.472931 Aug 29 10:43:00.319025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1006/1947] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:42:59 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:00.324501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:00.325118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:00.335458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.336122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.336725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.337658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.338283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.338866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.574189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.589144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01dad7c5-60d7-45a0-a92d-40a8b2b9ea27 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1265 microversion: 2.1 time: 0.269006 Aug 29 10:43:00.605978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1007/1948] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:00 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:00.609977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:00.610608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] [instance: 3d50327c-ed07-477a-aec6-424b7178f0b4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:00.617395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.617931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.618376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.625376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.626047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.626642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.649107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] HTTP exception thrown: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Request method failure captured: Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 HTTP/1.1 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbVBwrZC56kzNcBnsRFu2_8mwpbSjTOxxrsQxvCytZXbEM5qYQLfea2zQieMWWNIUpPE4L05cK4TbY5recXGDFolXXPPxRgEV3TL_jiUkkIEah3zm77ZNUqIQdKhPUYJQ8x9wHj9-ErCrZ7tiei3zY0uaEXGaj32PeOM6-nAXPEmIA Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0be9d74a565a43c5987663c472a656ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0be9d74a565a43c5987663c472a656ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0be9d74a565a43c5987663c472a656ec Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1054068989 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 78cba28ccfd244dba6e46f23d7ef35f4 Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1054068989-project Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3d50327c-ed07-477a-aec6-424b7178f0b4'} Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:00.657160 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. Aug 29 10:43:00.660413 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:00.661468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] Returning 404 to user: Instance 3d50327c-ed07-477a-aec6-424b7178f0b4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:00.662187 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e6368dbc-d0a0-4fe8-995c-255bcb220560 tempest-ServerRescueNegativeTestJSON-1054068989 tempest-ServerRescueNegativeTestJSON-1054068989-project] 10.222.0.47 "GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4" status: 404 len: 111 microversion: 2.1 time: 0.056683 Aug 29 10:43:00.666574 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1008/1949] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:00 2022] GET /compute/v2.1/servers/3d50327c-ed07-477a-aec6-424b7178f0b4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:00.795544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:00.814468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10445c39-ea38-4441-b2a2-5aea8f3d0dbf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1534 microversion: 2.1 time: 0.778909 Aug 29 10:43:00.815376 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 942/1950] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:00 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1534 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:00.871378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:00.872235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:00.888182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.888698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.889147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:00.889907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:00.890377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:00.890812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.057124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.058673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:01.059293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:01.065420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.066278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.066925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.067117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.068028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.068687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.069225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.069688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.076891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-71025ddf-95c9-4b2d-8016-4e13976f15e6 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1438 microversion: 2.75 time: 0.210234 Aug 29 10:43:01.078157 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1009/1951] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:00 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1438 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:01.360856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:01.364195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:01.371583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.372102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.372506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.373402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.374046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.374668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.467145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:01.467571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:01.468066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:01.468556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:01.468972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:01.554033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:01.563161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.564469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.565079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.566109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.566824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.567532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.672396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.693438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.697902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:01.701995 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-411c1cc4-ccdb-4bff-a4ef-32faf1076344 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.647266 Aug 29 10:43:01.704587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 943/1952] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:01 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:01.712711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:01.713575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:01.736796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.738827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.739637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.741964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.742582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.744261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.847444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:01.893371 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-500a56f1-05ad-40a8-9b82-33cdd469e83c tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c/action" status: 202 len: 1944 microversion: 2.75 time: 0.792808 Aug 29 10:43:01.896168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1010/1953] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:43:01 2022] POST /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c/action => generated 1944 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 29 10:43:01.907319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "fbc86598-a800-4c5e-94bc-23e2c82e3e23"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:01.922346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.923252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.923875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.938907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] Creating event network-changed:fbc86598-a800-4c5e-94bc-23e2c82e3e23 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:01.944378 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8c785470-2e0e-404f-8ac6-f9991fac2e90 req-12359298-c88b-410f-8143-444dfbccc5b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045749 Aug 29 10:43:01.945851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1011/1954] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:01.953214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:01.954716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:01.968068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.969627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.970401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:01.971455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:01.972176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:01.972823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:02.035138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:02.065297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:02.648304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:02.666049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ffc81ba-6b45-46f4-924c-f82ccd2972a8 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.959091 Aug 29 10:43:02.667283 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 944/1955] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:01 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:02.689722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:02.690777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:02.699704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:02.700748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:02.701592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:02.705222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:02.706158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:02.706739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:02.814067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:02.814735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:02.817460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:02.819365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lazy-loading 'fault' on Instance uuid f2c5bb1c-e73a-44cd-8074-9a6e660f429e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:02.985089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:03.008036 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c936025c-ea86-4e41-be68-dd50e83b90e4 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 200 len: 1369 microversion: 2.1 time: 0.330137 Aug 29 10:43:03.008830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 945/1956] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:02 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 1369 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:03.014317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:03.015031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:03.033618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.034274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.034920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.035632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.036081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.036504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.046276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:03.055541 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-841f4324-1b8c-47f9-87be-3a1c326aa029 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 1.108101 Aug 29 10:43:03.057390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1012/1957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:01 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:03.082828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:03.083506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:03.098484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.099063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.099514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.100230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.102410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.102855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.394864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:03.426583 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0ebdd38-9cf7-4873-8ba5-dee9397a821d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.416498 Aug 29 10:43:03.464936 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 946/1958] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:03 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:03.486839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b36e89-876f-4259-9edf-9b8fad86009e", "name": "network-vif-plugged", "status": "completed", "tag": "14a30729-9640-4767-ab4d-b3b9a76fbcc1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:03.521890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.523232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.524477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.560557 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] Creating event network-vif-plugged:14a30729-9640-4767-ab4d-b3b9a76fbcc1 for instance b7b36e89-876f-4259-9edf-9b8fad86009e on n-h2-854121-10 Aug 29 10:43:03.577829 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-cd9564df-c3d1-4dd2-8d8c-3707f6e45e40 req-f43dbeac-b5e9-446b-9622-83a254e08c50 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110297 Aug 29 10:43:03.584320 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 947/1959] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:03.693450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:03.694762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:03.707409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.707960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.710921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.713258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:03.713932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:03.717619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:03.899766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:03.915857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:03.918289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:03.919995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bc3f33a3-4ba7-41e0-970d-4fc9f7238590 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.846618 Aug 29 10:43:03.920812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1013/1960] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:03 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:04.030276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:04.031520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: f2c5bb1c-e73a-44cd-8074-9a6e660f429e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:04.045625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.046186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.046643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.047388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.047851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.048281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.066763 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] HTTP exception thrown: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Request method failure captured: Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e HTTP/1.1 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbW4ATcydTu4hCqup4SagAH9e0qsjCmAvht9hErBhp4HQzJB7q9bFY7RG-OLQyne326cU9XE7ev5pL6NKnWTAprXTNJEHJlZ0-vrs31TzeU8E60aAvcBb_U7CGgZMqdiDwQCjx9eTvup4BgIsU8hgXfNocLVtj__-Zjp8Q-ox9UirA Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_901105749eb4402d9a630487d32d7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 356590f9c0644b3695c6b3f321dd1275 Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f2c5bb1c-e73a-44cd-8074-9a6e660f429e'} Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:04.068436 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Returning 404 to user: Instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:04.072371 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-168254b2-6d3f-4c3d-b0d5-b9332827ec4f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e" status: 404 len: 111 microversion: 2.1 time: 0.044933 Aug 29 10:43:04.074619 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1014/1961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:04 2022] GET /compute/v2.1/servers/f2c5bb1c-e73a-44cd-8074-9a6e660f429e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:04.079597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "caace4f8-4013-4946-9b42-fa03ce69a6f1"}, {"server_uuid": "f2c5bb1c-e73a-44cd-8074-9a6e660f429e", "name": "network-vif-deleted", "tag": "8f65ede1-5140-442a-8161-258ffb215bfe"}, {"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "4b8184d7-704a-44a6-b5c7-d657900817c6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:04.118607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.119282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.122495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.139663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Creating event network-changed:caace4f8-4013-4946-9b42-fa03ce69a6f1 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:04.140429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Creating event network-vif-deleted:8f65ede1-5140-442a-8161-258ffb215bfe for instance f2c5bb1c-e73a-44cd-8074-9a6e660f429e on n-h2-854121-10 Aug 29 10:43:04.141106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] Creating event network-changed:4b8184d7-704a-44a6-b5c7-d657900817c6 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:04.150581 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-00fd4ded-0b78-431d-8f7c-1c95e2219ab7 req-4b839c5c-2468-4459-85c9-d01be80f61d6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.074476 Aug 29 10:43:04.152538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1015/1962] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:04.169592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-044e0f9a-5550-4091-92d3-a0b15258c2b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '.version_select at 0x7f66cafff670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:04.200975 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-044e0f9a-5550-4091-92d3-a0b15258c2b9 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424024772" status: 202 len: 0 microversion: 2.1 time: 0.038099 Aug 29 10:43:04.205415 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1016/1963] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424024772 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:43:04.210660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:04.211702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:04.220115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.220758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.221320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.222180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.222921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.223418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.361980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:04.372463 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdaddc0b-f902-455c-ae8e-201f412ade5d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1315 microversion: 2.1 time: 0.684451 Aug 29 10:43:04.373337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 948/1964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:03 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:04.455966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:04.456698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:04.463392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.465514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.466126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.466943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.467671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.468105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.644816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:04.674706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-334369bb-7426-4469-9fc4-82de5b19ff95 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.222889 Aug 29 10:43:04.675295 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 949/1965] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:04 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:04.696667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:04.707272 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a22d128-4cdd-44d2-ab8d-fd97c4e2a433 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 0.500509 Aug 29 10:43:04.707952 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1017/1966] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:04 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:04.944155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:04.944789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:04.963278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.963759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.965817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:04.966657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:04.967266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:04.967865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:05.393837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:05.394455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:05.401151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:05.402422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:05.403012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:05.404054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:05.404663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:05.405233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:05.441686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:05.451563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:05.453693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:05.455582 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-09dd194c-4ffa-4619-ae95-ed5d4f1450a1 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.515703 Aug 29 10:43:05.456411 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 950/1967] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:04 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:05.682361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d893f51a-b42d-4a2b-8b42-3dbdbd98cf81", "tag": "11aab3cc-bb00-494c-b28e-668948b08f8c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:05.706020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:05.706905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:05.708066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:05.738026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] Creating event network-changed:11aab3cc-bb00-494c-b28e-668948b08f8c for instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 on n-h1-854121-10 Aug 29 10:43:05.749735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-04ea4c47-0480-487d-ba5d-ededbb60d2cd req-5ba60045-d936-427c-85bc-09b1c0aac032 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070297 Aug 29 10:43:05.751295 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 951/1968] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:43:05.765815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:05.767569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:05.778788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:05.782478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:05.784003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:05.786638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:05.787116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:05.788449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.249324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:06.255349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:06.257437 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d23a8592-00f7-4602-bd60-245140debf78 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1504 microversion: 2.1 time: 0.867628 Aug 29 10:43:06.265425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1018/1969] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:05 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1504 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:06.272261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:06.275568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:06.297877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.298530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.299141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.299991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.300585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.301149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.302164 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f6256f3-43b7-423a-ad59-0ce07305f214 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.548925 Aug 29 10:43:06.307349 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 952/1970] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:05 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:06.335113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:06.339735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:06.357064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.358302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.358870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.359712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.361483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.362064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.400055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:06.437195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:06.439993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b0df758-072c-4004-942a-c12956793e7a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/os-instance-actions/req-89177771-c41f-4b20-b81e-811e96a5361f" status: 200 len: 313 microversion: 2.1 time: 0.117921 Aug 29 10:43:06.448279 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 953/1971] 10.222.0.47 () {58 vars in 1419 bytes} [Mon Aug 29 10:43:06 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/os-instance-actions/req-89177771-c41f-4b20-b81e-811e96a5361f => generated 313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:06.457076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:06.460397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:06.469485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.470210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.470822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.471843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.472437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.472999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.572905 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54446c39-c190-4035-9e38-d7963dfbbb4c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "POST /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/action" status: 202 len: 0 microversion: 2.1 time: 0.119500 Aug 29 10:43:06.575431 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 954/1972] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:43:06 2022] POST /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:43:06.585981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:06.587589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:06.603501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.604306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.606424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.607342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:06.609456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:06.610126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:06.992667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:06.997934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:07.007122 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-29eab986-7512-4457-a4d1-d0473088239d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 0.739658 Aug 29 10:43:07.023411 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1019/1973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:06 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:07.031874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:07.032670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:07.043045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.044017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.044728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.046496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.047877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.048506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.283246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:07.321371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:07.332922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:07.335819 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f04d1634-90fa-458e-b788-2949298dc2ad tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.758352 Aug 29 10:43:07.340385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 955/1974] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:06 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:07.358176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:07.358687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:07.371677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.374013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.374554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.376555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.377107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.377875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.418670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:43:07.525864 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1254a8a5-6f57-403e-b0b1-268313ba32ba tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 204 len: 0 microversion: 2.1 time: 0.183968 Aug 29 10:43:07.530437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 956/1975] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:43:07 2022] DELETE /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:43:07.536291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:07.537249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:07.545999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.546636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.547088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.548501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.549981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.549981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.576106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:07.595783 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a5ce0466-7fad-467f-8c46-bd0c33ca386c tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1506 microversion: 2.1 time: 0.569115 Aug 29 10:43:07.596858 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1020/1976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:07 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:07.618454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:07.619085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:07.639520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.640500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.641159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.658877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:07.662027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:07.662678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:07.706470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:07.731637 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f68c85d-5711-42f5-bf38-61c1014269d8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.200632 Aug 29 10:43:07.740708 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 957/1977] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:07 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:07.931284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:07.946511 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ed0dc51-c064-48db-931e-8a7cf5ff3d1f tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1466 microversion: 2.1 time: 0.347970 Aug 29 10:43:07.947439 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1021/1978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:07 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1466 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:08.029681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:08.030785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:08.043860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.044680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.046561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.048521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.049513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.050536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.367708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:08.368332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:08.381585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.382149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.382589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.383297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.383925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.384498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.457751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:08.467960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b2fa0ddf-c9a5-4b04-938e-9f50ba588ef6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 0.443093 Aug 29 10:43:08.472324 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 958/1979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:08 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:08.618714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:08.619327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:08.629101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.629598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.639908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.640884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:08.642247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:08.644084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:08.977906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:08.999925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:09.001629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:09.003046 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be85a5b2-3848-4c5f-b142-0c4a0f23d4d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.640114 Aug 29 10:43:09.003700 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1022/1980] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:08 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:09.010167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:09.011174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:09.026010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.027607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.029050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:09.030064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.030671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.031247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:09.209352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:09.221002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7089a96-1979-4e07-a0e2-1fe72f4ed66d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1506 microversion: 2.1 time: 0.606038 Aug 29 10:43:09.223532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 959/1981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:08 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:09.229286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:09.244110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:09.247326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:09.275152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.276600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.278269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:09.286716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.287202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.287758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:09.306710 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4494325-ef47-42c6-8f89-bd58615cbab9 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.301758 Aug 29 10:43:09.307315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1023/1982] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:09 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:09.495460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:09.499746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:09.511465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.512172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.512817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:09.514366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:09.515086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:09.516421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:10.471610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:10.483014 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-63cb74fb-669b-4912-bf8f-5b4427ef0bcf tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1466 microversion: 2.1 time: 1.258159 Aug 29 10:43:10.501469 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 960/1983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:09 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1466 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:10.508782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:10.509667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:10.517257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:10.517899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:10.518418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:10.519219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:10.519758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:10.520265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:10.557625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:10.575937 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc173313-6589-492c-9222-3d2ca9d559dc tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 1.085784 Aug 29 10:43:10.576552 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1024/1984] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:09 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:10.592436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:10.593152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:10.606653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:10.607454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:10.608102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:10.609108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:10.609782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:10.610656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.228619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:11.238552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b561cd49-5b68-48a4-afa3-51586605f8da tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1504 microversion: 2.1 time: 0.660814 Aug 29 10:43:11.239134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:11.239274 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1025/1985] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:10 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1504 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:11.254968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:11.256496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:11.260532 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-630c3bc0-f872-4a4f-b636-b38cf11a3d64 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.756405 Aug 29 10:43:11.265120 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 961/1986] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:10 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:11.271986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '.version_select at 0x7f66cb083670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:11.277214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:11.291594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.293414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.293975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.301239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:11.302245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:11.302576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.303176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.303867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.312671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.313168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.313614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.314354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.314813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.315237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.376789 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a246eb98-f6df-4bad-88a0-bd1c24847e19 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.109947 Aug 29 10:43:11.377831 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 962/1987] 10.222.0.47 () {58 vars in 1296 bytes} [Mon Aug 29 10:43:11 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e/os-instance-actions => generated 611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:11.390573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893f51a-b42d-4a2b-8b42-3dbdbd98cf81", "name": "network-vif-plugged", "status": "completed", "tag": "11aab3cc-bb00-494c-b28e-668948b08f8c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:11.403810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.405084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.406206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.421481 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] Creating event network-vif-plugged:11aab3cc-bb00-494c-b28e-668948b08f8c for instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 on n-h1-854121-10 Aug 29 10:43:11.430126 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-aa3eb592-0305-471c-951c-c5e4bc8f18d3 req-09fa891a-7dba-4b79-bd45-52499b3a4212 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050478 Aug 29 10:43:11.430966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 963/1988] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:11.438174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:11.439208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:11.450751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.451255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.451698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.452396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.453003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.453881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.496727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:43:11.620574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:11.693883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73b35856-7343-4192-87de-1b159500b5e1 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.379468 Aug 29 10:43:11.696009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1026/1989] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:11 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:11.710685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:11.711561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:11.723469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.724349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.724986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.726286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.730285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-618af8e0-1c48-4e53-aaf5-af935a23a9cd tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 204 len: 0 microversion: 2.1 time: 0.296753 Aug 29 10:43:11.731389 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 964/1990] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:43:11 2022] DELETE /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:43:11.734492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.739025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.744800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:11.746996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:11.764301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.766735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.768906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.774159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:11.777420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:11.778136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:11.960894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:11.996460 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c798af18-db1d-4061-9aca-13b481740eca tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1424 microversion: 2.1 time: 0.298449 Aug 29 10:43:11.997285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1027/1991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:11 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1424 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:12.002410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:12.006957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:12.031337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.032203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.032844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.033813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.042084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.043689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.252776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:12.262136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cea6f030-78bc-4f45-83f1-ea8ae10150da tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1307 microversion: 2.1 time: 0.528147 Aug 29 10:43:12.266416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 965/1992] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:11 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1307 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:12.276969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7166b683-1fb7-4865-9722-256ce4dec614", "name": "network-vif-deleted", "tag": "80e23a84-6b53-4495-a8c2-f6328360ca76"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:12.295232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.295716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.296151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.300261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:12.320790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] Creating event network-vif-deleted:80e23a84-6b53-4495-a8c2-f6328360ca76 for instance 7166b683-1fb7-4865-9722-256ce4dec614 on n-h2-854121-10 Aug 29 10:43:12.331579 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-64b5e31f-f9b2-4b75-ae69-3a61373ecf12 req-c3380d8c-0843-45f1-8375-e4e81c363b68 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063770 Aug 29 10:43:12.332776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 966/1993] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:12.339841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:12.340847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:12.353090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.355635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.355929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.357282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.357785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.358226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.589564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:12.598021 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fedbbf93-05f6-4211-a5c3-5baeaa70671a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1510 microversion: 2.1 time: 0.599428 Aug 29 10:43:12.612058 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1028/1994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:11 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:12.754170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:12.754810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:12.764080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.764580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.765020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.765747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:12.766208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:12.766635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:12.890531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:12.937038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:12.954165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:12.958088 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2faa6787-f832-4dcb-9ac7-cddc087847e5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.623945 Aug 29 10:43:12.965512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 967/1995] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:12 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:12.984088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:13.024289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:13.029154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:13.036154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-abc188f6-539a-4d08-8da5-4baf9e849d37 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.288121 Aug 29 10:43:13.043836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.045958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.046607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.047798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.050418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.053277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.059231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1029/1996] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:12 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:13.143580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.144070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.144506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.144955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lazy-loading 'fault' on Instance uuid 7166b683-1fb7-4865-9722-256ce4dec614 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:13.279981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:13.288782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:13.290077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:13.300053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62528520-fc2f-4607-bae0-69f5f6b09231 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 200 len: 1302 microversion: 2.1 time: 0.286515 Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.314903 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 968/1997] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:13 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 1302 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:13.620835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:13.621776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:13.637269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.638046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.639834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.640801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.646558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.647333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.686133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:13.700835 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1048d0f1-f9f9-4764-9ba8-d20f98020b70 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1485 microversion: 2.1 time: 0.417710 Aug 29 10:43:13.730044 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1030/1998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:13 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1485 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:13.735762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:13.743889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.744656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.745618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.862237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:43:13.929983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9558dfd4-6d69-4100-a3f1-21ccb786ff6b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81/action" status: 202 len: 0 microversion: 2.1 time: 0.196147 Aug 29 10:43:13.931689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1031/1999] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:43:13 2022] POST /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:43:13.955743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:13.956438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:13.967650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.968160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.968601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:13.969491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:13.970019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:13.970440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.394915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:14.405274 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-000d954c-c946-43ad-9322-46045bf93b7e tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1510 microversion: 2.1 time: 0.790271 Aug 29 10:43:14.420482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 969/2000] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:13 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:14.422312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:14.424659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:14.425280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:14.432985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd307af4-8c0f-4e5e-bfa3-9ddbba1bc45b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.485119 Aug 29 10:43:14.434247 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1032/2001] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:13 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:14.438223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.439753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.440202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.440918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.441969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.442578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.445993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:14.448994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:14.469031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.473666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.474417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.475250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.475803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.476469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.639935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:14.670025 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97eac62f-fe7f-466a-896e-7d5c17de150d tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.234402 Aug 29 10:43:14.670840 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1033/2002] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:14 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:14.872543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:14.903876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:14.905658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:14.906835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1523063c-6f44-4cfc-ab9f-6c483500ba81 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.486366 Aug 29 10:43:14.907378 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 970/2003] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:14 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:14.912011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:14.917385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: 7166b683-1fb7-4865-9722-256ce4dec614] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:14.936634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.938527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.942017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.943725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:14.949622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:14.950486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:14.973135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1824090152", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:14.986929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] HTTP exception thrown: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Request method failure captured: Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 HTTP/1.1 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJbW4ATcydTu4hCqup4SagAH9e0qsjCmAvht9hErBhp4HQzJB7q9bFY7RG-OLQyne326cU9XE7ev5pL6NKnWTAprXTNJEHJlZ0-vrs31TzeU8E60aAvcBb_U7CGgZMqdiDwQCjx9eTvup4BgIsU8hgXfNocLVtj__-Zjp8Q-ox9UirA Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_901105749eb4402d9a630487d32d7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 356590f9c0644b3695c6b3f321dd1275 Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7166b683-1fb7-4865-9722-256ce4dec614'} Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:14.996789 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. Aug 29 10:43:15.000178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:15.002074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Returning 404 to user: Instance 7166b683-1fb7-4865-9722-256ce4dec614 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:15.017253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4964a1c6-3df9-451c-9066-b70cd8d35ece tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614" status: 404 len: 111 microversion: 2.1 time: 0.108531 Aug 29 10:43:15.022304 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 971/2004] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:14 2022] GET /compute/v2.1/servers/7166b683-1fb7-4865-9722-256ce4dec614 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:15.040756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:15.041398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:15.051713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.055530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.056195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.057210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.064800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.066968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.069017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:15.069438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:15.070142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:15.070716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:15.071276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:15.097205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.097845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.098390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.099247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.099807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.100449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.120548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:15.138457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:43:15.146203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Getting quotas for project 0963e8f9d6be4f87afd6cc74e2c7f128. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:15.163673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Getting quotas for user 4b441d6daac1451ca082d9e6bf6db5c8 and project 0963e8f9d6be4f87afd6cc74e2c7f128. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:15.190362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:15.191840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:15.194239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:15.306843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b74d8d45-7486-4fc8-8362-39bdfde6155f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.634737 Aug 29 10:43:15.315967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1034/2005] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:43:15.325733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b36e89-876f-4259-9edf-9b8fad86009e", "name": "network-vif-deleted", "tag": "14a30729-9640-4767-ab4d-b3b9a76fbcc1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:15.347276 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-08d6ffc8-0025-4fdd-8601-90ba0ff9c2f3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 204 len: 0 microversion: 2.1 time: 0.321149 Aug 29 10:43:15.353533 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 972/2006] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:43:15 2022] DELETE /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:43:15.367533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:15.368467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.368841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:15.368965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.369379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.384594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:15.400501 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] Creating event network-vif-deleted:14a30729-9640-4767-ab4d-b3b9a76fbcc1 for instance b7b36e89-876f-4259-9edf-9b8fad86009e on n-h2-854121-10 Aug 29 10:43:15.418928 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-692495bb-a3bf-4e14-9174-623458d7ed61 req-dcf48755-1287-4098-b620-9f1450f50b36 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101310 Aug 29 10:43:15.420096 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1035/2007] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:15.427644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:15.431497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:15.441440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.442279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.442943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.443901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.444616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.445364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.886367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:15.900211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:15.909970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:15.911468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd33c352-2f7b-4333-a6ff-cb1ca9e122bd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1278 microversion: 2.57 time: 0.555253 Aug 29 10:43:15.912125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 973/2008] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:15 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1278 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:15.920528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:15.921457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:15.935337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.935829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.936263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.936966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.937418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.937867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.992655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:15.993315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:15.993825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:15.994202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lazy-loading 'fault' on Instance uuid b7b36e89-876f-4259-9edf-9b8fad86009e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:16.083014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:16.091556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-976e95cb-1188-4309-8ac9-bf087df36de6 tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1305 microversion: 2.1 time: 0.178383 Aug 29 10:43:16.109048 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 974/2009] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:15 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1305 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:16.114102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:16.117124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:16.124449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.125277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.125897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.126747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.127348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.127923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.151614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:16.163735 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3bd0475c-2ce0-4e4c-bc77-9ce5cc8a8dc3 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1469 microversion: 2.1 time: 0.740301 Aug 29 10:43:16.164324 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1036/2010] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:15 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1469 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:16.169997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:16.173942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:16.184475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.185216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.185914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.186802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.187399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.187958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.336735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:16.373990 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5428d8f6-3fa8-4c12-accc-32b840e5c5b4 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.208346 Aug 29 10:43:16.375109 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1037/2011] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:16 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:16.380673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:16.381842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:16.390227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.391596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.392242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.393325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:16.394036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:16.394665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:16.558249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:16.575481 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-560be0c9-cc4a-4af5-8134-291d149dacee tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.458743 Aug 29 10:43:16.575839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 975/2012] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:16 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:16.723971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d32e9d2-71e9-42c8-a2c5-6f9333833510 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Calling method '.version_select at 0x7f66cb0eb4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:16.828933 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8d32e9d2-71e9-42c8-a2c5-6f9333833510 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.252002 Aug 29 10:43:16.829545 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 976/2013] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:43:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:43:16.842479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2abd717-9368-4add-820e-91b3c487b068 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Action: 'create', calling method: .version_select at 0x7f66c66a6e50>, body: {"pool": "non_exist_pool"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:16.908172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e2abd717-9368-4add-820e-91b3c487b068 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] HTTP exception thrown: Floating IP pool not found. Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2abd717-9368-4add-820e-91b3c487b068 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Request method failure captured: Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 26 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhDCu8z7U86WVpKStARadqDS9crfjvhcCVLJ2QrtQXCCexWZd27c_5b3iEKqTW5s3fRdA7eSdbG7Ptoby_SBjb-gjiq3Mou_5STOZBgTCv6KQLBtOAMSxONAYZ3nV9cDmlu-qmqh2bST7-O9PasE215xHA9KTUZXojEYQ-L7kyKLSE Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e7f56b942fc8416f99b4c218ef9081c7 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e7f56b942fc8416f99b4c218ef9081c7 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsNegativeTestJSON-1142022534-project Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6e5d2b945cf247d0bf26e841b591e58f Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1142022534-project Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: {"pool": "non_exist_pool"} Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: exception: Floating IP pool not found. Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:16.911493 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:16.920765 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 29 10:43:16.920765 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:16.920765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2abd717-9368-4add-820e-91b3c487b068 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Returning 404 to user: Floating IP pool not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:16.920765 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2abd717-9368-4add-820e-91b3c487b068 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.075454 Aug 29 10:43:16.920765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 977/2014] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:43:16 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:43:16.928193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Calling method '.version_select at 0x7f66c670bca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:16.935885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:16.952292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:16.967574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.006706 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55b2c5dd-a4a8-4c45-9a79-9317c63403b4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.629838 Aug 29 10:43:17.011582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1038/2015] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:16 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:17.024574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:17.027749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 330ebaca-a644-4c8e-b070-95bc2980f526 could not be found", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:43:17.028636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] HTTP exception thrown: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526 Aug 29 10:43:17.030754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Request method failure captured: Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-floating-ips/330ebaca-a644-4c8e-b070-95bc2980f526 HTTP/1.1 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhDCu8z7U86WVpKStARadqDS9crfjvhcCVLJ2QrtQXCCexWZd27c_5b3iEKqTW5s3fRdA7eSdbG7Ptoby_SBjb-gjiq3Mou_5STOZBgTCv6KQLBtOAMSxONAYZ3nV9cDmlu-qmqh2bST7-O9PasE215xHA9KTUZXojEYQ-L7kyKLSE Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e7f56b942fc8416f99b4c218ef9081c7 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7f56b942fc8416f99b4c218ef9081c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e7f56b942fc8416f99b4c218ef9081c7 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1142022534 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsNegativeTestJSON-1142022534-project Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6e5d2b945cf247d0bf26e841b591e58f Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1142022534-project Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: exception: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '330ebaca-a644-4c8e-b070-95bc2980f526'} Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 330ebaca-a644-4c8e-b070-95bc2980f526 could not be found Aug 29 10:43:17.031428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d3d99c8-e5d5-4bcb-bca4-c3407b5a26c8'] Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526. Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526 Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526 Aug 29 10:43:17.035298 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:17.040593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] Returning 404 to user: Floating IP not found for ID 330ebaca-a644-4c8e-b070-95bc2980f526 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:17.042722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5de00d5b-28f8-4f75-993d-063153eac021 tempest-FloatingIPsNegativeTestJSON-1142022534 tempest-FloatingIPsNegativeTestJSON-1142022534-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/330ebaca-a644-4c8e-b070-95bc2980f526" status: 404 len: 111 microversion: 2.1 time: 0.121030 Aug 29 10:43:17.044141 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 978/2016] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:43:16 2022] DELETE /compute/v2.1/os-floating-ips/330ebaca-a644-4c8e-b070-95bc2980f526 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:17.060891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.065784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.068430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.071112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.074035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.076333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.112261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:17.112821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:17.128139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.128784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.129072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.129823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.130321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.130753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.249534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.250288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.250890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.251355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lazy-loading 'fault' on Instance uuid b7b36e89-876f-4259-9edf-9b8fad86009e {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:17.301887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.317138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.318909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.326342 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-86973e77-7816-4ca9-a879-b2d96ea45989 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1330 microversion: 2.57 time: 0.313166 Aug 29 10:43:17.327200 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1039/2017] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:17 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1330 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:17.339343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:17.347602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:17.388442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.388872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.389332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.390114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.390581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.391016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.617099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f66ab4526a49adb61f9faa5163e9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518789a1d4c94615a57231569c98b6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.627420 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-08fb72c6-050d-4994-8b88-7d8614996c6d tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 200 len: 1305 microversion: 2.1 time: 0.518847 Aug 29 10:43:17.628207 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 979/2018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:17 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 1305 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:17.646963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:17.647735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:17.655390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.656101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.656768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.657624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.658270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.658846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.795841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:17.821029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:17.833805 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65fa6640-2c4a-4e9d-8303-c819d5d6e091 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1469 microversion: 2.1 time: 0.503933 Aug 29 10:43:17.837348 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-334b2dc1-468c-4e54-9fb4-fb9760c1d672 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.194384 Aug 29 10:43:17.837982 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 980/2019] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:17 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:17.839258 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1040/2020] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:17 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1469 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:17.849321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:17.868073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:17.884833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.885627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.886573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:17.887486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:17.888127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:17.888707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.036624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:18.037568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:18.052440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.053556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.054278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.055645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.056124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.056807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.511754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.552229 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-abe0e42a-5754-4d9b-afc7-590732805560 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.711503 Aug 29 10:43:18.581030 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1041/2021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:17 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:18.602763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:18.608757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:18.617673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.619064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.619665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.620710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.621615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.622258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.656224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.670412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.674347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.678681 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52b32353-8953-413c-b2b3-5349f0b3c47a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.645985 Aug 29 10:43:18.680014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 981/2022] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:18 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:18.687654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a7afec-845f-46d0-b835-4235d35c15e2", "name": "network-vif-deleted", "tag": "b5d5efbf-e3a7-411e-ad86-aa68d5457269"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:18.710800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.711793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.712906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.727536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] Creating event network-vif-deleted:b5d5efbf-e3a7-411e-ad86-aa68d5457269 for instance a2a7afec-845f-46d0-b835-4235d35c15e2 on n-h2-854121-10 Aug 29 10:43:18.738678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e93425e5-050e-4788-ad7a-485dba7f79bd req-63e090ac-93de-4982-bbdd-c2a4ebd48574 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057153 Aug 29 10:43:18.741205 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 982/2023] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:18.754564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:18.756032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] [instance: b7b36e89-876f-4259-9edf-9b8fad86009e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:18.763684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.764339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.764792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.765630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.766119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.767238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.788066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] HTTP exception thrown: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Request method failure captured: Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e HTTP/1.1 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJgc1htNXyLRsf85oO4OJxEsvU57n7JnMXByPwpxHQq-u7bg_HUCvCKBP2SwaGFL6HSkztJdSQjT3LDHLrFIcY3XoT1uwKC8SLkOBEouETLcIhXkDodXBcHfBsclrEEtd-rbXRoCRandNTdyii3DPOX0vqZ6YHHGxCpi944BzKuIjlU Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 518789a1d4c94615a57231569c98b6a6 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-InstanceActionsTestJSON-1143057639 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/518789a1d4c94615a57231569c98b6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_518789a1d4c94615a57231569c98b6a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/518789a1d4c94615a57231569c98b6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/518789a1d4c94615a57231569c98b6a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-InstanceActionsTestJSON-1143057639 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 518789a1d4c94615a57231569c98b6a6 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1143057639 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-InstanceActionsTestJSON-1143057639-project Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 49f66ab4526a49adb61f9faa5163e9d2 Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-InstanceActionsTestJSON-1143057639-project Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b7b36e89-876f-4259-9edf-9b8fad86009e'} Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:18.790818 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. Aug 29 10:43:18.794982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:43:18.800294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] Returning 404 to user: Instance b7b36e89-876f-4259-9edf-9b8fad86009e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:18.801266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a43f3473-c4f8-44f2-9a8f-37bea011163a tempest-InstanceActionsTestJSON-1143057639 tempest-InstanceActionsTestJSON-1143057639-project] 10.222.0.47 "GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e" status: 404 len: 111 microversion: 2.1 time: 0.058296 Aug 29 10:43:18.805197 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 983/2024] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:18 2022] GET /compute/v2.1/servers/b7b36e89-876f-4259-9edf-9b8fad86009e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:18.865048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:18.866750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:18.880034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.884635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.885242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.886246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.886895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.895259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:18.925948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.939945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.944145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:18.947037 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63186eb3-124e-4bfe-9212-8d29621b7263 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1336 microversion: 2.57 time: 0.354232 Aug 29 10:43:18.962647 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1042/2025] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:18 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1336 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:18.971137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:18.972121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:18.985890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:18.996852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:18.998616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.000980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.003913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.004648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.053509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.054293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.054986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.055675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lazy-loading 'fault' on Instance uuid a2a7afec-845f-46d0-b835-4235d35c15e2 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:19.153150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:19.178686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356590f9c0644b3695c6b3f321dd1275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901105749eb4402d9a630487d32d7e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:19.196748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d99b14e3-c6c0-4963-b0db-ad48cf3fb3db tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 200 len: 1303 microversion: 2.1 time: 0.230226 Aug 29 10:43:19.200239 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1043/2026] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:18 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:19.226827 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd2dbebd-5d9f-4b57-ba25-e4e8299f29c8 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.366078 Aug 29 10:43:19.227520 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 984/2027] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:18 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:19.586609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:19.587868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:19.598866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.599810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.600914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.601808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.602424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.603361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.713496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:19.714736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:19.739205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.743210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.744046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.746164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.749491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.749999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.856675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:19.866676 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11c60132-be0f-4cfd-aac6-cb588eb649f4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.284573 Aug 29 10:43:19.867465 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1044/2028] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:19 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:19.988460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:19.989103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:19.998287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:19.998600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:19.999057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:19.999784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.000249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.001130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.213431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.232124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.233874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.235153 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f80ee37-942e-4fc0-8f1f-633ca4be9bba tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1336 microversion: 2.57 time: 0.263482 Aug 29 10:43:20.265041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1045/2029] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:19 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1336 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:20.278356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:20.279225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] [instance: a2a7afec-845f-46d0-b835-4235d35c15e2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:20.286345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.287025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.287727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.288582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.289182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.289778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.310832 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] HTTP exception thrown: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Request method failure captured: Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 HTTP/1.1 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJbW4ATcydTu4hCqup4SagAH9e0qsjCmAvht9hErBhp4HQzJB7q9bFY7RG-OLQyne326cU9XE7ev5pL6NKnWTAprXTNJEHJlZ0-vrs31TzeU8E60aAvcBb_U7CGgZMqdiDwQCjx9eTvup4BgIsU8hgXfNocLVtj__-Zjp8Q-ox9UirA Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_901105749eb4402d9a630487d32d7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/901105749eb4402d9a630487d32d7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 901105749eb4402d9a630487d32d7e5c Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-MigrationsAdminTest-2110745247 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 356590f9c0644b3695c6b3f321dd1275 Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-MigrationsAdminTest-2110745247-project Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a2a7afec-845f-46d0-b835-4235d35c15e2'} Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:20.312897 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. Aug 29 10:43:20.316806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:20.318176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] Returning 404 to user: Instance a2a7afec-845f-46d0-b835-4235d35c15e2 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:20.320108 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a169fbb-dfd5-4bc0-b41f-4518b5abd948 tempest-MigrationsAdminTest-2110745247 tempest-MigrationsAdminTest-2110745247-project] 10.222.0.47 "GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2" status: 404 len: 111 microversion: 2.1 time: 0.051898 Aug 29 10:43:20.325441 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1046/2030] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:20 2022] GET /compute/v2.1/servers/a2a7afec-845f-46d0-b835-4235d35c15e2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:43:20.333064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:20.334318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:20.349757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.350616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.355243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.366844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.367716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.368208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.371364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.377606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.381353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:20.383773 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f330f3bf-8294-4507-9db9-a75a375f8593 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.679637 Aug 29 10:43:20.397830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 985/2031] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:19 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:20.551104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:20.585563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a441125f-cb37-47f4-9915-b279b502e2dc tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.257837 Aug 29 10:43:20.602673 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1047/2032] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:20 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:20.888886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:20.889635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:20.896411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.897165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.897869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.898643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:20.899170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:20.899805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:20.905162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:21.267226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:21.267943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:21.284486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.285348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.286029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:21.287256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.287935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.298455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:21.645954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:21.661455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:21.671986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:21.676323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c377b6d-e72d-4660-8651-221348192cd5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1357 microversion: 2.57 time: 0.414482 Aug 29 10:43:21.679036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1048/2033] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:21 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:21.690220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:21.691150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:21.708946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.711120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.713135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:21.716604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.719593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.720768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:21.830710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:21.845175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad699483-fb20-4437-8036-33ada5d3484d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.958380 Aug 29 10:43:21.846125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 986/2034] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:20 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:21.858564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:21.862682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:21.872843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.874180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.874895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:21.887488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:21.889662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:21.891483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.033830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.044822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.058506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.060164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f60ae62d-acae-47e9-9034-1821af95eeec tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.379952 Aug 29 10:43:22.061212 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1049/2035] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:21 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:22.074415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:22.077734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:22.090994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.095374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.096047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.102729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.103511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.104160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.154951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:22.207001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deeb4958-8cbd-4690-8ce5-9325d77b497f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.358752 Aug 29 10:43:22.207609 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 987/2036] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:21 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:22.286969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:22.287397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:22.287875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:22.288281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:22.289791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:22.359778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:22.441575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:22.459185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.459690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.460153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.461084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.461563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.462030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.517119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ea0272e-bbf3-45ea-91a2-8108c64d992b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "POST /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454/action" status: 202 len: 1138 microversion: 2.57 time: 0.454632 Aug 29 10:43:22.517772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1050/2037] 10.222.0.47 () {62 vars in 1320 bytes} [Mon Aug 29 10:43:22 2022] POST /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454/action => generated 1138 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 10:43:22.538443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:22.539452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:22.547888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.548759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.549427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.550484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.551165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.551815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.633104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.642348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.644126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:22.645578 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03d64cd8-8576-435b-b101-9d7268dcef3b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.111669 Aug 29 10:43:22.646662 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 988/2038] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:22 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:22.866758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:22.867503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:22.881064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.881568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.888137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:22.888832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:22.889487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:22.891840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.084324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:23.084862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:23.094971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.098566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.099117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.100101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.100768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.106248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.632108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.642289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ef4589f-9302-43d7-9d02-5ed8fb24697e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.779348 Aug 29 10:43:23.643150 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1051/2039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:22 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:23.648579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:23.649397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:23.658756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.659481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.659936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.660661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.661131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.661807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.696954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.709120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.722642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.724269 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4acb5896-ee71-47a4-b44a-b2a824a25882 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.644081 Aug 29 10:43:23.725082 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 989/2040] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:23 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:23.738106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:23.738987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:23.757201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.757890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.758426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.759208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:23.759759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:23.760257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:23.782026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:23.822115 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7eb65e2f-d395-43cd-b525-2c529e4092b5 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.177056 Aug 29 10:43:23.825381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1052/2041] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:23 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:23.850083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.859912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.861343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:23.862539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77788730-abc9-4dd2-b80e-af7d46e6c794 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.135752 Aug 29 10:43:23.863093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 990/2042] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:23 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:24.666660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:24.668879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:24.690145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:24.693071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:24.693492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:24.694282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:24.694757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:24.695298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:24.747752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:24.748558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:24.756679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:24.757171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:24.776850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:24.778795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:24.780583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:24.782905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:25.118828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:25.177456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:25.207360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.221680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.227111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.232086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f59f872-a851-4e89-99fa-bf69d277f935 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.486031 Aug 29 10:43:25.248173 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 991/2043] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:24 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:25.252262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:25.256343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:25.269359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:25.269974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:25.270487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:25.271279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:25.275679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:25.276480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:25.432551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:25.460766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ab293d5-2558-4277-8289-1491d15b73ee tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.226356 Aug 29 10:43:25.475996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 992/2044] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:25 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:25.490325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:25.491229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:25.499351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:25.500101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:25.500728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:25.501964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:25.502609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:25.503213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:25.574140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.583802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bfffa553-6a96-4c0d-a8b3-e0a5f8569700 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.922354 Aug 29 10:43:25.585445 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1053/2045] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:24 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:25.659192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.669931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.672880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:25.678755 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76e2ac0c-aa80-4839-8c3c-3c949b21560f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.200612 Aug 29 10:43:25.695854 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 993/2046] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:25 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:25.909048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:26.055491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-936943393", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:26.109627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:43:26.112786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ccafbce7-d577-4cab-90cc-5706d4caf620 tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] Calling method '.version_select at 0x7f66c66ba3a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.130256 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ccafbce7-d577-4cab-90cc-5706d4caf620 tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.227506 Aug 29 10:43:26.137171 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 994/2047] 10.222.0.47 () {60 vars in 1226 bytes} [Mon Aug 29 10:43:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:43:26.141988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aea8a226-5d6d-49e1-aa00-2b40f6b79edf tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] Action: 'update', calling method: .version_select at 0x7f66c66badc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:26.269091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aea8a226-5d6d-49e1-aa00-2b40f6b79edf tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.130671 Aug 29 10:43:26.275423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 995/2048] 10.222.0.47 () {62 vars in 1247 bytes} [Mon Aug 29 10:43:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:43:26.282337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.283592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:26.290125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.290609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.291146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.291855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.292878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.293596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.401406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:26.401872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:26.402387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:26.402809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:26.403232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:26.412648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.413428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.414068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.414815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.415442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.415887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.452808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:26.465925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:26.480444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:26.482826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:26.547536 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8258c4c-d48a-4b9a-9608-dc4b54d1f30c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667212 Aug 29 10:43:26.559931 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1054/2049] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:43:26.568594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f3e136d-a54c-4f82-b76e-ddbdab5968ae tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] Calling method '.version_select at 0x7f66c65ccaf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.587475 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7f3e136d-a54c-4f82-b76e-ddbdab5968ae tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026093 Aug 29 10:43:26.588729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:26.590422 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1055/2050] 10.222.0.47 () {60 vars in 1226 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:43:26.604904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:26.607732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:26.609264 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a153a0c8-1f67-4b1a-b65e-2b843ad87d78 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.332337 Aug 29 10:43:26.609956 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 996/2051] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:26.610583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.611558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:26.622603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.623158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.623607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.624499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.624964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.627678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.632299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49ce3c72-df5e-488b-b96c-2e9bc0e3d64f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.633940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-49ce3c72-df5e-488b-b96c-2e9bc0e3d64f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:26.723021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49ce3c72-df5e-488b-b96c-2e9bc0e3d64f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:26.732019 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49ce3c72-df5e-488b-b96c-2e9bc0e3d64f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1216 microversion: 2.1 time: 0.120954 Aug 29 10:43:26.734209 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 997/2052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:26.739907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b8228db-9f11-42ca-b29e-8e09d54029a8 tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] Action: 'update', calling method: .version_select at 0x7f66c6e60c10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:26.791731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:26.818121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c86120d6-17dd-4a50-8076-6d77d517ac74 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.225883 Aug 29 10:43:26.831557 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1056/2053] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:26.845680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.846507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:26.847423 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b8228db-9f11-42ca-b29e-8e09d54029a8 tempest-QuotaClassesAdmin257Test-612458153 tempest-QuotaClassesAdmin257Test-612458153-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.110652 Aug 29 10:43:26.856217 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 998/2054] 10.222.0.47 () {62 vars in 1247 bytes} [Mon Aug 29 10:43:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:43:26.865192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:26.867064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.867662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.868325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.869381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:26.869589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.870395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.871010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.880973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.881468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.881952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.882670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:26.883133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:26.883556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:26.987797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.002718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.004809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.007064 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c0cf0b7-d5a6-485b-8a89-e08179c82c07 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.156810 Aug 29 10:43:27.007656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 999/2055] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:27.109257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.121330 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90b7cc96-b687-4ad9-8ace-99481d59fa8d tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.288386 Aug 29 10:43:27.122599 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1057/2056] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:26 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:27.632562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:27.633121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.644242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.763624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:27.764356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:27.773672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.774347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.774792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.775566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.777334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.778487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.893374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.904301 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad2bbf38-e6f0-4bbb-a596-671abe357817 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1268 microversion: 2.1 time: 0.150249 Aug 29 10:43:27.905072 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1058/2057] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:27 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:27.914304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:27.914922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:27.922447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.932291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.932872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.933289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.934263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:27.934721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:27.935147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:27.942476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.946743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:27.951371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebf32a0a-1e63-4574-9b91-ce692a77108b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.322754 Aug 29 10:43:27.952278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1000/2058] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:27 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:28.033793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:28.035032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:28.038766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:28.046838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.047335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.047772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:28.048478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.048921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.049349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:28.071403 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b26dd412-4e7c-47ab-a4e5-0f7e46cc9a29 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1931 microversion: 2.75 time: 0.159180 Aug 29 10:43:28.072686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1059/2059] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:27 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1931 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:28.144150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:28.145845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:28.159680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.161536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.163914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:28.165067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.166873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.169457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:28.183467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:28.196542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:28.198153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:28.202517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76e00484-1202-49d5-be8b-c78ab3759604 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.172891 Aug 29 10:43:28.206513 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1001/2060] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:28 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:28.477311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:28.489047 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b960b44e-f3a2-411b-bbea-13ed49f00a54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.350057 Aug 29 10:43:28.489637 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1060/2061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:28 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:28.606286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1040434300", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:28.614675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:28.678610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:43:28.924556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:28.925385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:28.957729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.958256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.958717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:28.959453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:28.960950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:28.961388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.098299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.109099 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e1898a94-3df6-4d41-b536-67aaee1af4a5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1274 microversion: 2.1 time: 0.188288 Aug 29 10:43:29.109811 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1061/2062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:28 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:29.126665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:29.127161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:29.127618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:29.128191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:29.128615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:29.128773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:29.130798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:29.141972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.142669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.143157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.144395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.146045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.146674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.146934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.147959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.149323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.150688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.153405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.155863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.206908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Getting quotas for project 5a0d634d151046a89a49c4e938d8dc36. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:29.219858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Getting quotas for user c51da1350111427ab3fe355344743f4e and project 5a0d634d151046a89a49c4e938d8dc36. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:29.238953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:29.241406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:29.306476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e376a846-e0a1-41b3-9a22-cc415735860f tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057416 Aug 29 10:43:29.307681 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1002/2063] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:43:29.317942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:29.318767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:29.333848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.353337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.355305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.358665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.362102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.363288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.529347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:29.556811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.561444 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d5b81be-7ce2-4ad1-982d-6f35a86a5a40 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1937 microversion: 2.75 time: 0.251424 Aug 29 10:43:29.562720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1003/2064] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:29 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1937 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:29.573735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:29.577463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:29.586452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.587578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.588205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.589610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.590336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.591037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.596642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.600478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.602250 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8cf6881e-2116-4f7d-9ebb-b664dcec137e tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.491684 Aug 29 10:43:29.603482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1062/2065] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:29 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:29.614747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb802898-4c07-4c4c-98a7-1a87e3534628 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:29.615663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb802898-4c07-4c4c-98a7-1a87e3534628 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:29.790320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.813506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.815311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb802898-4c07-4c4c-98a7-1a87e3534628 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.817534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:29.821326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f346cd4-504e-48ff-bb90-c7cfd02a4e9f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.257378 Aug 29 10:43:29.835222 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1004/2066] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:29 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:29.844041 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb802898-4c07-4c4c-98a7-1a87e3534628 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1217 microversion: 2.1 time: 0.235977 Aug 29 10:43:29.847464 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1063/2067] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:29 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:29.875349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:29.877148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:29.894959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.896869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.897560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:29.900902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:29.903130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:29.905083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:30.133567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:30.134230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:30.149364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:30.150039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:30.150356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:30.151070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:30.151725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:30.152288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:30.336846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:30.350280 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ffe69f10-1853-47f2-9498-8946e8606e35 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.512580 Aug 29 10:43:30.353145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1005/2068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:29 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:30.598735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:30.599745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:30.609341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:30.610198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:30.612185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:30.613370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:30.616690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:30.618681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:30.654783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:31.064853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:31.090754 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06b1b034-3512-410f-93c3-f42b083dc099 tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1937 microversion: 2.75 time: 0.503633 Aug 29 10:43:31.091706 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1006/2069] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:30 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1937 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:31.104075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.107128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:31.107910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:31.117549 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-34f4e01b-e6ce-4d5c-bc08-4271dd3a1fb2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.989523 Aug 29 10:43:31.118774 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1064/2070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:30 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:31.119297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.119872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.120458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.121511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.122268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.122906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.128119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:31.128755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:31.145978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.158135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.160666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.161613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.162263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.162844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.334091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.346514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.347984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.350491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-018037e0-1db0-4ee0-876a-eb083f8303e3 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.230476 Aug 29 10:43:31.351083 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1065/2071] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:31 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:31.371153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:31.372109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:31.373954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:31.381422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.381952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.382646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.383577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.384222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.384837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.612561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.626800 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77db7695-489a-42ec-9043-ab5bda1bb7c8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1275 microversion: 2.1 time: 0.274617 Aug 29 10:43:31.627450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1066/2072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:31 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:31.645564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:31.646567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:31.662373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.664767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.665485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.668883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:31.672429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:31.673148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:31.813418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.827245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.831291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:31.832762 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f480672c-0b85-4d55-8c95-8a4fe4134bbe tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.739706 Aug 29 10:43:31.833542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1007/2073] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:31 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:32.085506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.094675 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30fffc32-3418-43f9-8aa8-12ad75f4f285 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.462438 Aug 29 10:43:32.095206 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1067/2074] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:31 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:32.124804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:32.125423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:32.140786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:32.141279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:32.152391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.159109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.159664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.160245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.160998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.161591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.161732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.162172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.162488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.166654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.168320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.168867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.182155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:32.332633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] Lazy-loading 'services' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:32.359312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46486221-8bd1-4e8a-b608-02bd881d9e9f tempest-ServersAdmin275Test-257574451 tempest-ServersAdmin275Test-257574451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1922 microversion: 2.75 time: 0.240504 Aug 29 10:43:32.360586 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1008/2075] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:32 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1922 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:32.386283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:32.388008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:32.397393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.398250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.400439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.403689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.404826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.406298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.678828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.694813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.699775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.703216 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fd2e314b-a654-41c1-9e57-b5e4714ded2b tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.326512 Aug 29 10:43:32.704567 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1009/2076] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:32 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:32.719173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:32.722391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:32.738677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.743644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.744254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.744737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.745557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.746009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.746444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.750750 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-688a1f8a-0b78-48ef-96ac-c594eeacdd35 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.614647 Aug 29 10:43:32.752887 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1068/2077] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:32 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:32.757766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:32.758628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:32.772348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.774394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.775070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.776022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:32.777425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:32.778219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:32.814733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:43:32.941280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:32.960971 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1a7c2266-4006-42e7-8a18-81e42241f205 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1275 microversion: 2.1 time: 0.206188 Aug 29 10:43:32.963137 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1069/2078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:32 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:32.995139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:33.007469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:33.094107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.109940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.116983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:33.122318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.128387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.153431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:33.208870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e409d0b9-36ca-40af-ac5b-1d7f9de7bb70 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "DELETE /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 204 len: 0 microversion: 2.75 time: 0.491611 Aug 29 10:43:33.220899 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1010/2079] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:43:32 2022] DELETE /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:43:33.240897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:33.265490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:33.301520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.303340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.304281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:33.306133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.306609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.308241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:33.856516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:33.866162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:33.867508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:33.869063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9d4078e-56b8-434a-b528-355cb5c73fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.898008 Aug 29 10:43:33.886850 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1070/2080] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:32 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:33.893385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:33.894288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:33.901368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.902568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.903295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:33.904902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:33.905783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:33.906624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.055253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.069162 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52c95f5d-9322-4d5f-a455-2361c3f4b8d3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.843940 Aug 29 10:43:34.085678 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1011/2081] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:33 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:34.091221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec53f44c-01e4-4b61-8350-cea8fd318518", "tag": "c8ba2503-ea95-4d77-8cbf-1f5f6030d428"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:34.094611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.102884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.103952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.105111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.108031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.113777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.133097 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bee3e5a7-f040-4a63-a2e6-fa52037e610e tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1444 microversion: 2.75 time: 0.244101 Aug 29 10:43:34.133882 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1071/2082] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:33 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1444 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:34.139463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:34.140089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:34.144646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] Creating event network-changed:c8ba2503-ea95-4d77-8cbf-1f5f6030d428 for instance ec53f44c-01e4-4b61-8350-cea8fd318518 on n-h2-854121-10 Aug 29 10:43:34.156022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.160223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.161893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.162859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.164882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.165511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.170268 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-638fa6ff-9e29-42ee-ae25-dfb7ff335510 req-b475a4b1-f882-4c1c-a431-4ba798400457 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088890 Aug 29 10:43:34.172399 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1012/2083] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:34.195379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:34.203006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:34.229209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.230688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.232481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.233329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.235060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.238313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.406340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.423844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.425298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.427146 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3b7b534-6a31-4659-974f-f76b616a178f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.291416 Aug 29 10:43:34.427146 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1072/2084] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:34 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:34.454664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:34.455293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:34.472272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.474641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.482196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.483094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.483660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.489860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.699894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.708447 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-405db40b-ab35-4b24-8f63-dec234b07d36 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.527998 Aug 29 10:43:34.712092 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1013/2085] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:34 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:34.895412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:34.896168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:34.902589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.903086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.903523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.904823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:34.905282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:34.905989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:34.947354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:34.956576 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47391acd-6adb-4221-8ce5-ad8251c0ec18 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.512972 Aug 29 10:43:34.957421 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1073/2086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:34 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:35.094596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:35.096701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:35.114219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.116303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.116961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.129905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.130583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.132444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.290434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:35.302293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:35.311816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:35.313284 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-640d59c1-3bba-49e1-a0e4-b4711a2dba5b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.424453 Aug 29 10:43:35.317017 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1014/2087] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:34 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:43:35.327769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:35.358384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.359160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.359764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.400200 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] Creating event network-changed:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:43:35.407159 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b4572801-c268-4390-93d3-152404dd2ea3 req-f17c2b39-b499-4c93-9f3d-1e4a83a4141f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088450 Aug 29 10:43:35.409125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1015/2088] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:35.420612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:35.422803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:35.431330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.445738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.449070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.452077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.452793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.454522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.517561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:35.529426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:35.529970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:35.530459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lazy-loading 'fault' on Instance uuid acc61ffe-26b7-4276-8e18-8411eaac810c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:36.275090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.291075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3fd0274-9465-4a0f-a47f-cbb4125d619f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 1.203812 Aug 29 10:43:36.309500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.322848 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1074/2089] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:35 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:36.325156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.327916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f98f930159499e96b573aed9cc9400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12242044e58841fba2728ff392bdf656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.340715 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-82ba17d4-42a1-486a-9feb-0fe6d852d411 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 200 len: 1449 microversion: 2.75 time: 0.929478 Aug 29 10:43:36.341341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:36.342221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:36.342521 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1016/2090] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:35 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 1449 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:36.347305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:36.348134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:36.355455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.356315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.356949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.357906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.358664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.359300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.373607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.379756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.380513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.381601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.382332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.382975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.431664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:36.607166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.622544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.628004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.630790 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c86d7cbf-2a68-4897-a1be-0c9a78501d25 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.302404 Aug 29 10:43:36.634960 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1075/2091] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:36 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:36.651016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:36.652517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:36.662569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.666682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.668686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.670422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.673790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.674344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.761482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:36.769536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12e7df87-4e07-4c93-9ae7-1532bf40852f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.425806 Aug 29 10:43:36.770157 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1017/2092] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:36 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:36.782726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:36.783561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:36.799518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.800021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.803543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:36.804537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:36.805170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:36.807168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.255512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.270025 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a66452f2-42e2-4d66-803a-8e02760c5937 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.633626 Aug 29 10:43:37.270618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1076/2093] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:36 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:37.324861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:37.325488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:37.341169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.342096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.342688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.343884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.344493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.345161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.587775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.597738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82a76648-a46f-4cdd-8b51-626d5df789c2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.285316 Aug 29 10:43:37.603004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.613563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.615049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.616243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80e16f91-367e-4584-8553-b0677b8167c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.841806 Aug 29 10:43:37.639110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1077/2094] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:37 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:37.644973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:37.645239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] [instance: acc61ffe-26b7-4276-8e18-8411eaac810c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:37.650098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1018/2095] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:36 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:37.654498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.655214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.656429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.664512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:37.665381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:37.668858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.673679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.676720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.683150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.684058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.686570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.687531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.689127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.691045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.722994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] HTTP exception thrown: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Request method failure captured: Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c HTTP/1.1 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJgJhBxjLy1t8cIlImtPBD4fbbKsmr0yEOMDLMa6axHjflxElPCUNgMTRZcpxd4V7weMMfKZBCJ4rs5KMZmCtgDfWqMvk0Raacjgl-HAQbvNXaoUp6KO9AfFkZ020yuTBGJo-uSCObdF4FlzSqAd2YUQdSe-9aGn1WxgUCF3L3Rbsl4 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.75 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 12242044e58841fba2728ff392bdf656 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdmin275Test-1865347265 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/12242044e58841fba2728ff392bdf656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_12242044e58841fba2728ff392bdf656"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/12242044e58841fba2728ff392bdf656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/12242044e58841fba2728ff392bdf656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdmin275Test-1865347265 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 12242044e58841fba2728ff392bdf656 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdmin275Test-1865347265 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdmin275Test-1865347265-project Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 85f98f930159499e96b573aed9cc9400 Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdmin275Test-1865347265-project Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'acc61ffe-26b7-4276-8e18-8411eaac810c'} Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:43:37.737086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. Aug 29 10:43:37.741434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:43:37.744393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] Returning 404 to user: Instance acc61ffe-26b7-4276-8e18-8411eaac810c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:43:37.746541 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-439d66c4-97ec-4ac5-afdc-1c6dfb2e6344 tempest-ServersAdmin275Test-1865347265 tempest-ServersAdmin275Test-1865347265-project] 10.222.0.47 "GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c" status: 404 len: 111 microversion: 2.75 time: 0.106267 Aug 29 10:43:37.747311 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1078/2096] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:37 2022] GET /compute/v2.1/servers/acc61ffe-26b7-4276-8e18-8411eaac810c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:43:37.796068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:37.796744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:37.815386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.815994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.816453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.817373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:37.817672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:37.818134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:37.887097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.901641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.908675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:37.913824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd15386f-bd6c-4a5e-888c-612fc8f37dce tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.253783 Aug 29 10:43:37.918339 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1019/2097] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:37 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:38.099042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:38.125830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15053937-da61-4235-bfad-60e198c3332a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.326862 Aug 29 10:43:38.126491 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1079/2098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:37 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:38.292114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:38.293419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:38.313571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.314419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.315088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:38.316010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.316673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.317373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:38.658350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:38.660920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:38.675966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:38.692439 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bc434cfd-f391-4983-839f-a406e2634f9a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.401767 Aug 29 10:43:38.696071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1020/2099] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:38 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:38.707809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:38.712534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.713225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:38.714350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.715280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:38.716378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.718249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.719158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:38.729409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.730235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.730920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:38.731859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:38.732550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:38.733188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.091332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.094420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:39.106061 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d81de846-91a6-4bb9-b32f-fc1e9d9ef667 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.408576 Aug 29 10:43:39.107105 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1021/2100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:38 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:39.112859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:39.114301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:39.125806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.125806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.126157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.127110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.127702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.132279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.193913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:39.232473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:39.234743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.255871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.261298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.262789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f894539c-87cb-4bc2-bf5c-cc61d38deb93 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.627299 Aug 29 10:43:39.263562 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1080/2101] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:38 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:39.270930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:39.271549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:39.290841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.291097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.291668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.293435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.293990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.294486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.465373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.481176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.485378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.490861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-346c6803-fddd-40c3-811b-65313d19ee79 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.380169 Aug 29 10:43:39.492986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1022/2102] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:39 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:39.687298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:39.700473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1724bbd-5ec5-4eaa-aa51-c99d2608d2ee tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.432532 Aug 29 10:43:39.701228 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1081/2103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:39 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:39.735431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:39.737473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:39.758079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.759501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.760147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.762650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:39.764044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:39.765655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:39.908715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:40.032473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:40.048380 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5355eb2e-4c40-4f23-b00e-2dccea06146e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.325486 Aug 29 10:43:40.049239 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1023/2104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:39 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:40.129283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-395277213", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:40.131156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:40.139303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:40.202903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:40.203411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:40.203859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:40.206230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:40.206701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:40.210581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:40.234553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] validate_networks() for [('bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:43:40.736078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:40.753126 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b83ec58-a23e-4c4f-941d-439d161bb22a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.627241 Aug 29 10:43:40.755922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1024/2105] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:40 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:40.772930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:40.782269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:40.795405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:40.797050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:40.799435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:40.800521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:40.802031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:40.803746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.164304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.174505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.184289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.185824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe2b65a6-daad-41e8-bb91-563e5c38e609 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.426340 Aug 29 10:43:41.189313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1025/2106] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:40 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:41.210641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "4b8184d7-704a-44a6-b5c7-d657900817c6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:41.225206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.227884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.229284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.231872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:41.232486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:41.232982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:41.233479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:41.233937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:41.252398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] Creating event network-vif-plugged:4b8184d7-704a-44a6-b5c7-d657900817c6 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:41.259730 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6ca2e7c4-ec5b-43a4-85cd-5de435f02e2c req-775f02ef-1934-4d5b-8357-b0a1924c9964 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068874 Aug 29 10:43:41.260936 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1026/2107] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:41.267406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:41.270222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:41.277067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.277578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.279925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.280553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.281209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.282036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.282234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.282628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.283041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.283144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.283517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.284025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.322851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Getting quotas for project 454c5d1e28064c4794db28a10ee5a012. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:41.333142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Getting quotas for user 615f56cde3bf42649a599f66eaeaca6f and project 454c5d1e28064c4794db28a10ee5a012. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:41.359299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:41.361691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:41.405146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.427721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.429521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.430787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88237e78-88a2-4105-a2e3-753abb56140c tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.167962 Aug 29 10:43:41.445553 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53b2d5ce-7580-4e5a-9737-5dd51b49fe95 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541098 Aug 29 10:43:41.451377 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1082/2108] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:43:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:43:41.452293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1027/2109] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:41 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:41.459927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:41.461830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:41.462648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:41.463471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:41.472440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.473187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.473892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.475403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.476179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.476479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.477067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.494399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.494857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.495636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:41.496094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:41.496518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:41.807462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.822688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f50c99f-6da7-4100-8716-92a4561a5c81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.370120 Aug 29 10:43:41.836816 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1083/2110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:41 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:41.856239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:41.887232 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ca4ec05-cacf-49dc-a38a-97235f0a2d27 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.431928 Aug 29 10:43:41.904947 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1028/2111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:41 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:41.945776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa7c5a85-85d9-469b-999d-677847ad26f4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:41.954378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa7c5a85-85d9-469b-999d-677847ad26f4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:42.092321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa7c5a85-85d9-469b-999d-677847ad26f4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:42.112211 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa7c5a85-85d9-469b-999d-677847ad26f4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1223 microversion: 2.1 time: 0.204100 Aug 29 10:43:42.125004 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1029/2112] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:41 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1223 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:42.130663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:42.131272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:42.166127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:42.166678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:42.167054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:42.169644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:42.178528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:42.185833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:42.570680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:42.586747 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-de8dd855-5dd7-4545-a872-4abde4db9f80 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.468965 Aug 29 10:43:42.602543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-751676033", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "5fa5d8fb-37a2-44dd-9421-0381819e4e9e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:42.603254 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1030/2113] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:42 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:42.609763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:42.610763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:42.618260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:42.619139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:42.619792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:42.620783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:42.621538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:42.622112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:42.712066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] validate_networks() for [('5fa5d8fb-37a2-44dd-9421-0381819e4e9e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:43:43.735479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.757959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.761982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.773138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b54ab2d-6832-4e91-8e40-0c005ea0a26c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 1.168178 Aug 29 10:43:43.774492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1031/2114] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:42 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:43.790771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:43.791983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:43.819613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:43.820763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:43.826091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:43.832900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:43.833387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:43.833976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:43.967576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.985431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.992145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:43.993397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9571ac8a-6b70-421f-9208-3f0d1f3db7fd tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.217744 Aug 29 10:43:44.000412 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1032/2115] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:43 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:44.012159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:44.012963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:44.027554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.028079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.028705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.029445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.029940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.030381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.334846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:44.336642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:44.338459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:44.339076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:44.340725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:44.342501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:44.351584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb09eea1-4cb1-43f1-bdd3-42d287583c71 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.349369 Aug 29 10:43:44.357908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.358707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.359541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.360502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.361175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.363012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.366036 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1033/2116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:44 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:44.372130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:44.373019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:44.388784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.390849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.391297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.392035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.392497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.392921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.415122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Getting quotas for project 886a7bb817f14d5bb7cc19e7916bdcfe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:44.442151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Getting quotas for user b5d5994aeaff484291d3086e28477e6a and project 886a7bb817f14d5bb7cc19e7916bdcfe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:44.467888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:44.475206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:44.584136 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8279907c-c24e-4d9f-b128-337da01597e4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.745507 Aug 29 10:43:44.594121 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1084/2117] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:43:44.602522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:44.603384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:44.625444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.625992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.626449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.627187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.627657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.628292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.735236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:44.743279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f00ad63f-e839-445b-9ce0-972c939c12a0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.375894 Aug 29 10:43:44.743911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1034/2118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:44 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:44.783608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "caace4f8-4013-4946-9b42-fa03ce69a6f1"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "3753f968-91c5-486f-a765-2dc4bc69f280"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "fbc86598-a800-4c5e-94bc-23e2c82e3e23"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:44.823523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:44.825051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:44.833783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:44.862641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Creating event network-vif-plugged:caace4f8-4013-4946-9b42-fa03ce69a6f1 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:44.863675 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Creating event network-vif-plugged:3753f968-91c5-486f-a765-2dc4bc69f280 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:44.864903 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] Creating event network-vif-plugged:fbc86598-a800-4c5e-94bc-23e2c82e3e23 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:44.879806 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-874ec06c-74fe-4b1e-a0a7-88dfb02f3010 req-1c2e851c-8fcb-4c19-b476-01db47aaefdb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.121856 Aug 29 10:43:44.880606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1035/2119] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:45.012879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.034523 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-975c6081-3721-478c-a633-cdf4b070ccaa tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.445039 Aug 29 10:43:45.041076 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1085/2120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:44 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:45.078787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.079483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:45.098234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.098753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.099208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.099926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.109633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.115162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.262741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.271656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.281133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.281659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.285987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.286487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.286938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.382418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:45.433820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.440619 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77610ec5-0b7e-4e29-aeae-7cb2639ae814 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.557014 Aug 29 10:43:45.442356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1036/2121] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:45.442844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:45.450895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64f2635d-a547-49ed-ad5b-4fbd17f6a510 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1495 microversion: 2.1 time: 0.402120 Aug 29 10:43:45.452158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1086/2122] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:45 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1495 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:45.456939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.461510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.462391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:45.470378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:45.471237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.474082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.474752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.476154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.477618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.479420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.630590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.652859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.657814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.662189 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49838053-4a01-4ad4-aa6e-1c5c775df61e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1261 microversion: 2.26 time: 0.216553 Aug 29 10:43:45.665179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1037/2123] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:45 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:45.688120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.691884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:45.711425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.713495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.714271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.717055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.719351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.720063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.930001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.943037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.948518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:45.951559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4da228cc-2ff8-4f71-ac28-f07519f119a5 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.284315 Aug 29 10:43:45.954750 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1038/2124] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:45 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:45.970495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:45.972571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:45.981383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.982244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.982888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:45.984880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:45.985568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:45.987024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.132152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.152909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.154395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.155582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3445248a-f344-4f7a-bcba-85293d47ea5d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.700815 Aug 29 10:43:46.156138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1087/2125] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:45 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:46.174593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.187015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.187527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.187986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.190356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.190837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.191282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.256377 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7add30a-78a2-4bc1-89d6-9b88e2269ccb tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-854121-10" status: 200 len: 581 microversion: 2.1 time: 0.099186 Aug 29 10:43:46.258727 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1088/2126] 10.222.0.47 () {58 vars in 1174 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/os-services?host=n-d-854121-10 => generated 581 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:46.264513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.267362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:46.275252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.275909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.276491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.277523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.278318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.278893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.290707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.303269 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ae93b6a-1d6c-4824-83b0-ed8a0b1dcdd2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.346400 Aug 29 10:43:46.304302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1039/2127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:45 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:46.336217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.341218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:46.354917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.356132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.358721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.362062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.362378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.362817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.642086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.660863 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0588d6fd-7f26-4b0b-9a2c-ef59b361b0dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.400795 Aug 29 10:43:46.662331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1089/2128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:46.673333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.679861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.685659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34c22baa-a5d9-4b70-88e3-36b09b4a8d64 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.364802 Aug 29 10:43:46.686824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1040/2129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:46.695465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.695465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.695465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.695465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.695861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.696419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.706054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:46.717610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.718806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.719397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.727664 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e485455-d2d0-47b9-a47e-83e75281e9df tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.061019 Aug 29 10:43:46.729625 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1090/2130] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:46.742619 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] Creating event network-changed:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:43:46.743637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.744282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:46.749511 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9c8c0277-912e-4d1f-bd07-2202d7e65d5a req-bc5c6c6e-247f-453a-8eb8-388923485829 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046208 Aug 29 10:43:46.750477 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1041/2131] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:46.755361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.755778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.756293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.756468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:46.757076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.757924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.758489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.759468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.764401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.765086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.765730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.766449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.766905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.767335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.935274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.948485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.958699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:46.963689 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1999d068-5ebb-4770-8e76-0f063ab932ba tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1313 microversion: 2.26 time: 0.208171 Aug 29 10:43:46.964896 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1042/2132] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:46.976698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:46.987162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.988856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.990710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:46.993092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:46.994390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:46.996910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.003999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.014108 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98c24bd4-73d6-4a6d-b505-404cc486dc11 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 200 len: 1472 microversion: 2.1 time: 0.281945 Aug 29 10:43:47.015220 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1091/2133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:47.021209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "79dfe7f0-b18b-4f2f-8bef-721aec20fe1e"}, {"server_uuid": "ec53f44c-01e4-4b61-8350-cea8fd318518", "name": "network-vif-plugged", "status": "completed", "tag": "c8ba2503-ea95-4d77-8cbf-1f5f6030d428"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "844cad02-b496-4a09-975b-2dc20d4c7f00"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-plugged", "status": "completed", "tag": "bd598a4e-a61e-46b1-930c-4d59792d1dcb"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:47.035956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.036812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.037508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.056529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:47.068885 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Creating event network-vif-plugged:79dfe7f0-b18b-4f2f-8bef-721aec20fe1e for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:47.069850 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Creating event network-vif-plugged:c8ba2503-ea95-4d77-8cbf-1f5f6030d428 for instance ec53f44c-01e4-4b61-8350-cea8fd318518 on n-h2-854121-10 Aug 29 10:43:47.071365 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Creating event network-vif-plugged:844cad02-b496-4a09-975b-2dc20d4c7f00 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:47.072537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] Creating event network-vif-plugged:bd598a4e-a61e-46b1-930c-4d59792d1dcb for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:47.085536 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1fd299e2-e867-4ebf-9350-26c0ad181f7d req-9f07ed9a-4771-4085-a45f-010b6540a1ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.068475 Aug 29 10:43:47.086991 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1092/2134] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:47.092643 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1301bfa4-6efc-4252-934b-7b1b89876219 tempest-ServicesAdminTestJSON-181062244 tempest-ServicesAdminTestJSON-181062244-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.126413 Aug 29 10:43:47.093595 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1043/2135] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:47.095233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.096243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.107679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1401731131"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:47.113756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.115137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.117044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.118388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.120983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.122379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.126881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.127474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.127964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.128443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.129144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.129597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.130044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.276453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.293161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.298011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.300760 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0afb72bb-510d-4116-942c-03d746fcce7e tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.210755 Aug 29 10:43:47.316067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1093/2136] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:47.362517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.364146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.390189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.390717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.391751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.392546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.393042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.394639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.603886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-447f0893-f725-423e-b9fd-9eafe583d9e4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81/action" status: 202 len: 0 microversion: 2.1 time: 0.506741 Aug 29 10:43:47.611825 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1044/2137] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:43:47 2022] POST /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:43:47.620130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.621560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.635280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.638600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.639164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.640095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.641808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.642775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.782127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.792502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.794509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.795702 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a785e8e-c486-410c-b5c5-f63ae461f40a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.472210 Aug 29 10:43:47.796556 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1094/2138] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:47.804005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64053dd2-7aa4-41d2-ab21-24412ae2e98e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0e03a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.859746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64053dd2-7aa4-41d2-ab21-24412ae2e98e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.062120 Aug 29 10:43:47.869153 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1095/2139] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:47.876215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.877095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.884316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.885076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.885764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.886793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.887608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.888292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.918746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:47.932141 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a07ce4d9-b2ad-4683-b57d-968f575b04e6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.323227 Aug 29 10:43:47.947517 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1045/2140] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:47.959436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:47.960773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:47.989538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.990505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.991120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:47.992708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:47.994096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:47.994860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.146943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.171563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12220302-9924-4049-98d5-14941ebc90c4 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.291098 Aug 29 10:43:48.186406 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1096/2141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:48.189939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:48.190624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:48.198738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.198738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.200096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.200172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.200612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.201663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.242002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.251485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1f8f42e-4be2-4e60-ae45-b323402ed405 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.301066 Aug 29 10:43:48.257851 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1046/2142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:47 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:48.329913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:48.330575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:48.337332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.337875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.338400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.339110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.339596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.340178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.508922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.522999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.530386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.531679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e172d4e-84b4-4aa6-ac0d-db5ec76582ec tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1366 microversion: 2.57 time: 0.206116 Aug 29 10:43:48.537933 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1047/2143] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:48 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:48.627226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.639252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.640604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:48.642280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-88ac419f-50e4-4672-9fcd-40fb73b3fa21 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.460730 Aug 29 10:43:48.643367 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1097/2144] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:48 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:48.821782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:48.822577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:48.829833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.830476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.831017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.831828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.832528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.833055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.877242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-899fda86-9a95-4750-bbc8-810340e40f76 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb12d040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:48.940265 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-899fda86-9a95-4750-bbc8-810340e40f76 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.068780 Aug 29 10:43:48.941744 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1098/2145] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:48 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:48.962276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:48.964023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:48.973048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.974243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.975802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:48.976868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:48.977604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:48.978266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.232948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:49.246956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:49.252412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:49.258967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06b87ae3-6f9a-49b5-a328-99bd947e5e02 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1874 microversion: 2.42 time: 0.440388 Aug 29 10:43:49.260565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1048/2146] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:48 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1874 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:49.276023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:49.276638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:49.292680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:49.293575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:49.294721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.295584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:49.296184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:49.298312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.331035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:49.346527 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25ad2c9b-4df4-4d36-931a-839921c9298e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1316 microversion: 2.1 time: 0.392298 Aug 29 10:43:49.363368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1099/2147] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:48 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:49.380159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-plugged", "status": "completed", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:49.400992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:49.401481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:49.402847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.434662 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] Creating event network-vif-plugged:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:43:49.444476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f61a8084-42f0-40fd-9135-7ddc69bb264a req-b5d0c392-f0c9-4ea3-b675-e41e8a403d55 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079727 Aug 29 10:43:49.447833 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1100/2148] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:49.465530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:49.473310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:49.482967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:49.486226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:49.486993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:49.487806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.488984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:49.489868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:49.490760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:49.943638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:49.958563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fba20270-4ab8-41c4-be40-21c08db1a0f0 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.694336 Aug 29 10:43:49.963478 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1049/2149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:49 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:49.972097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:49.974628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:50.008225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.009165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.025485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.026829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.029684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.030327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.069963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.083096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b72a6455-087b-42e0-b103-9213f643f739 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.633822 Aug 29 10:43:50.083846 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1101/2150] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:49 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:50.097060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:50.099240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:50.119297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.126727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.127532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.129748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.137394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.147331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.520675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.543125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.565649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.569576 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-93a04d7b-f29f-4666-9bd7-ef4e02f32b60 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.482905 Aug 29 10:43:50.585138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1102/2151] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:50 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:50.604737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-973e2dd1-50c0-4b3a-beb6-d0971ea39db0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb1a6f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:50.648515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.661185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.669716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:50.671573 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9533a371-5a23-48e0-ab6a-3fd61cf2afd9 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1372 microversion: 2.57 time: 0.710905 Aug 29 10:43:50.672605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1050/2152] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:49 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1372 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:50.677867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:50.678671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:50.685502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.686883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.687478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.688338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.688929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.689815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.713441 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-973e2dd1-50c0-4b3a-beb6-d0971ea39db0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.125480 Aug 29 10:43:50.717288 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1103/2153] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:50 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:50.728055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:50.728890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:50.737365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.737970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.738390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:50.739173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:50.739670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:50.740068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.052785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.066745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.068241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.069514 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b41d398a-43a3-4a9b-bfef-5f198588a28f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2831 microversion: 2.42 time: 0.395626 Aug 29 10:43:51.070107 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1051/2154] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:50 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2831 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:51.091109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413da2fb-4ac9-4f14-a99c-614b7b23c672", "tag": "28b82e4e-c4f7-418a-809a-4312e9003a55"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:51.123742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.124246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.126010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.149823 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] Creating event network-changed:28b82e4e-c4f7-418a-809a-4312e9003a55 for instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 on n-h2-854121-10 Aug 29 10:43:51.163446 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-308d4128-5685-4e25-b39a-49b50ed0c27a req-bc4c7068-8ff3-4cfb-91a8-a794faa6dedc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088977 Aug 29 10:43:51.164672 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1052/2155] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:51.180082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.192820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:51.196287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.205316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.205667 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b63ef22-748d-4bd1-bb22-8e64ae53e84d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1466 microversion: 2.1 time: 0.487274 Aug 29 10:43:51.206181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.207098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.207995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.208596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.209270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.222993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1104/2156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:50 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1466 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:51.236711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.237225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:51.250802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.251542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.252209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.253125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.253875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.254645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.455899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ccaad932-207e-4a54-8c59-5c40338f40a3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.230071 Aug 29 10:43:51.456503 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1105/2157] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6/os-interface => generated 1831 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:51.464320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.465628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:51.473970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.474648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.475249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.476210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.476898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.477485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.570829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.581251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28f4b2b1-2030-4788-a473-73a261b2df77 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1317 microversion: 2.1 time: 0.415168 Aug 29 10:43:51.582511 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1053/2158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:51.693803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:51.712513 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52bcef74-a65f-4d6e-bf04-c8a2dca1fbca tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.252321 Aug 29 10:43:51.713956 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1106/2159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:51.843294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d37505df-2ad4-43ff-8456-23d36443f4a7 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.857186 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d37505df-2ad4-43ff-8456-23d36443f4a7 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.138689 Aug 29 10:43:51.861052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1107/2160] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:51.875965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.878650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:51.882505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:51.883266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:51.887479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.887971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.888704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.889559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.890199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.890778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.892202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.892697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.894219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:51.896010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:51.898149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:51.901000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.173185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.194019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.196145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.197715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-755dfa9d-805c-4027-9faf-9624f694e1d3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.335325 Aug 29 10:43:52.216839 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1108/2161] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:52.226328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.227614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:52.234698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:52.235511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:52.236316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.237833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:52.238617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:52.239334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.545984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.567143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.569621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:52.571103 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02785399-8939-4872-b754-0f88e0ced645 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1372 microversion: 2.57 time: 0.352108 Aug 29 10:43:52.586889 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1109/2162] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:52.595783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25e032ba-82b4-4c46-afe4-439d851ede5b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0e0b80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.668949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25e032ba-82b4-4c46-afe4-439d851ede5b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.080329 Aug 29 10:43:52.670289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1110/2163] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:52.675242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd385108-5df1-4bc8-b14e-441152cadf02 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.698898 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd385108-5df1-4bc8-b14e-441152cadf02 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027218 Aug 29 10:43:52.709960 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1111/2164] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:52.716966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "name": "network-vif-plugged", "status": "completed", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:52.728260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:52.729274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:52.729960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.749715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] Creating event network-vif-plugged:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:43:52.758720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a1409aac-1ac5-4358-8cac-5e5c76f3a6e9 req-7e02fe63-fcfb-4c18-a297-19ac4a306338 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046484 Aug 29 10:43:52.760021 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1112/2165] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:52.779173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.782994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:52.791758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:52.794552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:52.795588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.796559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:52.797044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:52.797482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:52.805003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:52.927868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ea3b416-3a46-4e89-ac5b-015aee04ed13 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1619 microversion: 2.1 time: 1.344046 Aug 29 10:43:52.933276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1054/2166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:51 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1619 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:52.943298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-20fd8275-3be0-477b-ba82-1b139545b28f tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.956779 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-20fd8275-3be0-477b-ba82-1b139545b28f tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021369 Aug 29 10:43:52.965150 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1055/2167] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:52.988273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:52.994944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:53.005331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.006206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.007510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.008494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.009203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.009969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.202553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.211648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f23e6c9d-961a-4c2f-bc9b-79415eed0b3e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1467 microversion: 2.1 time: 0.448881 Aug 29 10:43:53.217237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1113/2168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1467 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:53.227963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: .version_select at 0x7f66cb13eaf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-709940621", "policies": ["affinity"]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:53.253432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:53.259244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:53.271454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.282648 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b768bd73-dd78-4796-ba9c-355a0cde896f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.315784 Aug 29 10:43:53.283313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1056/2169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:52 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:53.288286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f123383a-2390-449c-b542-106ed9fde490 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:53.299132 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f123383a-2390-449c-b542-106ed9fde490 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014705 Aug 29 10:43:53.300250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1057/2170] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:53.305976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:53.308008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:53.316469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.317483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.318342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.319612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.320631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.321453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.351960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:53.367075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:53.410461 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a4aca47-270c-425c-9101-b68914032f20 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.187299 Aug 29 10:43:53.411453 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1114/2171] 10.222.0.47 () {60 vars in 1174 bytes} [Mon Aug 29 10:43:53 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:53.419992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-936683218", "metadata": {"image_type": "test"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:53.426638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:53.442161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.442161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.443098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.443485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.444022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.444389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.526654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Getting quotas for project 5a0d634d151046a89a49c4e938d8dc36. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:53.541283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Getting quotas for user c51da1350111427ab3fe355344743f4e and project 5a0d634d151046a89a49c4e938d8dc36. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:53.562983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.575660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.577438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.579554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b210e72a-062a-4a17-8762-a7bca07f978f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.278181 Aug 29 10:43:53.580785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1058/2172] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:53.586279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-610583f7-5818-4928-adf2-d30c5b8e401f tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:53.632517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-610583f7-5818-4928-adf2-d30c5b8e401f tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.049878 Aug 29 10:43:53.633318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1059/2173] 10.222.0.47 () {58 vars in 1165 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:53.638108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "tag": "3753f968-91c5-486f-a765-2dc4bc69f280"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:53.649835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.650323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.650759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.668349 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] Creating event network-changed:3753f968-91c5-486f-a765-2dc4bc69f280 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:43:53.673593 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-06b2e710-947d-4100-b19d-22efc89113dd req-35056296-db27-42ba-a96b-083cbcf90610 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039033 Aug 29 10:43:53.674996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1060/2174] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:53.683916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:53.684642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:53.701585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.702135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.702594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.703328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:53.703789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:53.704222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:53.864308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.874494 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7480ffc-7011-4369-b0db-b2c569c25f2a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "POST /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266/action" status: 202 len: 0 microversion: 2.1 time: 0.460996 Aug 29 10:43:53.880491 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1115/2175] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:43:53 2022] POST /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:43:53.891811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2000547319", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1f419406-5edc-4369-a31c-ce1bac533a3c"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:53.899166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.909086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:53.910854 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3dd367e4-3ed7-45f1-9bc8-47b91da02936 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1357 microversion: 2.57 time: 0.234369 Aug 29 10:43:53.936343 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1061/2176] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:53.947750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1cd6bfb-cf52-4e6e-84c3-c03f582e7d39 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:53.969410 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1cd6bfb-cf52-4e6e-84c3-c03f582e7d39 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031883 Aug 29 10:43:53.995396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:43:53.997747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1062/2177] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:54.002783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8bb1ffc6-7202-456d-931d-f3e3b7528116 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cafecb80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:54.077588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8bb1ffc6-7202-456d-931d-f3e3b7528116 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.078453 Aug 29 10:43:54.078488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1063/2178] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:53 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:54.084496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6017c0e3-ba06-4b95-85b6-443f070b79d3 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6664d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:54.159588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6017c0e3-ba06-4b95-85b6-443f070b79d3 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 0.078447 Aug 29 10:43:54.166848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1064/2179] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:54 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:54.174410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:54.175260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:54.185524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:54.190364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:54.190831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:54.192873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:54.193653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:54.194160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:54.232758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:43:54.294907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:54.403862 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ddda999b-a64a-4a49-8c29-cd152c610613 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 204 len: 0 microversion: 2.57 time: 0.241011 Aug 29 10:43:54.408978 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1065/2180] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:43:54 2022] DELETE /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:43:54.415260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab423d04-9393-4a01-a1ef-a54db7fdb380 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:54.459072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab423d04-9393-4a01-a1ef-a54db7fdb380 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.048652 Aug 29 10:43:54.472698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1066/2181] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Aug 29 10:43:54 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:54.478563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:54.479501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:54.491705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:54.492462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:54.492913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:54.493682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:54.494175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:54.494600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:54.916209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:43:54.917283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:43:54.918696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:43:54.919326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:43:54.920521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:43:54.930710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:54.968722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e4c68b25-6478-48bf-8df7-5705ba26d7a5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1323 microversion: 2.1 time: 0.477708 Aug 29 10:43:54.969408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1067/2182] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:54 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:54.994776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:54.995370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:54.998559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:54.999254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.000760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.001382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.001940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.003769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:55.015540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.016030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.020696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.022799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.023384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.024879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.044434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:55.050511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:55.067704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 2 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:43:55.070505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:55.120557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.122946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128681) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 10:43:55.135248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.136717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.146256 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2275796-52a6-4173-a54b-eee88329f45f tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1363 microversion: 2.57 time: 0.175634 Aug 29 10:43:55.146844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1068/2183] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:54 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:55.166445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:55.174151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-60693c52-2d64-4445-9f32-401bc15f6658 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.176834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:55.206832 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-60693c52-2d64-4445-9f32-401bc15f6658 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.040750 Aug 29 10:43:55.207848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1069/2184] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:55.213720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.215028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:55.222664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.223866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.224511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.225517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.226203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.226828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.233337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:55.243598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:55.246654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:55.263191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=7f4059b0-58e5-40ba-babf-443bc0659909,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:43:55.336665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:55.344022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:55.396368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:43:55.408195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:43:55.456692 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-afc14584-b817-46a8-a6a7-4b2e92055002 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.574795 Aug 29 10:43:55.458000 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1116/2185] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:43:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 1577 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:43:55.463400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893f51a-b42d-4a2b-8b42-3dbdbd98cf81", "name": "network-vif-plugged", "status": "completed", "tag": "11aab3cc-bb00-494c-b28e-668948b08f8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:55.477215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.478005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.478782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.482884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.491920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.493376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.493651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] Creating event network-vif-plugged:11aab3cc-bb00-494c-b28e-668948b08f8c for instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 on n-h1-854121-10 Aug 29 10:43:55.494557 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1cac2765-b3d2-42c2-bdc2-a87e073d4254 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.285577 Aug 29 10:43:55.495125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1070/2186] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:55.514366 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-16b1c24b-ad70-4ba4-a8a9-502fdc8feb68 req-9869d66d-d2fd-42dd-b270-29a1cb210dde service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054308 Aug 29 10:43:55.518546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a9b974c-756c-4826-8a4d-31ab8b4c4b05 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c66e18b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.519804 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1117/2187] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:55.525687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c34305b2-62a4-469e-b761-7ef8d5d45464 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c731c430>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.629451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a9b974c-756c-4826-8a4d-31ab8b4c4b05 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.120086 Aug 29 10:43:55.644260 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1071/2188] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:55.648699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:43:55.658431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0bf4822d-7803-4a6f-afc1-571fa9ef3182 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.671795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c34305b2-62a4-469e-b761-7ef8d5d45464 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 0.149716 Aug 29 10:43:55.676038 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0bf4822d-7803-4a6f-afc1-571fa9ef3182 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029838 Aug 29 10:43:55.677182 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1072/2189] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:55.679893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1118/2190] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:55.682765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.688551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:55.689689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Searching by: {'deleted': False, 'project_id': '0c15797a6a384952a37fe2ca744e22a3'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:43:55.704337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f9304e8-1545-4040-9245-a1f558442936 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.711325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.711956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.712467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.713277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:55.713863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:55.714561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:55.793924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:43:55.816073 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f9304e8-1545-4040-9245-a1f558442936 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.120854 Aug 29 10:43:55.818476 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1119/2191] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:55.836814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e2479173-9c3e-4965-8f6b-027b7caab962 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.851743 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-12fdfc32-26cf-441a-b752-fdc3c6fafcc8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.172792 Aug 29 10:43:55.853012 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1073/2192] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/servers => generated 1003 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:55.865733 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e2479173-9c3e-4965-8f6b-027b7caab962 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034097 Aug 29 10:43:55.866896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1120/2193] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:55.867153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b3fb4227-b4d4-4d82-b979-66a3d923633d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.867914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b3fb4227-b4d4-4d82-b979-66a3d923633d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:55.880095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4584c4d4-3c00-4039-a7cc-de4bc5532e94 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.919276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4584c4d4-3c00-4039-a7cc-de4bc5532e94 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042177 Aug 29 10:43:55.921066 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1121/2194] 10.222.0.47 () {58 vars in 1144 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:55.947319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4542a80d-f974-4981-ba8e-f491a99add02 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:55.963799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4542a80d-f974-4981-ba8e-f491a99add02 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030865 Aug 29 10:43:55.965812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1122/2195] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:43:55.977523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5001c651-3bd0-4c41-a9fd-490a7af0ec76 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.015833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b3fb4227-b4d4-4d82-b979-66a3d923633d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:56.025515 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b3fb4227-b4d4-4d82-b979-66a3d923633d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1219 microversion: 2.1 time: 0.162870 Aug 29 10:43:56.041612 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1074/2196] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:43:56.041831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5001c651-3bd0-4c41-a9fd-490a7af0ec76 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.059498 Aug 29 10:43:56.050104 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1123/2197] 10.222.0.47 () {58 vars in 1148 bytes} [Mon Aug 29 10:43:55 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:56.055921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fffbe068-3fa9-454b-9ae0-a8d754ceabba tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.060001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.065385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:56.097334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.097922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.098364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.101178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fffbe068-3fa9-454b-9ae0-a8d754ceabba tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.047328 Aug 29 10:43:56.101935 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1124/2198] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:56.102802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.105611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.105611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.117915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a30fd06e-fda1-4cf2-b871-25bb56c5ed29 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.126695 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a30fd06e-fda1-4cf2-b871-25bb56c5ed29 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012663 Aug 29 10:43:56.127453 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1125/2199] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:56.140131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e334a40a-bd64-466e-8e50-35090d599f20 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.167180 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e334a40a-bd64-466e-8e50-35090d599f20 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.028959 Aug 29 10:43:56.178105 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1126/2200] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:56.184016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.184404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:56.191696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.192015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.192239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.192960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.193414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.193880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.239272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.240065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.240649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.241248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lazy-loading 'fault' on Instance uuid 74213bcd-07ff-4ad1-b063-c74aacb98454 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:43:56.392120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:56.409195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:56.412606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b441d6daac1451ca082d9e6bf6db5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0963e8f9d6be4f87afd6cc74e2c7f128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:56.416630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bffe4ed8-76be-455a-95e3-538dac20fb5d tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 200 len: 1368 microversion: 2.57 time: 0.237269 Aug 29 10:43:56.437001 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1127/2201] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:56.446685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-18541faa-72bd-4ca8-8e8f-ce42d141fe75 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.476121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-18541faa-72bd-4ca8-8e8f-ce42d141fe75 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037885 Aug 29 10:43:56.476732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1128/2202] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:56.495594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77bf25ae-3d4c-4685-aa31-87049ac938c9 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.505896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77bf25ae-3d4c-4685-aa31-87049ac938c9 tempest-FlavorsV2TestJSON-1000608002 tempest-FlavorsV2TestJSON-1000608002-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014126 Aug 29 10:43:56.514416 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1129/2203] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:43:56.528785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:56.529411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:43:56.537876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.538378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.540191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.545836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:43:56.584480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:43:56.584480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:43:56.584611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:56.593727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-631f0b3e-a578-40b2-8d24-7f569e94df52 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1519 microversion: 2.1 time: 0.564961 Aug 29 10:43:56.613843 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1075/2204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1519 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:56.642930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ce05b28-7e1f-4538-8b9d-83158a77e386 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'create', calling method: .version_select at 0x7f66cafec940>, body: {"pool": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:43:57.747719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:57.759291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:57.760744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:43:57.762144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a506a29e-b7b9-4f83-9292-5667b8c6aee7 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 1.245867 Aug 29 10:43:57.782536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1130/2205] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:43:56 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:43:57.787640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b3e457c-a81d-4053-a22f-6eb0d46c1354 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c74018b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:43:57.922459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b3e457c-a81d-4053-a22f-6eb0d46c1354 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1414 microversion: 2.1 time: 0.138698 Aug 29 10:43:57.923287 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1131/2206] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:57 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:43:57.953098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-394abea9-d180-4c87-9a85-0fb9dc5a1149 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c71f5280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:01.757211 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ce05b28-7e1f-4538-8b9d-83158a77e386 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.141609 Aug 29 10:44:01.759326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1076/2207] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 10:43:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:01.788436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:01.789181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:01.813465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:01.815659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:01.816463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:01.819294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:01.826493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:01.829449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:02.383160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:02.397740 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e1834a4-dd2c-41b0-9851-4436eed2bf5b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1319 microversion: 2.1 time: 0.636775 Aug 29 10:44:02.399862 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1077/2208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:01 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:02.413603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:02.414914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] [instance: 74213bcd-07ff-4ad1-b063-c74aacb98454] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:02.433479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:02.435666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:02.437291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:02.441035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:02.441976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:02.444303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:02.485360 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] HTTP exception thrown: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Request method failure captured: Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 HTTP/1.1 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhBV1wQyUYiEZjbVUsNFBXJjw8twyEDsev8IrEcOgkGOq-u-IMXzBmQ8abn6I5IDUzl_GavLcFKBfFHYilYQaPXsJHZTAvyXPSYUlhxruHrYM3VuuN12v5sYtUFJ4Bav0C8cNwX8nL1h6nk3OGyJMzrglxwbaQba1tAWOrSPONj9oo Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.57 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0963e8f9d6be4f87afd6cc74e2c7f128 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerShowV257Test-1117334314 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0963e8f9d6be4f87afd6cc74e2c7f128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0963e8f9d6be4f87afd6cc74e2c7f128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0963e8f9d6be4f87afd6cc74e2c7f128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0963e8f9d6be4f87afd6cc74e2c7f128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerShowV257Test-1117334314 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0963e8f9d6be4f87afd6cc74e2c7f128 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerShowV257Test-1117334314 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerShowV257Test-1117334314-project Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4b441d6daac1451ca082d9e6bf6db5c8 Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerShowV257Test-1117334314-project Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '74213bcd-07ff-4ad1-b063-c74aacb98454'} Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:02.491686 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. Aug 29 10:44:02.496252 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:02.499449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] Returning 404 to user: Instance 74213bcd-07ff-4ad1-b063-c74aacb98454 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:44:02.501820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9fb9d948-a493-4d7c-b742-5240d02aa708 tempest-ServerShowV257Test-1117334314 tempest-ServerShowV257Test-1117334314-project] 10.222.0.47 "GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454" status: 404 len: 111 microversion: 2.57 time: 0.100706 Aug 29 10:44:02.504235 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1078/2209] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:02 2022] GET /compute/v2.1/servers/74213bcd-07ff-4ad1-b063-c74aacb98454 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:44:02.516824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:02.520916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:02.541040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:02.541872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:02.542459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:02.545290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:02.545990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:02.546584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:03.006915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:03.021069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:03.024794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:03.028206 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8834128b-a3b4-4ba7-86b0-4ef28a67f543 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.520859 Aug 29 10:44:03.030335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1079/2210] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:02 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:03.039466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0304e3dd-bf74-4e2f-9b6b-b2e84ce9eddd tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c670b0d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:05.019000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:05.417563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=42 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:05.730228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:06.021335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:06.534055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:07.757950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:09.041156 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-394abea9-d180-4c87-9a85-0fb9dc5a1149 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 11.107788 Aug 29 10:44:09.042027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1132/2211] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:43:57 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 11110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:09.052805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-plugged", "status": "completed", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:09.056466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0304e3dd-bf74-4e2f-9b6b-b2e84ce9eddd tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1423 microversion: 2.1 time: 6.023303 Aug 29 10:44:09.057223 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1080/2212] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:03 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1423 bytes in 6025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:09.071408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1478510555", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:09.089283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.092447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.095031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.124452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] Creating event network-vif-plugged:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:44:09.142409 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-981ea5f9-762a-4662-8b7a-5751474eadfa req-91a0b42d-879d-4e74-b580-bd18354b98cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096125 Aug 29 10:44:09.149663 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1133/2213] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:09.174918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b415ddf9-7fc5-48dd-af90-1de9fa32c200", "tag": "240718b5-03c6-4744-a898-e106aec650d7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:09.197649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] validate_networks() for [('bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:09.221408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.221933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.222376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.236393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] Creating event network-changed:240718b5-03c6-4744-a898-e106aec650d7 for instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 on n-h1-854121-10 Aug 29 10:44:09.246686 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3575780f-fce3-43ea-bcaa-58ba84576607 req-85595070-2a02-4c73-8728-c7c729e65e36 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095152 Aug 29 10:44:09.248008 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1134/2214] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:09.253463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:09.254438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:09.262214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.262970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.263580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.264484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.264951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.265420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.581726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:09.598246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-59f648ee-aef4-4736-ab2e-93272bd4461e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1319 microversion: 2.1 time: 0.346616 Aug 29 10:44:09.617740 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1135/2215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:09 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:09.634272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4059b0-58e5-40ba-babf-443bc0659909", "tag": "e9105456-8e3a-4917-884a-68fa1f352f2e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:09.659766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.660426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.661051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.685534 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] Creating event network-changed:e9105456-8e3a-4917-884a-68fa1f352f2e for instance 7f4059b0-58e5-40ba-babf-443bc0659909 on n-h1-854121-10 Aug 29 10:44:09.694825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3a11269b-752c-42f9-b97a-dc77add65f05 req-dd9f3eaf-f521-488a-8e32-13cc0052ff87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075495 Aug 29 10:44:09.698136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1136/2216] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:09.713039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:09.721536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:09.738978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.739757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.740389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:09.741473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:09.742130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:09.742718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:10.376582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:10.390206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:10.393872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:10.398938 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b85ee2bd-1ad1-40d9-93a7-d2c3b3a56095 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 0.699398 Aug 29 10:44:10.399748 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1137/2217] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:09 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:10.410212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0a07670-e8f3-4c1b-8c15-dc7bee2f84a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c71953a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:10.540047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:10.540586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:10.540953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:10.541680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:10.542300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:10.558297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:10.559756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:10.561290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:10.564373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:10.568083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:10.568776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:10.641572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Getting quotas for project 454c5d1e28064c4794db28a10ee5a012. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:10.653326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:10.657661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Getting quotas for user 615f56cde3bf42649a599f66eaeaca6f and project 454c5d1e28064c4794db28a10ee5a012. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:10.705446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:10.714173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:10.870203 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01d640da-e4fa-498e-987f-e6eb7b38926d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812021 Aug 29 10:44:10.881140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1081/2218] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:10.894663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ea8b4ff6-51b7-4d7d-a9ee-a2cf5304c593 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c670bca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:10.989992 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0a07670-e8f3-4c1b-8c15-dc7bee2f84a4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 200 len: 1423 microversion: 2.1 time: 0.589009 Aug 29 10:44:10.990958 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1138/2219] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:10 2022] GET /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 1423 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:11.011410 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ea8b4ff6-51b7-4d7d-a9ee-a2cf5304c593 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 0.126705 Aug 29 10:44:11.020697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1082/2220] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:10 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:11.022552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:11.023605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:11.036143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8cfe119-fff6-4588-bf1d-294d727b4f1b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66ba670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:11.043285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:11.044239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:11.045416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:11.047087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:11.048107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:11.048734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:11.114092 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8cfe119-fff6-4588-bf1d-294d727b4f1b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe" status: 200 len: 662 microversion: 2.1 time: 0.091992 Aug 29 10:44:11.123278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1083/2221] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:11 2022] GET /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:11.134322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3dad05c-e01f-4a64-89b6-d117810635c7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:11.138358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3dad05c-e01f-4a64-89b6-d117810635c7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:11.327195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e3dad05c-e01f-4a64-89b6-d117810635c7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:11.348177 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3dad05c-e01f-4a64-89b6-d117810635c7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1224 microversion: 2.1 time: 0.227754 Aug 29 10:44:11.351331 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1084/2222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:11 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1224 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:11.363061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86038565-3df4-4581-9ad0-67b79a16190a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66caff15e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:11.432686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:11.442471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54bde429-746f-4e5b-971a-14bb45e1ceb6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1319 microversion: 2.1 time: 0.447830 Aug 29 10:44:11.449099 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1139/2223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:10 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:11.469667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09fce493-765c-46f5-be51-54aa28845ff9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c724c160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:12.568586 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86038565-3df4-4581-9ad0-67b79a16190a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 204 len: 0 microversion: 2.1 time: 1.215615 Aug 29 10:44:12.572309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1085/2224] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:11 2022] DELETE /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 0 bytes in 1217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:12.576980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413da2fb-4ac9-4f14-a99c-614b7b23c672", "name": "network-vif-plugged", "status": "completed", "tag": "28b82e4e-c4f7-418a-809a-4312e9003a55"}, {"server_uuid": "b415ddf9-7fc5-48dd-af90-1de9fa32c200", "name": "network-vif-plugged", "status": "completed", "tag": "240718b5-03c6-4744-a898-e106aec650d7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:12.607848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:12.609565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:12.610183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:12.630528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Creating event network-vif-plugged:28b82e4e-c4f7-418a-809a-4312e9003a55 for instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 on n-h2-854121-10 Aug 29 10:44:12.632006 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] Creating event network-vif-plugged:240718b5-03c6-4744-a898-e106aec650d7 for instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 on n-h1-854121-10 Aug 29 10:44:12.643190 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5c4e092e-e3be-4863-995f-bff6af907d70 req-a7a64e38-e8df-43e9-bb6f-9924eecf7c91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071942 Aug 29 10:44:12.644635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1086/2225] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:12.651425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:12.653445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:12.663007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:12.663834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:12.664493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:12.666081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:12.666686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:12.667431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:13.052266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09fce493-765c-46f5-be51-54aa28845ff9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe" status: 200 len: 662 microversion: 2.1 time: 1.587152 Aug 29 10:44:13.054603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1140/2226] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:11 2022] GET /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe => generated 662 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:13.060820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b28db2e4-b70a-40ac-b423-c9e9232bf0ec tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c7485700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:13.311999 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b28db2e4-b70a-40ac-b423-c9e9232bf0ec tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 0.256091 Aug 29 10:44:13.325294 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1141/2227] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:13 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:13.332862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:13.334056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:13.342651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:13.343655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:13.344451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:13.345397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:13.347160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:13.347881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:13.723974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:13.743645 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-517870b9-cd80-4485-88e4-539e176c0ff3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1284 microversion: 2.1 time: 0.416573 Aug 29 10:44:13.744840 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1142/2228] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:13 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1284 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:13.751453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:13.752251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:13.763443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:13.764173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:13.770597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:13.771660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:13.772297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:13.772885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:14.207832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:14.218009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:14.223481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:14.231566 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ee0e0fc-6dbd-4eb2-9495-40310ee33324 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1361 microversion: 2.26 time: 1.584697 Aug 29 10:44:14.232829 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1087/2229] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:12 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1361 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:14.251632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:14.252515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:14.265478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:14.266009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:14.266452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:14.267375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:14.268232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:14.268866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:14.348162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:44:14.357379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:14.373517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35bc414f-bc4d-45c0-a393-78ba02885b05 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1319 microversion: 2.1 time: 0.625229 Aug 29 10:44:14.388116 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1143/2230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:13 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:14.401332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7093bf7e-c8ac-4729-9c9a-1402ecb027ce tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c7401310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:14.622860 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b721706-fbcf-4b81-a3fe-be4cede41e65 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 204 len: 0 microversion: 2.1 time: 0.388480 Aug 29 10:44:14.628382 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1088/2231] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:44:14 2022] DELETE /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:14.720856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893f51a-b42d-4a2b-8b42-3dbdbd98cf81", "name": "network-vif-unplugged", "status": "completed", "tag": "11aab3cc-bb00-494c-b28e-668948b08f8c"}, {"server_uuid": "7f4059b0-58e5-40ba-babf-443bc0659909", "name": "network-vif-plugged", "status": "completed", "tag": "e9105456-8e3a-4917-884a-68fa1f352f2e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:14.776348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:14.776905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:14.777390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:14.810902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Creating event network-vif-unplugged:11aab3cc-bb00-494c-b28e-668948b08f8c for instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 on n-h1-854121-10 Aug 29 10:44:14.816821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] Creating event network-vif-plugged:e9105456-8e3a-4917-884a-68fa1f352f2e for instance 7f4059b0-58e5-40ba-babf-443bc0659909 on n-h1-854121-10 Aug 29 10:44:14.876164 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c94e0289-a1dd-470e-809d-4939e0e14968 req-f0661eb3-beab-4693-9ed7-632db5eb5d42 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.172713 Aug 29 10:44:14.886639 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1089/2232] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:44:14.937831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:14.937831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:14.972532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:14.980892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:14.980892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:14.980892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:14.980892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:14.980892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:15.175957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7093bf7e-c8ac-4729-9c9a-1402ecb027ce tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1423 microversion: 2.1 time: 0.782230 Aug 29 10:44:15.182288 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1144/2233] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:14 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1423 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:15.198056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1866062950", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "f0e277bb-7983-4d32-9041-e842f755bb17"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:15.345340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] validate_networks() for [('f0e277bb-7983-4d32-9041-e842f755bb17', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:15.367863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:15.380742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da80d886-6767-4f09-99b0-a8ab6442b770 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.485547 Aug 29 10:44:15.383720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1090/2234] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:14 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:15.405756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24b214e1-8535-4a9d-b16f-73ebb7aea673 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb08fe50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:15.539520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24b214e1-8535-4a9d-b16f-73ebb7aea673 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989" status: 200 len: 662 microversion: 2.1 time: 0.152262 Aug 29 10:44:15.540143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1091/2235] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:15 2022] GET /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989 => generated 662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:15.553230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:15.566882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:15.579869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:15.580483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:15.580880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:15.581743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:15.582229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:15.582646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.261393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:16.279200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:16.287542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:16.289243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa325cac-933d-4efc-ac08-ad9d47605225 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1544 microversion: 2.26 time: 0.747756 Aug 29 10:44:16.291340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1092/2236] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:15 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1544 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:16.300937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:16.304741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:16.326975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.328920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.330275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.337959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.338475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.338925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.726029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:16.736686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9122e4ec-cf12-43b5-aef1-2006db3e4184 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1468 microversion: 2.1 time: 0.444131 Aug 29 10:44:16.738052 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1093/2237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:16 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1468 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:16.742951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9244421f-73c9-4cad-81df-36ab6ad19c73 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb08f820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:16.803055 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9244421f-73c9-4cad-81df-36ab6ad19c73 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989" status: 200 len: 662 microversion: 2.1 time: 0.063048 Aug 29 10:44:16.813929 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1094/2238] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:16 2022] GET /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989 => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:16.814097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:16.814696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:16.814959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:16.815445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:16.815871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:16.821680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-804abe91-5c2a-4941-a872-f5595bf1aab8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb0eb1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:16.835925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.841867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.843957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.845297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.848462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.850638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.907230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:16.926359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for user e2bcddcae75e410786962c142abebf34 and project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:16.926786 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-804abe91-5c2a-4941-a872-f5595bf1aab8 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1432 microversion: 2.1 time: 0.111535 Aug 29 10:44:16.943289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1095/2239] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:16 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1432 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:16.948402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb08f820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:16.953424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:16.957000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:16.965608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.966511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.967160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.968038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:16.975976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.976922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.977556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:16.978766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:16.979708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:16.980338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.016282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:17.025931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.026492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.026939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.047389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.047885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.048500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.055138 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d94ab42c-9c22-4398-9227-c4ddf40ca1a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871717 Aug 29 10:44:17.056842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1145/2240] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:17.072768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.074468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:17.084348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:17.103816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.104483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.104940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.109453 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad5d83de-8eb8-486c-a35a-789d9b8728bf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1810540015" status: 201 len: 0 microversion: 2.26 time: 0.164927 Aug 29 10:44:17.110262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.110603 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1096/2241] 10.222.0.47 () {62 vars in 1380 bytes} [Mon Aug 29 10:44:16 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1810540015 => generated 0 bytes in 166 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 10:44:17.111105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.112007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.115302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817fec32-3127-4f17-90cc-e74790899f58", "tag": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:17.130430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.131084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.131920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.151686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] Creating event network-changed:7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742 for instance 817fec32-3127-4f17-90cc-e74790899f58 on n-h2-854121-10 Aug 29 10:44:17.159389 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3f8f8954-fcbb-4cb6-b2bc-b315b4f1554d req-a07257f2-a005-4962-9d55-fa6908b8f786 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047120 Aug 29 10:44:17.160376 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1097/2242] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:17.166306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.167116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:17.175505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.176010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.176454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.177170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.177721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.178144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.580666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:17.591831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00229067-fdb3-458c-b9de-0d1de46bbe4d tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.530557 Aug 29 10:44:17.598359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:17.603364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1146/2243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:17.611518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d255bd8-10fb-4d0b-9c56-6eb68b3fd7b7 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c76f0ca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.622820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8aed2c3e-4739-454e-a385-16267212122d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1319 microversion: 2.1 time: 0.461082 Aug 29 10:44:17.623806 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1098/2244] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:17.633474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ffadf3b-7755-458d-94ba-17c206e8975f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.634297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ffadf3b-7755-458d-94ba-17c206e8975f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:17.715877 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6d255bd8-10fb-4d0b-9c56-6eb68b3fd7b7 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 200 len: 1432 microversion: 2.1 time: 0.107634 Aug 29 10:44:17.718220 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1147/2245] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 1432 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:17.730058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0e59ea1-0b7e-446e-9622-6de4385dcf61 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c762fdc0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.758543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0e59ea1-0b7e-446e-9622-6de4385dcf61 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.763222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0e59ea1-0b7e-446e-9622-6de4385dcf61 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.763864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0e59ea1-0b7e-446e-9622-6de4385dcf61 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.834348 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0e59ea1-0b7e-446e-9622-6de4385dcf61 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1810540015" status: 204 len: 0 microversion: 2.26 time: 0.114455 Aug 29 10:44:17.835016 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1148/2246] 10.222.0.47 () {60 vars in 1361 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1810540015 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:17.846156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.849153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:17.867811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.868686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.869376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.875949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ffadf3b-7755-458d-94ba-17c206e8975f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:17.884060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ffadf3b-7755-458d-94ba-17c206e8975f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1208 microversion: 2.1 time: 0.258972 Aug 29 10:44:17.885393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.900357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.900567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.901749 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1099/2247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1208 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:17.920441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb0eb1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:17.947206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.947811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.948960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.949599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:17.971088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.991548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:17.992227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:17.993061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:17.993881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.000306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.053567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.054334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.055131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.090689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:18.114187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b4255687-c4d1-47bd-97ff-54778c68e926 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 204 len: 0 microversion: 2.26 time: 0.206189 Aug 29 10:44:18.120129 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1100/2248] 10.222.0.47 () {60 vars in 1295 bytes} [Mon Aug 29 10:44:17 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:18.126562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-935b3783-aca9-450a-9a12-080f5646b526 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c670b3a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.135304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935b3783-aca9-450a-9a12-080f5646b526 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.135815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935b3783-aca9-450a-9a12-080f5646b526 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.136260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-935b3783-aca9-450a-9a12-080f5646b526 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.148157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-935b3783-aca9-450a-9a12-080f5646b526 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 12 microversion: 2.26 time: 0.026581 Aug 29 10:44:18.149557 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1101/2249] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:18.159867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb0e6940>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.173172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.174812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.175459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.176660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:18.185493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.186620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.187405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.188320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.188964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.189587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.236011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.236515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.237179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.248966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.250138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.250777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.286146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:18.305016 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-142e79be-0d15-40a1-b477-26c2ce336376 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-119987042" status: 201 len: 0 microversion: 2.26 time: 0.149124 Aug 29 10:44:18.305823 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1102/2250] 10.222.0.47 () {62 vars in 1377 bytes} [Mon Aug 29 10:44:18 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-119987042 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 29 10:44:18.316853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3eb0f7d-1c6f-4e14-8b1b-c451c995b953 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c66ba5e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.325197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3eb0f7d-1c6f-4e14-8b1b-c451c995b953 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.325969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3eb0f7d-1c6f-4e14-8b1b-c451c995b953 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.326403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3eb0f7d-1c6f-4e14-8b1b-c451c995b953 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.336385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3eb0f7d-1c6f-4e14-8b1b-c451c995b953 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 35 microversion: 2.26 time: 0.023932 Aug 29 10:44:18.337163 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1103/2251] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 35 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:18.347623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb0ebd30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.359576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.360171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.360796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.361394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:18.367790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.368425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.368870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.369614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.370162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.370511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.382099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:18.394602 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4a2b19e-0267-4bd2-abc2-5f580d052046 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1467 microversion: 2.1 time: 0.558430 Aug 29 10:44:18.395116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.395611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.396066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.410041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1149/2252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:17 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1467 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:18.420046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37669721-bbb5-45d5-989b-6952129d15d1 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c7401550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.429434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:18.447286 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2d11426-e7f0-46c5-9687-b3c7b8f37fa3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-119987042" status: 204 len: 0 microversion: 2.26 time: 0.103814 Aug 29 10:44:18.451686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1104/2253] 10.222.0.47 () {60 vars in 1361 bytes} [Mon Aug 29 10:44:18 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-119987042 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 10:44:18.458425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f2290f1-2a7b-4d79-9754-e8ff95fd2789 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c66645e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.468757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f2290f1-2a7b-4d79-9754-e8ff95fd2789 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.469267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f2290f1-2a7b-4d79-9754-e8ff95fd2789 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.469728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f2290f1-2a7b-4d79-9754-e8ff95fd2789 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.474658 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37669721-bbb5-45d5-989b-6952129d15d1 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde" status: 200 len: 784 microversion: 2.1 time: 0.060010 Aug 29 10:44:18.480072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f2290f1-2a7b-4d79-9754-e8ff95fd2789 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 12 microversion: 2.26 time: 0.027071 Aug 29 10:44:18.488200 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1105/2254] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:18.488466 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1150/2255] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:44:18.491651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f23b172-6683-4d90-ae3b-035cb2871eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb0eb310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.492753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11e2ba34-5543-4d77-a522-adf1db790e21 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.504420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11e2ba34-5543-4d77-a522-adf1db790e21 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018064 Aug 29 10:44:18.512345 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1151/2256] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:18.518108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c762f820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.537295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.538489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.539225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.539413 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f23b172-6683-4d90-ae3b-035cb2871eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e" status: 200 len: 661 microversion: 2.1 time: 0.052171 Aug 29 10:44:18.540547 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1106/2257] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:18.542064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:18.546496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34cfe020-94bc-438d-bad3-b606041fc797 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c66e1ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.557556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.558590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.559985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.560962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.561618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.562264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.597736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.598296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.598853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.617937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:18.642916 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c2ce26f-e968-4303-9f50-7d98e98c8382 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 204 len: 0 microversion: 2.26 time: 0.129386 Aug 29 10:44:18.643811 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1152/2258] 10.222.0.47 () {60 vars in 1295 bytes} [Mon Aug 29 10:44:18 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:18.655612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef28d2c9-aa59-4966-983d-ce8d7f593a98 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c71f5160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.704804 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef28d2c9-aa59-4966-983d-ce8d7f593a98 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e" status: 200 len: 661 microversion: 2.1 time: 0.059824 Aug 29 10:44:18.705805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1153/2259] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:18.710799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.711625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:18.718753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.719317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.719916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.720789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.721507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.729417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.939711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:18.952121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8761171c-f679-4dc3-a0cf-64b1ccdf4829 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.244978 Aug 29 10:44:18.952897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1154/2260] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:18.957920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:18.958672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:18.970940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.976306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.976955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:18.978187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:18.978842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:18.981444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.206874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:19.219624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4e120190-b764-4afa-bf65-3a66b636c220 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1469 microversion: 2.1 time: 0.264901 Aug 29 10:44:19.220749 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1155/2261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:18 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:19.226462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb1a6670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:19.240288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.241189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.243739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.244555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:19.254993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.255738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.256506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.257385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.258150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.258978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.266142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34cfe020-94bc-438d-bad3-b606041fc797 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "DELETE /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 204 len: 0 microversion: 2.1 time: 0.723481 Aug 29 10:44:19.271091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1107/2262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:18 2022] DELETE /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:19.338275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.339068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.339724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.343752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1320523333", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:19.351923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.352942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.353595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.399984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:19.423220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] validate_networks() for [('96920ae8-fae5-466a-acdc-c8ef40245e0b', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:19.444423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd56fa86-af37-4344-b42e-f4d8bf7bc5f3 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1821123551" status: 201 len: 0 microversion: 2.26 time: 0.221902 Aug 29 10:44:19.446708 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1156/2263] 10.222.0.47 () {62 vars in 1380 bytes} [Mon Aug 29 10:44:19 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1821123551 => generated 0 bytes in 225 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 10:44:19.459946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2142142170", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:19.546677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:19.968000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:19.971054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:19.973281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:19.973940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:19.974809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:19.992065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.994585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:19.995345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:19.996513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:19.997259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.002430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.038033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Getting quotas for project afb1017f343248ea8ad41f19db4c7ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:20.046004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Getting quotas for user 636c452bd5494aabba7727f21c317a53 and project afb1017f343248ea8ad41f19db4c7ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:20.066018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:20.069048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:20.137744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0abf3b47-def6-4244-ac43-1b896972ed06 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688562 Aug 29 10:44:20.139305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1157/2264] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:20.146123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:20.147494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:20.159451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.159954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.160627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.162224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.162894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.164491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.280091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:20.302254 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7c195c6-22cb-4f89-9486-aac3d8a53ffe tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1266 microversion: 2.1 time: 0.160447 Aug 29 10:44:20.303563 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1158/2265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:20 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:20.311612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:20.320600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:20.323362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Searching by: {'reservation_id': 'r-5w6evocx', 'deleted': False, 'project_id': '0c15797a6a384952a37fe2ca744e22a3'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:44:20.335883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.336732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.338496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.340169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.341232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.341954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.369453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:20.370067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:20.370389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:20.370800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:20.372136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:20.387882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.391218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.391718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.392526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.393012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.393452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.433678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Getting quotas for project e3ba4ea8e9c94ae5a32cc7a933a777cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:20.445279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Getting quotas for user 7e4c22d37f6c48d59b0fa7e832c0451d and project e3ba4ea8e9c94ae5a32cc7a933a777cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:20.446295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:20.471700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:20.475346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:20.535278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:44:20.580558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7c31414-a062-4b36-ab3a-6ebaa101d950 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305333 Aug 29 10:44:20.581445 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1108/2266] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:20.589553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893f51a-b42d-4a2b-8b42-3dbdbd98cf81", "name": "network-vif-deleted", "tag": "11aab3cc-bb00-494c-b28e-668948b08f8c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:20.618732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.619141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.619591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.646806 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] Creating event network-vif-deleted:11aab3cc-bb00-494c-b28e-668948b08f8c for instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 on n-h1-854121-10 Aug 29 10:44:20.679818 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-16275de3-b9d7-41bf-937f-c92e6de7d809 req-aca2c57a-0593-4895-a7e2-1108f5ba102e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093144 Aug 29 10:44:20.680508 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1109/2267] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:20.704555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac15e0ab-390d-49fd-a2cf-25e5ae4a95d6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb0ebee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:20.724176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:20.733948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.734452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.734897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.736485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ac15e0ab-390d-49fd-a2cf-25e5ae4a95d6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] HTTP exception thrown: Image not found. Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac15e0ab-390d-49fd-a2cf-25e5ae4a95d6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Request method failure captured: Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 HTTP/1.1 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhPlU_gaY8vXTtzswapy3qxgoVlRtt8pDJtVrbbdQqovTjG9NV6ATUelgZ1q31GC10b0qUp0M1wgUe-fiA1LFqvl8nugzhA3hK2oDQqlUECMhaPkDuaTzD8O1EqGMTrXrzgqEfP6qKrHL504L8OwlUvOp31cHBgSO-C7hMqdj_tqYo Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c51da1350111427ab3fe355344743f4e Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '50f16575-c2e7-44b2-a7c5-b9ba3f604868'} Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50f16575-c2e7-44b2-a7c5-b9ba3f604868 Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:44:20.747085 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50f16575-c2e7-44b2-a7c5-b9ba3f604868 could not be found. Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:44:20.752323 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:44:20.762450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac15e0ab-390d-49fd-a2cf-25e5ae4a95d6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:44:20.763797 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ac15e0ab-390d-49fd-a2cf-25e5ae4a95d6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 404 len: 62 microversion: 2.1 time: 0.074963 Aug 29 10:44:20.764687 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1110/2268] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:20 2022] GET /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:44:20.774556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66caff1940>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:20.797654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.798336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.798961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.799630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:20.807254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.808131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.808685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.809645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.810427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.811048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.868173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.869026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.869761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.911667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.912151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.913070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.949268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:20.975634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83fba535-2c53-4d22-881f-0f68dc4b7354 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1571746703" status: 201 len: 0 microversion: 2.26 time: 0.209086 Aug 29 10:44:20.977014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1111/2269] 10.222.0.47 () {62 vars in 1380 bytes} [Mon Aug 29 10:44:20 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1571746703 => generated 0 bytes in 211 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 10:44:20.983638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:20.984572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:20.992154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.992757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.993171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:20.993929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:20.994426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:20.995074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:21.523679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d2e44ec-da52-447c-96ce-f5900005665e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?reservation_id=r-5w6evocx" status: 200 len: 2930 microversion: 2.1 time: 1.218781 Aug 29 10:44:21.524489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1159/2270] 10.222.0.47 () {58 vars in 1197 bytes} [Mon Aug 29 10:44:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5w6evocx => generated 2930 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:21.531925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1957243912", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:21.567862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:21.579774 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87993a6d-5c30-4987-b8c0-f49e5e32792c tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.601201 Aug 29 10:44:21.582803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1112/2271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:20 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:21.594757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:21.597467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:21.611417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:21.613844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:21.614375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:21.615145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:21.615607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:21.625033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:21.664727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:21.668532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:21.795295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:21.807147 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1af95df9-08f6-48de-aa75-2567e3e56904 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1221 microversion: 2.1 time: 0.220540 Aug 29 10:44:21.812112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1113/2272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:21 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1221 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:21.833240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1862953118"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:21.835677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:21.843052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:21.843553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:21.844002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:21.844722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:21.845185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:21.845621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.129331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e527c53-e3f9-4e65-8248-4eb30c2475a6 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "POST /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266/action" status: 202 len: 0 microversion: 2.1 time: 0.301661 Aug 29 10:44:22.130409 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1114/2273] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:21 2022] POST /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:44:22.137859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66cb0eb8b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:22.151501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.153342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.154073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.154777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:22.155160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:22.155601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:22.156259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:22.156632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:22.157057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:22.166781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.169124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.170334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.171717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.172299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.173227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.187650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.188162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.188611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.189490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.190143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.190581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.234606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Getting quotas for project afb1017f343248ea8ad41f19db4c7ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:22.245355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Getting quotas for user 636c452bd5494aabba7727f21c317a53 and project afb1017f343248ea8ad41f19db4c7ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:22.269258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:22.272488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:22.304637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.305356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.305775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.369147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:22.408799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6652bc40-8edd-426a-b401-7197dac230fc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881619 Aug 29 10:44:22.411782 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1160/2274] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:22.421602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:22.426639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:22.436376 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81c87ca1-fb38-477f-b5b9-cfb47a56d8d4 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 204 len: 0 microversion: 2.26 time: 0.304527 Aug 29 10:44:22.437016 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1115/2275] 10.222.0.47 () {60 vars in 1295 bytes} [Mon Aug 29 10:44:22 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:22.479054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:22.487558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.516651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.521431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.530646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.532197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.538844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.645305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_groups [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Querying cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) for 2 instances {{(pid=128682) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 10:44:22.656782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.658642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.659314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.776029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-93d80ab4-387f-4356-a54f-36098719579a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/1f419406-5edc-4369-a31c-ce1bac533a3c" status: 200 len: 265 microversion: 2.1 time: 0.324326 Aug 29 10:44:22.776719 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1116/2276] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:44:22 2022] GET /compute/v2.1/os-server-groups/1f419406-5edc-4369-a31c-ce1bac533a3c => generated 265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:22.801782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-unplugged", "status": "completed", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:22.850115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:22.866291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:22.869149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:22.874628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:22.960802 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] Creating event network-vif-unplugged:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:44:23.014855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-857b6dcb-619a-40bb-a7ec-f102544b7119 req-3e4d25c5-d0fa-4361-8f4d-a0481b9adcbe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.224241 Aug 29 10:44:23.017538 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1117/2277] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:23.036075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7a1039c1-3a5d-4416-8829-b976a6b4f914 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb0a5a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.120446 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7a1039c1-3a5d-4416-8829-b976a6b4f914 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.098668 Aug 29 10:44:23.121045 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1118/2278] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.143324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18813a2d-50ef-47a6-ade7-5b232659d85a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.144107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18813a2d-50ef-47a6-ade7-5b232659d85a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.245168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:23.279280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fdc0fb59-6aa6-4689-a7a2-afb0ba3192e1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.865535 Aug 29 10:44:23.281805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1161/2279] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:22 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.310170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3d575dd-493e-4fe7-beb0-c16a2051f251 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c6fe9f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.334840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3d575dd-493e-4fe7-beb0-c16a2051f251 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.335670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3d575dd-493e-4fe7-beb0-c16a2051f251 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.336476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3d575dd-493e-4fe7-beb0-c16a2051f251 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.353478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3d575dd-493e-4fe7-beb0-c16a2051f251 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 12 microversion: 2.26 time: 0.068901 Aug 29 10:44:23.354993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1162/2280] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 12 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.354993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.361499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.369487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.370261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.370856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.372358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.373097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.373966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.410835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18813a2d-50ef-47a6-ade7-5b232659d85a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:23.425037 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18813a2d-50ef-47a6-ade7-5b232659d85a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1218 microversion: 2.1 time: 0.299947 Aug 29 10:44:23.439726 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1119/2281] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1218 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.448160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.449169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.458729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.463783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.465339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.467442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.470242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.470916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.804422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:23.812657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6802f94b-38e9-48bf-9960-9e0d95bdbba2 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1622 microversion: 2.1 time: 0.370965 Aug 29 10:44:23.828615 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb59d67e-3f16-4dee-abdb-5aeba841a470 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.462093 Aug 29 10:44:23.828615 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1163/2283] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.828615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.828615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.838881 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1120/2283] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1622 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:23.844827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66caff1700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.846369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.847688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.849254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.852787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.852787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.853927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.855557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.856727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.857388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.858059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.864094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.864588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.865115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.865815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.866435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.867061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.893568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.894088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.894685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.909296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:23.926574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-975c168a-cb09-470e-95c1-c6b66e9fd52c tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 204 len: 0 microversion: 2.26 time: 0.086278 Aug 29 10:44:23.927501 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1121/2284] 10.222.0.47 () {60 vars in 1295 bytes} [Mon Aug 29 10:44:23 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:23.937375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:23.938031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:23.944550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.945044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.945476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.946460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:23.946980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:23.947338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:23.987778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:24.003205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0ba3c80-ab8f-4143-8746-24481a20fbec tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1275 microversion: 2.1 time: 0.182216 Aug 29 10:44:24.003799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1164/2285] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.011279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c73548b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.018819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:24.026138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.026959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.027406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.029184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.036556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.037107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.037545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.038265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.038983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.039494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.069606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.070295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.071149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.080906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.081531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.082105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.109352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:24.128785 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e05c347-c0d7-4a1e-bc7b-ea3e8e477d8f tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1552860098" status: 201 len: 0 microversion: 2.26 time: 0.122891 Aug 29 10:44:24.129987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1165/2286] 10.222.0.47 () {62 vars in 1380 bytes} [Mon Aug 29 10:44:24 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-1552860098 => generated 0 bytes in 125 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 10:44:24.140557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-14b56afb-2376-4eb9-8bbb-821f24ecfc89 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c7517d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.211924 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-14b56afb-2376-4eb9-8bbb-821f24ecfc89 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.075808 Aug 29 10:44:24.212697 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1166/2287] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:24 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.218239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c6fe9f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.228357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.228852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.229297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.229786 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f38a1ad6-1fa4-49ca-a3b6-e2d727eaba77 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 200 len: 1621 microversion: 2.1 time: 0.300906 Aug 29 10:44:24.229928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.231599 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1122/2288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:23 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 1621 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.237458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.237920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.238503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.239224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.239686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.240202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.254737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: .version_select at 0x7f66caff1b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1499270268", "policies": ["anti-affinity"]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:24.281281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:24.285876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.286376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.286821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.288578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:24.299132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.299621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.300161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.335854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:24.359875 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56a6bd8c-829e-4e3e-9f17-ffd8b80ffeaf tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-742969413" status: 201 len: 0 microversion: 2.26 time: 0.146153 Aug 29 10:44:24.361861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1167/2289] 10.222.0.47 () {62 vars in 1377 bytes} [Mon Aug 29 10:44:24 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags/tempest-tag-742969413 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 10:44:24.367073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.367708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.375425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:24.376606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.377229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.377851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.378868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.379819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.380264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.382427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:24.399657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb802b66-0846-445e-835a-15cf7e262a81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.149524 Aug 29 10:44:24.421735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1123/2290] 10.222.0.47 () {60 vars in 1174 bytes} [Mon Aug 29 10:44:24 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:24.421735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Action: 'update_all', calling method: .version_select at 0x7f66caff1ee0>, body: {"tags": ["tempest-tag-478748983", "tempest-tag-170858254"]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:24.425897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.426398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.427020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.428326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.435458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.436231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.436827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.438917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.439929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.440577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.474690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.475365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.475960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.505970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:24.534821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b1fd2bb-5077-4ec3-b954-89fb3aa3faa8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 60 microversion: 2.26 time: 0.127702 Aug 29 10:44:24.543468 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1124/2291] 10.222.0.47 () {62 vars in 1312 bytes} [Mon Aug 29 10:44:24 2022] PUT /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 60 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.549633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.550070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.561284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.561974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.562932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.564047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.565448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.566117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.638332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:24.656328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41fb4843-4e0d-4447-9c28-b254580dbcb2 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.292900 Aug 29 10:44:24.657789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1168/2292] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:24 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.663963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd75d88-63e1-441e-8d84-aa355a7d15ee", "tag": "60f39c1c-b970-4b6a-862b-4681bfa43d81"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:24.679657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.682302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.682930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.697647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] Creating event network-changed:60f39c1c-b970-4b6a-862b-4681bfa43d81 for instance dbd75d88-63e1-441e-8d84-aa355a7d15ee on n-h2-854121-10 Aug 29 10:44:24.705037 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d5117964-7f7c-4602-89f0-e7841af5ee8c req-a0b08a7a-90e6-43ba-8b47-d1d30855fd5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045489 Aug 29 10:44:24.706527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1169/2293] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:24.714101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84c03e27-84ac-412e-a100-d7bb2d23c873 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c7517550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.722330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:24.725900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c03e27-84ac-412e-a100-d7bb2d23c873 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.730088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c03e27-84ac-412e-a100-d7bb2d23c873 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.730757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c03e27-84ac-412e-a100-d7bb2d23c873 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.732248 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-714938be-d079-4136-abd4-5965a87f1a6d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1214 microversion: 2.1 time: 0.187258 Aug 29 10:44:24.734055 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1125/2294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:24 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.739257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1939304758", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d3d93d67-1f7b-49c2-b1b5-b68dff202be2"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:24.760669 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84c03e27-84ac-412e-a100-d7bb2d23c873 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 200 len: 60 microversion: 2.26 time: 0.052709 Aug 29 10:44:24.761177 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1170/2295] 10.222.0.47 () {60 vars in 1292 bytes} [Mon Aug 29 10:44:24 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 60 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:24.776541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '.version_select at 0x7f66c76c79d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.787128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.789873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.790526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.792427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.804771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.807228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.808442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.809779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.810979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.811925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.819845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:24.850528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.851052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.851675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.870639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lazy-loading 'flavor' on Instance uuid 413da2fb-4ac9-4f14-a99c-614b7b23c672 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:24.893414 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38c59311-a508-4f9f-a2bd-e403406a28c8 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags" status: 204 len: 0 microversion: 2.26 time: 0.121830 Aug 29 10:44:24.894676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1171/2296] 10.222.0.47 () {60 vars in 1295 bytes} [Mon Aug 29 10:44:24 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:24.902949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:24.903860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:24.910948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.911676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.912112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:24.912855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:24.913316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:24.913764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.156882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:25.157428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:25.158713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:25.159929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:25.160477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:25.188712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.197508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63889bfb-e9af-49d8-9396-1cf4f80059f6 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.301466 Aug 29 10:44:25.201760 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1172/2297] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:24 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:25.201907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.201907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.201907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.202156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.203213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.203623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.203731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:25.204335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.225533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.226316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.226763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.227474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.227922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.228343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.238836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:25.250787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:25.267182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 2 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:25.269894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:25.273378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:44:25.297465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:25.318780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128682) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 10:44:25.349465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:25.358586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:25.398213 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1276790a-f82f-4318-9a6a-9573c5651a74 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 204 len: 0 microversion: 2.26 time: 0.198755 Aug 29 10:44:25.402368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1173/2298] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:44:25 2022] DELETE /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:44:25.407235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.408109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:25.415651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:25.417045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.417673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.418391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.419225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.419923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.420623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.422208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:25.440868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=a0d9f98c-962c-4329-b37a-ffc99828ed5f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:25.495535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:25.501585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:25.502821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:25.547821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:25.553309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:25.593488 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1d19cf8-79c0-4a5e-9ad9-51c548b799f2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.858022 Aug 29 10:44:25.598822 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1126/2299] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 10:44:25.604923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51d2d9af-f102-47a1-9b4e-29ae3bfe1dde tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb0a5a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.611553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.624577 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66d57144-39a2-493d-90ba-ff37b1f043d7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.222557 Aug 29 10:44:25.624757 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1174/2300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:25.643188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.643827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:25.650928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.651430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.652355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.654553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.655186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.655625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.659873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51d2d9af-f102-47a1-9b4e-29ae3bfe1dde tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.059704 Aug 29 10:44:25.660680 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1127/2301] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:25.677066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817fec32-3127-4f17-90cc-e74790899f58", "name": "network-vif-plugged", "status": "completed", "tag": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:25.690674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.691521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.692056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.706158 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] Creating event network-vif-plugged:7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742 for instance 817fec32-3127-4f17-90cc-e74790899f58 on n-h2-854121-10 Aug 29 10:44:25.713457 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-799890c1-1625-4746-9175-3c4defcd9bee req-2aaa8830-f1c2-46a7-bc5d-76f7ce6d9fe1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050646 Aug 29 10:44:25.714747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1128/2302] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:25.722853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.730081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.732430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Searching by: {'deleted': False, 'project_id': '0c15797a6a384952a37fe2ca744e22a3'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:44:25.755707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.756492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.758387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.759443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.760087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.760643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.804830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:44:25.841824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-93c44389-5cdc-460e-9f1b-119b5fe38da9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.124743 Aug 29 10:44:25.842909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.843688 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1129/2303] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/servers => generated 1665 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:25.852362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.853477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.853630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:25.855605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:25.858125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c32f965e-c5e3-473d-9450-046dd89c82ec tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1550 microversion: 2.26 time: 0.223154 Aug 29 10:44:25.858709 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1175/2304] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1550 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:25.862289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.863058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.863603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.864495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.865043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.865328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:25.865837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.866041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:25.876471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.876963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.877402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:25.878293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:25.878902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:25.879336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.000114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:26.016012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a71614f8-4115-4920-a199-e07e90475409 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1214 microversion: 2.1 time: 0.156037 Aug 29 10:44:26.017345 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1176/2305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.022392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ba30b135-df14-448e-bdfc-8882766a8252 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:26.023093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ba30b135-df14-448e-bdfc-8882766a8252 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:26.104516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ba30b135-df14-448e-bdfc-8882766a8252 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:26.112534 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ba30b135-df14-448e-bdfc-8882766a8252 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1219 microversion: 2.1 time: 0.094324 Aug 29 10:44:26.113286 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1177/2306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:26 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.133172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:26.142493 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dedc5d89-db72-455d-b225-a102db906286 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.297574 Aug 29 10:44:26.151086 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1130/2307] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:25 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.221095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:26.222188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:26.230816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.231228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.231608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.232312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.232775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.233467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.386716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:26.396393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1df21f57-7cf3-4528-be29-4ca1568a9ead tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.180244 Aug 29 10:44:26.419886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:26.425765 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1178/2308] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:26 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.432241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.433251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.434628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.447257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] Creating event network-changed:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:44:26.456388 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-44111eb6-16b7-4a67-a4d0-83d59f47755c req-937d3598-b309-474e-86d0-852f3de35995 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041793 Aug 29 10:44:26.457868 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1131/2309] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:26.648741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:26.649845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:26.669601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.670307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.673283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.676347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.677051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3bd409b-4513-4662-988f-bba7dc9c7ea9 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb0a5040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:26.677184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.677509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.755366 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3bd409b-4513-4662-988f-bba7dc9c7ea9 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.083148 Aug 29 10:44:26.765298 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1132/2310] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:26 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.885157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:26.886029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:26.889296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:26.897723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02f7bd1a-6319-408d-bacd-19a8c723e64f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.255187 Aug 29 10:44:26.899491 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1179/2311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:26 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:26.915012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.915527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.915971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:26.916702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:26.917158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:26.917610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.038072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.038699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:27.045998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.046798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.047456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.048533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.049107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.049925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.076675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.088121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.089595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.091549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-076a407e-4437-4acb-aab6-3c432e6f9bf5 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1550 microversion: 2.26 time: 0.211238 Aug 29 10:44:27.092114 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1133/2312] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:26 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1550 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:27.132273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.139907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.140528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:27.141050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9703bdd9-21b0-4d7b-be92-a080762fb60b tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1214 microversion: 2.1 time: 0.106753 Aug 29 10:44:27.142314 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1180/2313] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:27.146966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.147519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.147969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.148682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.149271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.150216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.155028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:27.164501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.165134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:27.173217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.173738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.174250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.176296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.176767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.177342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.231459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.239285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24ba60e4-1544-46dd-9af5-0bf78e6b6b2e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1271 microversion: 2.1 time: 0.103869 Aug 29 10:44:27.240293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1134/2314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:27.318564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.327264 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ebfbf44-52a3-4a52-a169-c94f640fba54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.166706 Aug 29 10:44:27.327844 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1181/2315] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:27.424852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.425580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:27.433026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.433611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.434741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.435564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.436125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.436631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.582974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:27.592584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3b569d1-8168-4480-8181-a7abe96e9953 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.172553 Aug 29 10:44:27.593566 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1135/2316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:27.771200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bc9cd6e-1d59-43fd-8685-112e76d17f98 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c7385ca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.815557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bc9cd6e-1d59-43fd-8685-112e76d17f98 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.048198 Aug 29 10:44:27.816124 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1182/2317] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:27.921184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:27.921832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:27.928340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.928824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.929270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:27.929992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:27.930450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:27.930886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.063665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.071323 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a0ff91f-590a-4c10-8db1-19560c578014 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.154926 Aug 29 10:44:28.071886 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1136/2318] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:27 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:28.113850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.114464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:28.120543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.121026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.122349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.123237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.123701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.124133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.165401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.166186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:28.173250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.173641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.174102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.174795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.175248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.175668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.249428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.257348 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e1ad9c3-8a75-431d-8796-26118207ae4c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1214 microversion: 2.1 time: 0.096063 Aug 29 10:44:28.257965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1137/2319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:28.263589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.264208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:28.270512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.270750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.271181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.271879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.272337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.272765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.281452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.289469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.290943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.292132 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33ffe260-eb86-4e92-8223-bd8eec9bfb8e tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1550 microversion: 2.26 time: 0.182351 Aug 29 10:44:28.292695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1183/2320] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:28.335466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.344225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80ea2ea4-05fd-483c-99bf-3f728b2df444 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1271 microversion: 2.1 time: 0.085296 Aug 29 10:44:28.344795 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1138/2321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:28.348333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.348960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:28.355197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.355727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.356745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.357445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.357953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.358388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.472069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:28.484378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.485156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.485480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.495178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.497371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] Creating event network-changed:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:44:28.502265 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e49aab4a-22d1-47cb-a5ca-062e65ba3c9d req-c69883a6-da68-4392-9367-8eb37f72a567 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035374 Aug 29 10:44:28.502870 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1139/2322] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:44:28.503026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-71e31253-c698-47e3-bbe1-413879d4db54 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.158606 Aug 29 10:44:28.503591 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1184/2323] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:28.614652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.615439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:28.621816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.622495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.622944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.623641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:28.624101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:28.624530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:28.765474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:28.773340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5240407-be9c-460c-b2d1-81d325cc0a54 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.162941 Aug 29 10:44:28.773949 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1140/2324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:28.832095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35a578df-6cd4-4aae-84ba-147b995068ff tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6ef1670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:28.876644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35a578df-6cd4-4aae-84ba-147b995068ff tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.048366 Aug 29 10:44:28.877210 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1185/2325] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:28 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:29.093237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.095234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.102882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.103510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.104081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.105095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.105629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.107090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.247159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.255547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff0d6dc5-4a77-49ea-9d5f-6e01d6745663 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.167523 Aug 29 10:44:29.256128 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1141/2326] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:29.279696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.280442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.286650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.287139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.287584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.288290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.288758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.289191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.317236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.317979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.324136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.325332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.326810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.327632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.328297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.328719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.354294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.363196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1bbadd25-ade3-4b6f-bccb-ced82518d9f8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1214 microversion: 2.1 time: 0.088464 Aug 29 10:44:29.374252 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1186/2327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:29.374252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.374252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.376443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.376939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.377404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.378455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.378923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.379388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.453668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.461650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c3791067-da50-46eb-99e3-75373665fac7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1271 microversion: 2.1 time: 0.096830 Aug 29 10:44:29.462624 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1187/2328] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:29.467956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-plugged", "status": "completed", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:29.477357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.477872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.478970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.493672 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] Creating event network-vif-plugged:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:44:29.498960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-86572b53-99fe-4a48-9bfa-264017d4c0e6 req-78e86a6e-695d-4125-af54-d5604357935e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Aug 29 10:44:29.499816 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1188/2329] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:29.506950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.515762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.517123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.519699 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64942e64-fa1d-402a-a51f-1f496b23607a tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1550 microversion: 2.26 time: 0.206558 Aug 29 10:44:29.520282 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1142/2330] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1550 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:29.522738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.523447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.530825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.531313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.531760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.532454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.532916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.533350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.667388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:29.676166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cac826da-e973-4929-92d9-c584d5d11fdf tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.157493 Aug 29 10:44:29.677118 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1189/2331] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:29.795429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.796175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:29.802623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.803186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.803674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.804701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:29.805182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:29.805659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:29.892570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02616e89-6ef1-47cc-94b7-a9c5055d76c9 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c77a69d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:29.945452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02616e89-6ef1-47cc-94b7-a9c5055d76c9 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.056601 Aug 29 10:44:29.947015 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1190/2332] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:30.051003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:30.059697 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fcd3c88a-2f6b-4b48-a7c6-5939704c9379 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.268169 Aug 29 10:44:30.066690 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1143/2333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:29 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:30.276670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:30.277306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:30.285556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.286327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.286493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:30.290665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.291161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.294594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:30.386992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:30.388125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:30.416182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.420643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.423770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:30.427921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.429033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.432113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:30.655933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:30.668768 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10a727d9-08f3-4c01-bb3e-c2a145524cac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1270 microversion: 2.1 time: 0.286937 Aug 29 10:44:30.671191 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1144/2334] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:30 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1270 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:44:30.682065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:30.684667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:30.700034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.702668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.703156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:30.703896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:30.704359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:30.709083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:31.021598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.030304 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36b96aa1-c9d1-4cfd-86fa-6377a7bba7b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1277 microversion: 2.1 time: 0.358032 Aug 29 10:44:31.030880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1145/2335] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:30 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:31.035811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:31.036418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:31.042283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:31.042827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:31.043212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:31.044558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:31.045250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:31.045674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:31.153078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.160902 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-460d0ea1-73ce-4e59-bb3c-eacd37818aea tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.888257 Aug 29 10:44:31.161658 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1191/2336] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:30 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:31.166037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:31.166647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:31.174124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:31.176604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:31.177084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:31.177868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:31.178330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:31.178758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:31.939365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.948165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.949800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.951427 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a51f524-b606-4bf6-bd7f-7d15e1607bcd tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1550 microversion: 2.26 time: 0.919589 Aug 29 10:44:31.952074 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1146/2337] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:31 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1550 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:31.963484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:31.969925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aebea9fa-5b26-45c2-979d-a88ea5ba9f1a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c711b430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:31.974715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fcd05aae-69d7-463c-82bd-e0b4d304c2ab tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.812105 Aug 29 10:44:31.992798 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1192/2338] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:31 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:31.998416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:31.999838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:32.006921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.007524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.008288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.009899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.010366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.010792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.043788 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aebea9fa-5b26-45c2-979d-a88ea5ba9f1a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.090362 Aug 29 10:44:32.045153 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1147/2339] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:31 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:32.050145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:32.050924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:32.057903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.058614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.060747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.061492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.062000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.062879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.211249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:32.216880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:32.227753 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4abbd0c6-3e2d-47e9-b0cc-d4079e823156 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1278 microversion: 2.1 time: 0.181257 Aug 29 10:44:32.233878 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1148/2340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:32 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:32.241939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:32.242758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:32.250411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.251051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.255995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.256978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.257543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.258110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.508660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:32.515083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:32.517884 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8796321a-e19f-410e-8959-90759b2f93e7 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1324 microversion: 2.1 time: 0.523672 Aug 29 10:44:32.543882 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1193/2341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:31 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:32.549219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:32.550072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:32.561090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.571973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.572673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:32.573583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:32.574355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:32.575581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.086402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:33.103814 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee90c3b3-831a-4f49-acf3-432aec9d96a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.867882 Aug 29 10:44:33.110811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1149/2342] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:32 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:33.124238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:33.127101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:33.134808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.135375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.135891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.136725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.146753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.148102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.218569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:33.230622 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c81df7d-b841-4d75-806e-058b6bcfd918 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.684993 Aug 29 10:44:33.233189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1194/2343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:33.252679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:33.253721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:33.261261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.262677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.263467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.265519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.266542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.267550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.662659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:33.681384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:33.699219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d5994aeaff484291d3086e28477e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886a7bb817f14d5bb7cc19e7916bdcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:33.701634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-953174ac-9cce-4c48-a99f-d783ae436b0d tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 200 len: 1508 microversion: 2.26 time: 0.589468 Aug 29 10:44:33.711745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1150/2344] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:33 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:33.717848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1804e12-27a0-4de3-9009-1a4f63cc541c tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c73d14c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:33.789791 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1804e12-27a0-4de3-9009-1a4f63cc541c tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.075906 Aug 29 10:44:33.791045 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1151/2345] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:33 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:33.796039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:33.802996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:33.816126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.816841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.820663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:33.821864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:33.822581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:33.823177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:34.240957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:34.259901 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51c980dc-48b8-426b-830d-d9ab6ce09527 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 1.013941 Aug 29 10:44:34.279375 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1195/2346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:33 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:34.332785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:34.348691 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f97b2b7-34cc-462c-b13b-38725c819ccb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1318 microversion: 2.1 time: 0.556384 Aug 29 10:44:34.349285 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1152/2347] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:33 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:34.366466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:34.367153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:34.378265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:34.382804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:34.383575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:34.384811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:34.385565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:34.389979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:34.426917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:34.448795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413da2fb-4ac9-4f14-a99c-614b7b23c672", "name": "network-vif-deleted", "tag": "28b82e4e-c4f7-418a-809a-4312e9003a55"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:34.476027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:34.477510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:34.478011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:34.517302 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] Creating event network-vif-deleted:28b82e4e-c4f7-418a-809a-4312e9003a55 for instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 on n-h2-854121-10 Aug 29 10:44:34.525249 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-871cb5c0-f6e0-4923-a42b-21d6ac319ebb req-485242b4-f31c-459f-8f08-557b3c6a06e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240101 Aug 29 10:44:34.526516 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1196/2348] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:34.535979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:34.537411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:34.547814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:34.548235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:34.548679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:34.550280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:34.551119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:34.551888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.228417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:35.242051 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8570f45-95d7-498a-b96a-65008c5aa0b0 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 200 len: 1521 microversion: 2.1 time: 0.888068 Aug 29 10:44:35.261672 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1153/2349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:34 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 1521 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:35.280865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:35.281970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:35.296926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.300671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.301470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.302529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.303210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.305826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.331241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:35.339323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7e0a1104-b3cf-483b-80d7-bbc0542b0123 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.811558 Aug 29 10:44:35.339907 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1197/2350] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:34 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:35.350570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "name": "network-vif-plugged", "status": "completed", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:35.380111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.381023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.381675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.394946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] Creating event network-vif-plugged:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:44:35.400333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b4a7512d-0c6f-46a7-bd85-eef4eab612fa req-a657c090-3a74-4ee1-8f3e-2eaf1ec62793 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053261 Aug 29 10:44:35.401660 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1198/2351] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:35.408433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:35.409558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] [instance: 413da2fb-4ac9-4f14-a99c-614b7b23c672] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:35.419931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.420805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.421486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.422464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.423134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.423908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.441289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] HTTP exception thrown: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Request method failure captured: Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 HTTP/1.1 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhcw2IGLf3sKYEAakGhB7aejVaVOy6hwUxVHvc_DyVuFrh517SvaeYPqqF54kOFsbsKMkXB-KdggzhmzdZPlu8AQKv4P1BqyEZBVypOc3GpjxSQM4IiXmZ8OWmabNHUFxH63pVtD3MqL8EOBKnCkouwvcc1rKQHDpLCyMENsHtasZA Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.26 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 886a7bb817f14d5bb7cc19e7916bdcfe Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerTagsTestJSON-766752885 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/886a7bb817f14d5bb7cc19e7916bdcfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_886a7bb817f14d5bb7cc19e7916bdcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/886a7bb817f14d5bb7cc19e7916bdcfe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/886a7bb817f14d5bb7cc19e7916bdcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerTagsTestJSON-766752885 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 886a7bb817f14d5bb7cc19e7916bdcfe Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerTagsTestJSON-766752885 Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerTagsTestJSON-766752885-project Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b5d5994aeaff484291d3086e28477e6a Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerTagsTestJSON-766752885-project Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '413da2fb-4ac9-4f14-a99c-614b7b23c672'} Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:35.443428 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. Aug 29 10:44:35.447655 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:35.449546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] Returning 404 to user: Instance 413da2fb-4ac9-4f14-a99c-614b7b23c672 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:44:35.451859 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7616c3f-bfac-4298-bacd-e097538ae1f6 tempest-ServerTagsTestJSON-766752885 tempest-ServerTagsTestJSON-766752885-project] 10.222.0.47 "GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672" status: 404 len: 111 microversion: 2.26 time: 0.048622 Aug 29 10:44:35.453033 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1199/2352] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:35 2022] GET /compute/v2.1/servers/413da2fb-4ac9-4f14-a99c-614b7b23c672 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:44:35.458387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49193749-5b70-4133-8307-db9a25034e1a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6eb9c10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:35.533188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49193749-5b70-4133-8307-db9a25034e1a tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.075248 Aug 29 10:44:35.534298 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1200/2353] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:35 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:35.541314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.150"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:35.548325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:35.561300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=48 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:35.563852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.564466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.566829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.568248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:35.568790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:35.569453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:35.607205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:44:35.608192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquired lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:44:35.779670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:36.031377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:36.041951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ba53bc4-bc3e-4021-a518-8fd8ab1ec996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1317 microversion: 2.1 time: 0.778625 Aug 29 10:44:36.043021 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1154/2354] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:35 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:36.068307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:36.069282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:36.079497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:36.079984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:36.080423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:36.081131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:36.081579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:36.082037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:36.112231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=22 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:36.686564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:36.709063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-951f49b0-c5a3-4b07-8ce6-2a94d2e0f088 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.648395 Aug 29 10:44:36.713134 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1155/2355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:36 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:36.727275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:36.728805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:36.755945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:36.757214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:36.761526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:36.766555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:36.767735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:36.769819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:37.713076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:37.722281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5249e5f7-b248-4901-b5ae-9bbb97e220a4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1318 microversion: 2.1 time: 1.007763 Aug 29 10:44:37.723114 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1156/2356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:36 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1318 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:37.730160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089c491c-4d5b-46f0-841b-f04a161b9068", "tag": "043cc140-449c-47a1-b030-fdd429a26e32"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:37.741198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:37.741849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:37.742388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:37.759349 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] Creating event network-changed:043cc140-449c-47a1-b030-fdd429a26e32 for instance 089c491c-4d5b-46f0-841b-f04a161b9068 on n-h2-854121-10 Aug 29 10:44:37.764202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-36e37c3c-b6bd-46e3-be17-63523531b151 req-811a793a-5091-43ca-8a27-8c751470f651 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039641 Aug 29 10:44:37.764988 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1157/2357] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:37.770371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:37.770986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:37.777574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:37.778147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:37.778590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:37.779299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:37.779758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:37.780191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:38.567941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:38.591229 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e984ec07-7f2e-4c1b-a3b1-7abdd0494c75 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.813958 Aug 29 10:44:38.592006 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1158/2358] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:37 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:38.596935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6041080d-b186-4348-b8a3-34846a7f59ec tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c735ab80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:38.705325 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6041080d-b186-4348-b8a3-34846a7f59ec tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.112180 Aug 29 10:44:38.707673 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1159/2359] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:38 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:38.727833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c538ce3-5bf5-4b58-ae7c-1da21b710e1f", "tag": "1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:38.773416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:38.779483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:38.784103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:38.803852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] Creating event network-changed:1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6 for instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f on n-h1-854121-10 Aug 29 10:44:38.813947 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7fd7fad6-eed3-408f-84c4-d5c132dd7d17 req-7d6559ce-df09-4818-9356-81290a6a6b1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102408 Aug 29 10:44:38.814906 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1160/2360] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:38.821780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:38.826163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:38.835685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:38.836201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:38.837371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:38.838385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:38.838906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:38.840282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:39.602675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:39.625265 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0808257-f0e4-4a2e-8242-79672c4b87a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.808983 Aug 29 10:44:39.626201 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1161/2361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:38 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:39.630700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-plugged", "status": "completed", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:39.660797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:39.662767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:39.669315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:39.691724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] Creating event network-vif-plugged:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:44:39.703353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-63402ad5-9da1-4bad-b4b1-c2c365928b8d req-18017fc8-794e-482f-8862-e4d5ac26a542 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075824 Aug 29 10:44:39.706705 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1162/2362] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:39.712124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:39.714775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:39.724087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:39.724852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:39.725471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:39.726501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:39.727295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:39.727938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:40.190276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:40.198825 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59d738ec-90f6-4aa6-9030-99671ebb1e60 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 0.490817 Aug 29 10:44:40.204919 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1163/2363] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:39 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:40.222456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:40.225498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:40.239798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:40.242038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:40.242500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:40.243236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:40.243735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:40.244142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:40.845680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:44:40.917845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:40.937926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2bb76c8-d8c4-46c1-9bbc-3bc27d11de8c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1318 microversion: 2.1 time: 0.731917 Aug 29 10:44:40.952340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1164/2364] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:40 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:40.958065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:40.958912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:40.966480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:40.967414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:40.968120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:40.969203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:40.969861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:40.970462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:41.895983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:41.911886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-131a39bc-3026-4459-a42a-ea41c35d45c7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.958099 Aug 29 10:44:41.914812 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1165/2365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:40 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:41.921237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1299904791", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:42.030659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] validate_networks() for [('96920ae8-fae5-466a-acdc-c8ef40245e0b', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:43.563078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Updating instance_info_cache with network_info: [{"id": "95fbce57-72b7-45ad-bece-e8308aca8135", "address": "fa:16:3e:65:2e:f0", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95fbce57-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:44:43.584261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Releasing lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:44:43.585661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79c09e56-326e-47c2-a145-239a0f450ed5 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action" status: 202 len: 0 microversion: 2.1 time: 8.050047 Aug 29 10:44:43.586686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1201/2366] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:35 2022] POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action => generated 0 bytes in 8052 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:44:43.596782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ccaabb85-9e76-48f0-80ac-90ec8d25e86e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66cb08f9d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:43.693394 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ccaabb85-9e76-48f0-80ac-90ec8d25e86e tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.105220 Aug 29 10:44:43.700029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1202/2367] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:43 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:43.717942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:43.740156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:43.741352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:43.742034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:43.742635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:43.743224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:43.768268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:43.773176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:43.775334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:43.776040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:43.780514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:43.782022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:43.785030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:43.790322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:43.792418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:43.844741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] Creating event network-changed:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:44:43.882076 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-92630895-5878-43ab-adc1-f30961212789 req-1231efc3-4ed5-4ebb-b9bd-c904fbff1104 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169088 Aug 29 10:44:43.889297 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1203/2368] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:43.906925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:43.912663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:43.913392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Getting quotas for project e3ba4ea8e9c94ae5a32cc7a933a777cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:43.927712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:43.928357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:43.928910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:43.929888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:43.930424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:43.931216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:43.932525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Getting quotas for user 7e4c22d37f6c48d59b0fa7e832c0451d and project e3ba4ea8e9c94ae5a32cc7a933a777cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:43.976419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:43.982309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:44.014395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:44.095182 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4383137-b446-4465-91f1-d8adef059677 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179124 Aug 29 10:44:44.095765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1166/2369] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:44.236538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd75d88-63e1-441e-8d84-aa355a7d15ee", "name": "network-vif-plugged", "status": "completed", "tag": "60f39c1c-b970-4b6a-862b-4681bfa43d81"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:44.262972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:44.265028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:44.268953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:44.298574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] Creating event network-vif-plugged:60f39c1c-b970-4b6a-862b-4681bfa43d81 for instance dbd75d88-63e1-441e-8d84-aa355a7d15ee on n-h2-854121-10 Aug 29 10:44:44.307402 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6de75204-3ab4-4c36-b5a1-3ce2c34f5f8c req-f1be4419-70fb-4465-8391-6d272fa92331 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210394 Aug 29 10:44:44.309003 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1167/2370] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:44.325992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:44.327358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:44.339567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:44.341434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:44.342358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:44.345818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:44.346535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:44.347183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:45.445832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:45.483401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e59d3ceb-7a67-4124-b2f6-567a28eb2e8f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 1.591280 Aug 29 10:44:45.502950 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1204/2371] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:43 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:45.515734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:45.524541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:45.539968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:45.554015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:45.556950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:45.558586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:45.561103 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53b9003c-4025-48dc-9de8-7ed86b1c9868 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1318 microversion: 2.1 time: 1.241454 Aug 29 10:44:45.564472 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1168/2372] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:44 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:45.575769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:45.576764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:45.577233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:45.581318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.150"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:45.592336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:45.601642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:45.602517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:45.603165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:45.604278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:45.604931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:45.605560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:45.636122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:44:45.637380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquired lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:44:46.420138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:46.431268 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cebc6455-b706-4c7b-a67d-39d12561411f tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.936675 Aug 29 10:44:46.432354 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1205/2373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:45 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:46.448705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:46.453045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:46.467504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.468886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.469494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:46.470441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.471095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.471691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:46.640508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:46.653942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f78ecf1-20ba-4706-b4b5-0217e14e4532 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1269 microversion: 2.1 time: 0.208563 Aug 29 10:44:46.654580 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1206/2374] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:46 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:46.665280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c868c38b-82e9-4191-b5c4-e0f4d8012de1 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6eedca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:46.728270 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c868c38b-82e9-4191-b5c4-e0f4d8012de1 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1429 microversion: 2.1 time: 0.069372 Aug 29 10:44:46.729384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1207/2375] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:46 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:46.735046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d9f98c-962c-4329-b37a-ffc99828ed5f", "tag": "40ff8956-3d8e-4789-bc62-b416db7c2a2e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:46.745069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.745879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.746482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:46.762795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] Creating event network-changed:40ff8956-3d8e-4789-bc62-b416db7c2a2e for instance a0d9f98c-962c-4329-b37a-ffc99828ed5f on n-h2-854121-10 Aug 29 10:44:46.770991 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-944ac459-dbf7-46da-a031-29030fd57246 req-a8a8dc7f-480b-423f-9d1a-afdd7245372c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040111 Aug 29 10:44:46.772371 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1208/2376] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:46.780788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089c491c-4d5b-46f0-841b-f04a161b9068", "name": "network-vif-plugged", "status": "completed", "tag": "043cc140-449c-47a1-b030-fdd429a26e32"}, {"server_uuid": "9c538ce3-5bf5-4b58-ae7c-1da21b710e1f", "name": "network-vif-plugged", "status": "completed", "tag": "1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:46.794770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.795520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.796274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:46.812295 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Creating event network-vif-plugged:043cc140-449c-47a1-b030-fdd429a26e32 for instance 089c491c-4d5b-46f0-841b-f04a161b9068 on n-h2-854121-10 Aug 29 10:44:46.814117 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] Creating event network-vif-plugged:1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6 for instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f on n-h1-854121-10 Aug 29 10:44:46.833997 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0ea2bf56-0aff-425a-bf2f-3fd8602fbe23 req-824e87a0-8db2-40d7-848c-c1886c9e5f33 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059154 Aug 29 10:44:46.836110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1209/2377] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:46.844429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:46.845846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:46.855799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.857121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.857758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:46.859307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:46.859931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:46.860655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:47.960824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:47.973154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9507bad2-8383-46f7-800c-92342bc11ff8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1308 microversion: 2.1 time: 1.135628 Aug 29 10:44:47.991226 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1210/2378] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:46 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1308 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:48.001069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:48.002170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:48.009877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:48.011261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:48.011817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:48.012852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:48.013593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:48.014155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:48.556392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:48.564613 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96c397a8-caba-4f57-8147-90004f25e419 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1318 microversion: 2.1 time: 0.570071 Aug 29 10:44:48.565490 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1211/2379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:47 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:48.570480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:48.573756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:48.583119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:48.584316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:48.585134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:48.586559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:48.587043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:48.588188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.016740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:49.026974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31a00f60-70b4-4d01-a1e0-36aead5cd3ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1319 microversion: 2.1 time: 0.459907 Aug 29 10:44:49.041474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1212/2380] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:48 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:49.047401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:49.048409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:49.055681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.056490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.057120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.058284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.058927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.059619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.199979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:49.208752 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c4e1f79-0795-46b7-bd74-5dca4898179d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1275 microversion: 2.1 time: 0.165613 Aug 29 10:44:49.223628 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1213/2381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:49 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:49.228933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e621e904-6dfe-4d34-bb7c-0a811afa23ce tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6e8ec10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:49.282820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e621e904-6dfe-4d34-bb7c-0a811afa23ce tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1438 microversion: 2.1 time: 0.057649 Aug 29 10:44:49.283451 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1214/2382] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:49 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1438 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:49.288213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:49.289030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:49.297499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.298250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.298848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.299856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.300470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.301055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.644884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:49.655886 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bfed0962-725e-455b-83ed-e1e0b0349f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1487 microversion: 2.1 time: 0.371285 Aug 29 10:44:49.657202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1215/2383] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:49 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1487 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:49.671427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ae41628-f838-49b4-880e-75e8330d324b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6e8e820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:49.738311 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ae41628-f838-49b4-880e-75e8330d324b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 200 len: 1438 microversion: 2.1 time: 0.079600 Aug 29 10:44:49.738900 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1216/2384] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:49 2022] GET /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:49.747461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:49.748123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:49.756041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:49.757575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.758138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.758615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:49.759719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:49.760603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:49.760603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:50.450866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:50.467063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:50.468858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:50.470655 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f327ddb-c338-49b4-b024-af79843cc614 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2948 microversion: 2.42 time: 0.730690 Aug 29 10:44:50.471375 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1217/2385] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:49 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2948 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:50.476504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d9f98c-962c-4329-b37a-ffc99828ed5f", "name": "network-vif-plugged", "status": "completed", "tag": "40ff8956-3d8e-4789-bc62-b416db7c2a2e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:50.488059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:50.488892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:50.489498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:50.508050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] Creating event network-vif-plugged:40ff8956-3d8e-4789-bc62-b416db7c2a2e for instance a0d9f98c-962c-4329-b37a-ffc99828ed5f on n-h2-854121-10 Aug 29 10:44:50.515877 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-283b0caa-91ad-4381-be18-bc7188e0e53c req-91f1ac7b-9669-47cb-a3ba-bcc15af4344c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043177 Aug 29 10:44:50.516731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1218/2386] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:50.521957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:50.522810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:50.530606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:50.531106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:50.531584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:50.532801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:50.532978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:50.533590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:50.570418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:50.936850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:50.946124 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-726b58e5-445a-43bb-8854-770d33d84d27 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1468 microversion: 2.1 time: 0.428402 Aug 29 10:44:50.956244 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1219/2387] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:50 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1468 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:50.968572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:50.969135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:50.978028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:50.978544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:50.979192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:50.981003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:50.981003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:50.983421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.020097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lazy-loading 'flavor' on Instance uuid dbd75d88-63e1-441e-8d84-aa355a7d15ee {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:44:51.107549 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-abc6c9a8-ed80-49d3-8874-43f499051ed0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee/action" status: 202 len: 0 microversion: 2.1 time: 0.148974 Aug 29 10:44:51.111787 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1220/2388] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:50 2022] POST /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:44:51.260308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1193668070", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:51.339805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:51.340225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:51.341321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:51.342004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:51.342168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:51.352920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.353811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.354257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.355256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.355531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.357406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.385113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Getting quotas for project a3689137fc344b2b9f136f4917cc75f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:51.392709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Getting quotas for user d2d08ba84dc446bbbe3ebf2365d66ce9 and project a3689137fc344b2b9f136f4917cc75f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:51.409086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:51.411699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:51.426380 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.neutron [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] re-assign floating IP 172.25.3.150 from instance 864ecced-20b1-4ddc-ae7c-87146d360f86 Aug 29 10:44:51.472420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a62139f4-e307-4b71-b7b5-299183fbebb7 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.361983 Aug 29 10:44:51.473430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1221/2389] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:44:51.487130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:51.490351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:51.490684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Building network info cache for instance {{(pid=128682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:44:51.516793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.517360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.517841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.518843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.519432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.519884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.848572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:51.862950 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-319fce85-a442-449e-b9db-44fb84053c6b tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1467 microversion: 2.1 time: 0.388359 Aug 29 10:44:51.863542 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1222/2390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:51 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1467 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:51.881090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:51.881738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:51.891588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.892085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.892532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:51.893232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:51.893691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:51.894141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.172570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:52.190377 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80579ca3-9cf1-4ede-bd51-6cc17495de9e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1468 microversion: 2.1 time: 0.321660 Aug 29 10:44:52.191308 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1223/2391] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:51 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:52.198562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:52.199497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:52.206434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.207770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.208558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.209481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.210166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.211902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.597105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:52.611837 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9b5a2da-8af6-4027-85fd-63268b027dc1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.418040 Aug 29 10:44:52.613244 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1224/2392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:52 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:52.621554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:52.623057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:52.633035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.633548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.634018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.637926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.639506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Updating instance_info_cache with network_info: [{"id": "95fbce57-72b7-45ad-bece-e8308aca8135", "address": "fa:16:3e:65:2e:f0", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95fbce57-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:44:52.640991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.641553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.656772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Building network info cache for instance {{(pid=128682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:44:52.862576 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbccbf5c-7c58-43bf-9486-36a6b5f8a957 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.243123 Aug 29 10:44:52.863924 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1225/2393] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:44:52 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6/os-interface => generated 1831 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:52.869504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:52.870532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:52.878509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.879009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.879478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:52.880185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:52.880801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:52.881232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.385125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.394694 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-958bf251-0c63-4ca2-ba62-4c56395fba9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 1467 microversion: 2.1 time: 0.529283 Aug 29 10:44:53.395290 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1226/2394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:52 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 1467 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:53.400365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:53.401134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:53.408505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.409212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.409824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.410729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.411532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.412132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.636846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.645362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee8e947f-8b93-4aad-9459-293274d2b705 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 200 len: 1478 microversion: 2.1 time: 0.248743 Aug 29 10:44:53.646096 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1227/2395] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:53 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:53.650688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:53.660838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.661294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.661820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.675412 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] Creating event network-changed:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:44:53.680185 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f996af84-eca8-4040-8982-81c2be824e84 req-84146763-fde5-42e4-9b55-4d5e710e6aac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Aug 29 10:44:53.680777 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1228/2396] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:53.687678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:53.688382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:53.694493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.694975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.695405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.696101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.696549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.696967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.783699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.788012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Updating instance_info_cache with network_info: [{"id": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742", "address": "fa:16:3e:ca:7b:82", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7ecdd3b1-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:44:53.791805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.793232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.795079 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-828136c2-6fab-40dd-a2f6-872bc6a1a915 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8" status: 200 len: 1336 microversion: 2.47 time: 0.113225 Aug 29 10:44:53.795644 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1229/2397] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:53 2022] GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:53.800627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-05ea25b8-9f62-4bb5-a8d1-625f5d7d5aaf tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6e30280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:53.801969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:53.804317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Releasing lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:44:53.805850 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b7b25c8-e52f-40f0-aa58-ee433f8865ed tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58/action" status: 202 len: 0 microversion: 2.1 time: 8.231664 Aug 29 10:44:53.807009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1169/2398] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:45 2022] POST /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58/action => generated 0 bytes in 8242 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:44:53.816016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:53.816726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:53.825522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.826300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.827235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.828367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.829137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.829607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.963681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:53.966056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:53.973390 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c848cd65-e8f6-49e1-8c8e-1b87fd1e6b70 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f" status: 200 len: 1469 microversion: 2.1 time: 0.164259 Aug 29 10:44:53.974019 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1170/2399] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:53 2022] GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:53.978860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1412737044"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:53.985508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:53.993831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.994327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.994773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:53.995537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:53.995998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:53.996429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.147796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:54.196148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51fb6a4a-8ec7-4c26-b231-edcc987055ca tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "POST /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3/action" status: 202 len: 0 microversion: 2.1 time: 0.220801 Aug 29 10:44:54.196798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1171/2400] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:53 2022] POST /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:44:54.209150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-unplugged", "status": "completed", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:54.221547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.222055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.222578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.235665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] Creating event network-vif-unplugged:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:44:54.240478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f74419d4-d1f9-4e35-9683-23ceca4be246 req-f30a5b5f-3f0a-4854-ab3a-051446c50d2c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042237 Aug 29 10:44:54.241142 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1172/2401] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:54.246805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:54.247455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:54.254781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.255350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.255806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.256519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.256978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.257406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.406256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:54.415942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a0b108c-7541-4ad9-a68a-d40a1113ece1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.173354 Aug 29 10:44:54.416534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1173/2402] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:54 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:54.422321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1504819801"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:54.424946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:54.431237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.431940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.432535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.433391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.434028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.435167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.467559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-05ea25b8-9f62-4bb5-a8d1-625f5d7d5aaf tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "DELETE /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc" status: 204 len: 0 microversion: 2.1 time: 0.670837 Aug 29 10:44:54.468149 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1230/2403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:53 2022] DELETE /compute/v2.1/images/7bc19122-bf8b-4147-894d-93fe02ca54cc => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:54.473283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.150"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:54.609443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:54.616964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.618244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.619206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.620111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.620780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.621408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.681272 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0024d5f8-3f84-44e6-9a37-5da848fb42a8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee/action" status: 202 len: 0 microversion: 2.1 time: 0.263463 Aug 29 10:44:54.682521 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1174/2404] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:54 2022] POST /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:44:54.689844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-269802176", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:54.760425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:54.761129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:54.762047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:54.763858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:54.764855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:54.776943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.778512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.779287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.780267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.781259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.781999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.808216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Getting quotas for project a3689137fc344b2b9f136f4917cc75f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:54.815993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Getting quotas for user d2d08ba84dc446bbbe3ebf2365d66ce9 and project a3689137fc344b2b9f136f4917cc75f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:54.831493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:54.834138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:54.904809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5bbc4ebf-8178-4f0f-800d-25c687767dd3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.218858 Aug 29 10:44:54.906442 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1175/2405] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:44:54.911866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:54.918463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:54.921563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Searching by: {'reservation_id': 'r-aqgbhjih', 'deleted': False, 'project_id': '0c15797a6a384952a37fe2ca744e22a3'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:44:54.927793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.928373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.928808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:54.929588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:54.930189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:54.930619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.051346 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] HTTP exception thrown: Floating IP 172.25.3.150 is not associated with instance 864ecced-20b1-4ddc-ae7c-87146d360f86. Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Request method failure captured: Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action HTTP/1.1 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 49 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhbCLeVtNmTHF31-ItQDu4dR4JXacRrIsVCSOMbpmkT6jrVuX8rLvuVhfz__e3MJ2PInAm7Q1v2oqQ29V93iH2vrYVQoGoQw02Ig36RJVnD-CGh72g-CrDz4doiCCtzkLbi-E4RrPCD7PCfxZ6NoY_yh2qkREWt8fQPg0olr4_-3Zo Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 615f56cde3bf42649a599f66eaeaca6f Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: {"removeFloatingIp": {"address": "172.25.3.150"}} Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: exception: Floating IP 172.25.3.150 is not associated with instance 864ecced-20b1-4ddc-ae7c-87146d360f86. Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '864ecced-20b1-4ddc-ae7c-87146d360f86', 'body': {'removeFloatingIp': {'address': '172.25.3.150'}}} Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.150 is not associated with instance 864ecced-20b1-4ddc-ae7c-87146d360f86. Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.150 is not associated with instance 864ecced-20b1-4ddc-ae7c-87146d360f86. Aug 29 10:44:55.053117 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.056566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Returning 409 to user: Floating IP 172.25.3.150 is not associated with instance 864ecced-20b1-4ddc-ae7c-87146d360f86. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:44:55.056566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dae0588a-d3d4-4d1c-bd0d-88591b509964 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action" status: 409 len: 146 microversion: 2.1 time: 0.585197 Aug 29 10:44:55.056566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1231/2406] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:54 2022] POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action => generated 146 bytes in 586 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:44:55.061121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35f5e7da-db20-483d-9713-d1259f786aee tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e37b80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.078314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:44:55.134943 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35f5e7da-db20-483d-9713-d1259f786aee tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 200 len: 1455 microversion: 2.1 time: 0.075881 Aug 29 10:44:55.140897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1232/2407] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:55.146872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbd2738e-7815-442f-ac01-df042afd6050 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '.version_select at 0x7f66c6e5d040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.176415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:55.179381 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-dbd2738e-7815-442f-ac01-df042afd6050 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] HTTP exception thrown: Image not found. Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbd2738e-7815-442f-ac01-df042afd6050 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Request method failure captured: Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 HTTP/1.1 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhPlU_gaY8vXTtzswapy3qxgoVlRtt8pDJtVrbbdQqovTjG9NV6ATUelgZ1q31GC10b0qUp0M1wgUe-fiA1LFqvl8nugzhA3hK2oDQqlUECMhaPkDuaTzD8O1EqGMTrXrzgqEfP6qKrHL504L8OwlUvOp31cHBgSO-C7hMqdj_tqYo Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c51da1350111427ab3fe355344743f4e Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '50f16575-c2e7-44b2-a7c5-b9ba3f604868'} Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50f16575-c2e7-44b2-a7c5-b9ba3f604868 to delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50f16575-c2e7-44b2-a7c5-b9ba3f604868 could not be found. Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.182338 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:44:55.187476 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:44:55.188796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.188796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.188796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.189974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbd2738e-7815-442f-ac01-df042afd6050 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:44:55.190878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbd2738e-7815-442f-ac01-df042afd6050 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "DELETE /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868" status: 404 len: 62 microversion: 2.1 time: 0.048698 Aug 29 10:44:55.191495 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1233/2408] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:55 2022] DELETE /compute/v2.1/images/50f16575-c2e7-44b2-a7c5-b9ba3f604868 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:44:55.196123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d047ee44-e13c-4d99-bd34-d1fd6e48e0b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e7eb80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.253851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d047ee44-e13c-4d99-bd34-d1fd6e48e0b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 200 len: 1440 microversion: 2.1 time: 0.061032 Aug 29 10:44:55.261649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1234/2409] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 1440 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:55.261649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fdf6b9b-017d-46ec-b144-9c53b139e0c3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:55.264003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1fdf6b9b-017d-46ec-b144-9c53b139e0c3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.306531 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1fdf6b9b-017d-46ec-b144-9c53b139e0c3 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "PUT /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 991 microversion: 2.47 time: 0.049894 Aug 29 10:44:55.307055 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1235/2410] 10.222.0.47 () {62 vars in 1297 bytes} [Mon Aug 29 10:44:55 2022] PUT /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:44:55.312987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.150"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:55.435515 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06650fff-8591-4068-8a95-29eb27b6a1a3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?reservation_id=r-aqgbhjih" status: 200 len: 2930 microversion: 2.1 time: 0.527877 Aug 29 10:44:55.436125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1176/2411] 10.222.0.47 () {58 vars in 1197 bytes} [Mon Aug 29 10:44:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-aqgbhjih => generated 2930 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:55.445769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.446585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.454702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.455298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.455804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.456634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.457222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.457765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.485456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:44:55.517400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.526246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.526837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.527488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.529323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.530136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.530668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.574002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a0e8cf1-6ca0-4937-a98d-de44baa33986 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "DELETE /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 204 len: 0 microversion: 2.1 time: 0.135052 Aug 29 10:44:55.574603 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1177/2412] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:44:55 2022] DELETE /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:55.583511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.584215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.590149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.590659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.591096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.591792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.592246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.592672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.683868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:55.693182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:55.694643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:55.695770 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9cf29e25-802c-4c21-a332-0c6387fb8c2b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1273 microversion: 2.47 time: 0.118673 Aug 29 10:44:55.696559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1178/2413] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:55.701921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.702533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.708895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.709388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.710015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.710749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.711205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.711633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.796344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:44:55.796753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquired lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:44:55.923528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:55.931185 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-69a91f7a-515e-48af-a899-6278598787de tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.233821 Aug 29 10:44:55.931761 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1179/2414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:55.936646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.950155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_groups [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Querying cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) for 2 instances {{(pid=128682) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 10:44:55.950853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.951325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.952047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.971204 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee3f855e-e55f-4e01-b66f-e50002be45fc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/d3d93d67-1f7b-49c2-b1b5-b68dff202be2" status: 200 len: 271 microversion: 2.1 time: 0.038393 Aug 29 10:44:55.971779 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1180/2415] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/os-server-groups/d3d93d67-1f7b-49c2-b1b5-b68dff202be2 => generated 271 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:55.978074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:55.978879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:55.986309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.986930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.987546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:55.988355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:55.988920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:55.989625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.319433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:56.328443 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ddf6ed74-dff3-49c2-9cfa-de99c110790d tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1473 microversion: 2.1 time: 0.355687 Aug 29 10:44:56.329080 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1181/2416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:55 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1473 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:56.333736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817fec32-3127-4f17-90cc-e74790899f58", "tag": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742"}, {"name": "network-changed", "server_uuid": "de87605b-3cef-45a8-b1f0-ce3c0c3be2ee", "tag": "628e4687-e050-422e-a779-9db9a22d5f9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:56.344889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:56.345374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:56.345840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.358565 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Creating event network-changed:7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742 for instance 817fec32-3127-4f17-90cc-e74790899f58 on n-h2-854121-10 Aug 29 10:44:56.359061 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] Creating event network-changed:628e4687-e050-422e-a779-9db9a22d5f9b for instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee on n-h2-854121-10 Aug 29 10:44:56.365357 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e9b13f70-6a58-4e17-8196-b9922d75d41c req-293c8a67-3057-4d53-afaf-56bf1837d5b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035198 Aug 29 10:44:56.366137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1182/2417] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:56.370774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:56.371538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:56.378227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:56.378711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:56.379151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.379846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:56.380302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:56.380729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.673425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b4a21f7-0d8b-4351-9a65-442038977102 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1621 microversion: 2.1 time: 0.306176 Aug 29 10:44:56.674036 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1183/2418] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:56 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1621 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:56.678482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-915d93e3-709e-4e7c-88dd-b9210d790634 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c73d1d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:56.724795 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-915d93e3-709e-4e7c-88dd-b9210d790634 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 200 len: 1455 microversion: 2.1 time: 0.049717 Aug 29 10:44:56.727915 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1184/2419] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:56 2022] GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:56.733816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-372e8df9-e491-439f-a522-f540db24bb43 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c708e280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:56.785016 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-372e8df9-e491-439f-a522-f540db24bb43 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 200 len: 1440 microversion: 2.1 time: 0.058487 Aug 29 10:44:56.785924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1185/2420] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:56 2022] GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 1440 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:56.790975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:56.791749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:56.798480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:56.798964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:56.799423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.800111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:56.800558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:56.800978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:56.815512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:44:57.020313 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-075edf4b-7df9-4fae-b7c1-9d77d5e0e932 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f" status: 200 len: 1622 microversion: 2.1 time: 0.232687 Aug 29 10:44:57.021425 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1186/2421] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:56 2022] GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f => generated 1622 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:57.026818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:57.027436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:57.039561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:57.039561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:57.039561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:57.041678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:57.042595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:57.043039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:57.149872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:57.161433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:57.163471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:57.164880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f416772-ae27-4e30-9519-de598cf2f28d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1273 microversion: 2.47 time: 0.141972 Aug 29 10:44:57.165566 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1187/2422] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:57 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:57.184090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:57.186104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:57.194821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:57.194821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:57.194821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:57.195344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:57.195344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:57.195344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:57.202938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:44:57.894910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:57.904926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e729a186-5898-4091-a387-1ff066faa80c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.731242 Aug 29 10:44:57.905521 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1188/2423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:57 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:57.914906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1201662636", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "ec53f44c-01e4-4b61-8350-cea8fd318518"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:58.039026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:44:58.063004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Updating instance_info_cache with network_info: [{"id": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742", "address": "fa:16:3e:ca:7b:82", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7ecdd3b1-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:44:58.078121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Releasing lock "refresh_cache-817fec32-3127-4f17-90cc-e74790899f58" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:44:58.079358 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54f8047a-2cff-4762-ba1c-21b26858fe49 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58/action" status: 202 len: 0 microversion: 2.1 time: 2.770913 Aug 29 10:44:58.083682 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1236/2424] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:44:55 2022] POST /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58/action => generated 0 bytes in 2776 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:44:58.088606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:58.089313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:58.096517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:58.097189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:58.097634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:58.098365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:58.098982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:58.099557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:58.564865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51da1350111427ab3fe355344743f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0d634d151046a89a49c4e938d8dc36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:58.576929 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80b9d0a1-3405-4868-ab95-10daf7d312dc tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 200 len: 1473 microversion: 2.1 time: 0.491630 Aug 29 10:44:58.577642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1237/2425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:58 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 1473 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:58.583561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d50d8d9e-fbcc-43ee-8d5f-96652390b734 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c758f790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:58.789368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:44:58.790102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:44:58.790756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:44:58.791344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:44:58.792410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:44:58.813737 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d50d8d9e-fbcc-43ee-8d5f-96652390b734 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 200 len: 1455 microversion: 2.1 time: 0.234180 Aug 29 10:44:58.814822 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1238/2426] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:58 2022] GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 1455 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:58.817274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:58.817793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:58.818238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:58.818978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:58.819444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:58.819852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:58.827543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c44a0b9-a7c6-4491-881c-d36f3b8f2190 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e50f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:58.867949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:44:58.878771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:44:58.914293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:44:58.921770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:44:59.010156 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b05d3a0d-5363-4ea8-88d4-f7a449515e48 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103502 Aug 29 10:44:59.019363 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1189/2427] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:44:59.024338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:59.024899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:59.034356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.035038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.035829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.036774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.037403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.038146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.093534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:44:59.234340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-532676c2-8588-44ac-9eba-3da695f02d07 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "DELETE /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 204 len: 0 microversion: 2.1 time: 0.213473 Aug 29 10:44:59.240994 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1190/2428] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:44:59 2022] DELETE /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:44:59.248627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:59.250583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:59.261932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.263590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.264312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.265338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.266005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.266618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.354466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:59.366451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:59.367818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:59.368966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70be2772-20c3-4a16-9b88-5fd8813e9c65 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1335 microversion: 2.47 time: 0.132094 Aug 29 10:44:59.369543 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1191/2429] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:44:59 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:44:59.374529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817fec32-3127-4f17-90cc-e74790899f58", "tag": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:44:59.410324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.410813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.411327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.433569 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] Creating event network-changed:7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742 for instance 817fec32-3127-4f17-90cc-e74790899f58 on n-h2-854121-10 Aug 29 10:44:59.445284 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f043f886-ac23-4d9e-9723-0be50a275ed6 req-850f95a9-9093-4fe5-af5e-6d7e0a35c233 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073597 Aug 29 10:44:59.475712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1192/2430] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:44:59.483113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:59.483820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:59.518209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.519326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.519995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.525124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.525935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.529983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.863548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:44:59.873733 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9752f6f8-5fc4-4c3e-a2de-acf0a949ad81 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.394935 Aug 29 10:44:59.897686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1193/2431] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:59 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:44:59.904997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:44:59.905932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:44:59.912811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.913498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.914127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:44:59.914982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:44:59.915589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:44:59.916369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:00.057885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:00.077643 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc8c4417-b7ec-4729-a827-4dda7e02f2b5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1221 microversion: 2.1 time: 0.177890 Aug 29 10:45:00.079354 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1194/2432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:44:59 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:00.095436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.150"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:00.102141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:00.113933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:00.129066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:00.131739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:00.132403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:00.135937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:00.136606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:00.137214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:00.219660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:45:00.220105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquired lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:45:01.375884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:01.402271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:04.988625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Building network info cache for instance {{(pid=128682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:45:06.190668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Updating instance_info_cache with network_info: [{"id": "95fbce57-72b7-45ad-bece-e8308aca8135", "address": "fa:16:3e:65:2e:f0", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95fbce57-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:45:06.206663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Releasing lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:45:06.211293 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-edd29505-12dc-42ef-88a4-4e580934dcc9 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action" status: 202 len: 0 microversion: 2.1 time: 6.126908 Aug 29 10:45:06.216875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1195/2433] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:00 2022] POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action => generated 0 bytes in 6136 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:45:06.240839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:06.241461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] [instance: 19cac30a-0ec9-4c48-8bf5-e9d591349266] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:06.277537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:06.278067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:06.279113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:06.279948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:06.280408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:06.290343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:06.360926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] HTTP exception thrown: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Request method failure captured: Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 HTTP/1.1 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhPlU_gaY8vXTtzswapy3qxgoVlRtt8pDJtVrbbdQqovTjG9NV6ATUelgZ1q31GC10b0qUp0M1wgUe-fiA1LFqvl8nugzhA3hK2oDQqlUECMhaPkDuaTzD8O1EqGMTrXrzgqEfP6qKrHL504L8OwlUvOp31cHBgSO-C7hMqdj_tqYo Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a0d634d151046a89a49c4e938d8dc36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5a0d634d151046a89a49c4e938d8dc36 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1395497627 Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c51da1350111427ab3fe355344743f4e Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesOneServerTestJSON-1395497627-project Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '19cac30a-0ec9-4c48-8bf5-e9d591349266'} Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:06.364737 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] Returning 404 to user: Instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:06.369507 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3debcedc-b70e-4536-9a17-b1bcd3211a16 tempest-ImagesOneServerTestJSON-1395497627 tempest-ImagesOneServerTestJSON-1395497627-project] 10.222.0.47 "GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266" status: 404 len: 111 microversion: 2.1 time: 0.143686 Aug 29 10:45:06.384865 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1196/2434] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:06 2022] GET /compute/v2.1/servers/19cac30a-0ec9-4c48-8bf5-e9d591349266 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:06.402606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56b337c6-a97c-4ed1-befc-26aed5639db6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c708e280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:08.094233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:08.583510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:08.836470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:08.906169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:13.277149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c44a0b9-a7c6-4491-881c-d36f3b8f2190 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 200 len: 1440 microversion: 2.1 time: 14.460628 Aug 29 10:45:13.278078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1239/2435] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:44:58 2022] GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 1440 bytes in 14462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:13.284591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd75d88-63e1-441e-8d84-aa355a7d15ee", "name": "network-vif-plugged", "status": "completed", "tag": "60f39c1c-b970-4b6a-862b-4681bfa43d81"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:13.297413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.297998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.298446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.311993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] Creating event network-vif-plugged:60f39c1c-b970-4b6a-862b-4681bfa43d81 for instance dbd75d88-63e1-441e-8d84-aa355a7d15ee on n-h2-854121-10 Aug 29 10:45:13.314995 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56b337c6-a97c-4ed1-befc-26aed5639db6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 200 len: 1464 microversion: 2.1 time: 6.925445 Aug 29 10:45:13.315877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1197/2436] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:06 2022] GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 1464 bytes in 6928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:13.320483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.321097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:13.326028 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9b62f13b-f7e3-4e55-823c-f23e3408729b req-46015806-5b29-4edd-9034-2fcf750e74ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045140 Aug 29 10:45:13.327505 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1240/2437] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:13.328862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.330343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.330447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.331136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.331658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.332038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.333190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.334027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:13.340198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.340681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.342022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.342895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.343359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.343793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.408894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:13.417173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:13.418649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:13.419847 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-982f9af2-039c-493c-8489-e10dc75259a4 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1356 microversion: 2.47 time: 0.102940 Aug 29 10:45:13.420613 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1198/2438] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:13.424972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.425581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:13.431850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.431850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.432290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.432986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.433445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.433961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.525034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:13.532847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10a4ae7b-03ba-45dd-87b7-a83f97459e7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.204138 Aug 29 10:45:13.533420 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1241/2439] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:13.537770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cac30a-0ec9-4c48-8bf5-e9d591349266", "name": "network-vif-deleted", "tag": "bd10fc0a-eb5d-4269-b201-f60491d19d2d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:13.547917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.548393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.548829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.560190 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] Creating event network-vif-deleted:bd10fc0a-eb5d-4269-b201-f60491d19d2d for instance 19cac30a-0ec9-4c48-8bf5-e9d591349266 on n-h2-854121-10 Aug 29 10:45:13.565676 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-38156983-61a6-452a-8d05-729113f495ad req-ef0c6ef8-5075-4bc5-a3be-8b69078f82c0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031095 Aug 29 10:45:13.566305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1242/2440] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:13.586289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:13.594559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e23867f9-569e-405a-9a9a-ea2fc39ccaac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1317 microversion: 2.1 time: 0.173074 Aug 29 10:45:13.595364 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1199/2441] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:13.616769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c6a01ae-3c17-4ad6-9a7c-7f1763981b99 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '.version_select at 0x7f66c77ed550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.723280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ae26be-5b3e-4efd-b98c-afe870e6cf80", "tag": "d3a9a770-c5a2-4991-a281-5d18327015fb"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:13.740081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.740661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.741175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.752538 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] Creating event network-changed:d3a9a770-c5a2-4991-a281-5d18327015fb for instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 on n-h1-854121-10 Aug 29 10:45:13.757679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-efbb6d70-69c3-4eab-98de-1ff25bf0eb99 req-bf1310d2-243b-4b42-894d-e9e8e4c3eda0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190026 Aug 29 10:45:13.758396 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1243/2442] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:13.814944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c6a01ae-3c17-4ad6-9a7c-7f1763981b99 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/6fa1c8f3-b32e-48c8-8ffe-340c48b6431a" status: 200 len: 184 microversion: 2.1 time: 0.202053 Aug 29 10:45:13.815735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1200/2443] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/os-floating-ips/6fa1c8f3-b32e-48c8-8ffe-340c48b6431a => generated 184 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:13.820680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89805d84-b597-4315-a342-cad039ad3cfb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c74f0550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.828633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Calling method '.version_select at 0x7f66c6dec3a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:13.842627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.843123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.843572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.844311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.844905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.845344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.869860 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-790413e5-1114-4346-9046-0f8ee4e0610c tempest-AbsoluteLimitsTestJSON-1392066678 tempest-AbsoluteLimitsTestJSON-1392066678-project] 10.222.0.47 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.107073 Aug 29 10:45:13.871084 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89805d84-b597-4315-a342-cad039ad3cfb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 200 len: 1464 microversion: 2.1 time: 0.054167 Aug 29 10:45:13.873003 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1201/2444] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:13.878002 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1244/2445] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 10:45:13 2022] GET /compute/v2.1/limits => generated 511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:13.885345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:13.887737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.150"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:13.888443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:13.895844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.896468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.896912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:13.897636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:13.898117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:13.898541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.015997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:45:14.016409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:45:14.016884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:45:14.017292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:45:14.017731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:45:14.064915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:14.073576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.074309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.075104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.077617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.079548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.080597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.124272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:14.136157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.141417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.142187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.142656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.144108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.144553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.214941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68653ccf-9745-4cbb-b668-9edb27107de8 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "POST /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392/action" status: 202 len: 1078 microversion: 2.47 time: 0.340859 Aug 29 10:45:14.233360 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1202/2446] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:45:13 2022] POST /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392/action => generated 1078 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 10:45:14.246576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:14.247809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:14.269829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.270350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.270963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.271877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.274508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.275106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.429045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 10:45:14.429978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquired lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 10:45:14.565329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:14.573904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84ea3e36-d521-4908-ab07-6745a7eb4a9c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 1467 microversion: 2.1 time: 0.339799 Aug 29 10:45:14.574571 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1203/2447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:14 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 1467 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:14.584129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:14.585198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:14.592299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.593080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.593604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.594385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.594900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.595386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.705316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:14.713532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:14.714986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:14.716314 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-298e1b99-08f4-4561-84f1-1ee29e0f326f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.139700 Aug 29 10:45:14.725735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1204/2448] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:14 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:14.729543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7133b345-f54f-4aaa-99c5-d25088538de4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6ebd940>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:14.775608 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7133b345-f54f-4aaa-99c5-d25088538de4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 200 len: 1449 microversion: 2.1 time: 0.057308 Aug 29 10:45:14.776179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1205/2449] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:14 2022] GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 1449 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:14.781614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:14.782252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:14.788838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.789329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.789912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.790591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:14.791186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:14.791469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:14.810991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:15.084462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:15.092988 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22a540a3-d109-40a4-8752-48dd6c8ac6e2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.315526 Aug 29 10:45:15.093920 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1206/2450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:14 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:15.098485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-676589835"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:15.100795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:15.106807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.107457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.107903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.108601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.109192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.109469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.330151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e00f02c2-144e-4c08-af6a-f51cac1d0bef tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "POST /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068/action" status: 202 len: 0 microversion: 2.1 time: 0.234966 Aug 29 10:45:15.331151 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1207/2451] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:15 2022] POST /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:45:15.337525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:15.338261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:15.345209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.345723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.346362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.347314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.347968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.348397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.656614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:15.664471 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-146abd2c-5de1-4909-a20d-b9711dc6c4bc tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1317 microversion: 2.1 time: 0.331819 Aug 29 10:45:15.665178 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1208/2452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:15 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:15.688797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ab2d3f5-5a99-4b59-a20e-4a92992cb92f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66cb0d39d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:15.710266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 10:45:15.768795 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ab2d3f5-5a99-4b59-a20e-4a92992cb92f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 200 len: 1449 microversion: 2.1 time: 0.101753 Aug 29 10:45:15.769576 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1209/2453] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:15 2022] GET /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 1449 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:15.780509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7aec88f6-8d08-463d-a24e-34c875d6fb35 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f83700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:15.830282 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7aec88f6-8d08-463d-a24e-34c875d6fb35 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.059370 Aug 29 10:45:15.835256 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1210/2454] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:15 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:15.842513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de87605b-3cef-45a8-b1f0-ce3c0c3be2ee", "name": "network-vif-plugged", "status": "completed", "tag": "628e4687-e050-422e-a779-9db9a22d5f9b"}, {"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-plugged", "status": "completed", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}, {"server_uuid": "31ae26be-5b3e-4efd-b98c-afe870e6cf80", "name": "network-vif-plugged", "status": "completed", "tag": "d3a9a770-c5a2-4991-a281-5d18327015fb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:15.860338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.861339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.863563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.891148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Creating event network-vif-plugged:628e4687-e050-422e-a779-9db9a22d5f9b for instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee on n-h2-854121-10 Aug 29 10:45:15.892735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Creating event network-vif-plugged:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:45:15.894041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] Creating event network-vif-plugged:d3a9a770-c5a2-4991-a281-5d18327015fb for instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 on n-h1-854121-10 Aug 29 10:45:15.909817 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7a72add1-f019-4b8a-8a7a-938f2ad4c468 req-49236ff4-ece5-4c04-a017-d2254bb56ebb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072506 Aug 29 10:45:15.911139 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1211/2455] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:15.917232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817fec32-3127-4f17-90cc-e74790899f58", "name": "network-vif-deleted", "tag": "7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742"}, {"name": "network-changed", "server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:15.932858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:15.933843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:15.935169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:15.952846 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Creating event network-vif-deleted:7ecdd3b1-e9d5-4dd1-b7cb-c83abfe32742 for instance 817fec32-3127-4f17-90cc-e74790899f58 on n-h2-854121-10 Aug 29 10:45:15.953394 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] Creating event network-changed:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:45:15.991131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7e796481-33d4-4281-af8a-afc3e957e1d2 req-4d85bca7-bb0f-4782-be3b-2d96e2e5bf80 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058590 Aug 29 10:45:15.991817 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1212/2456] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:16.012277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:16.012277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:16.046272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.046843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.047295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.048038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.048503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.048950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.241108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:16.261624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:16.264739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:16.269328 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64c218f3-73e2-47da-8b4b-ebf40ca72eed tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.272848 Aug 29 10:45:16.271009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1213/2457] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:15 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:16.280745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c440f814-94f0-4e70-b92c-d2d74d1d1a39 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c711b430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:16.554610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Updating instance_info_cache with network_info: [{"id": "95fbce57-72b7-45ad-bece-e8308aca8135", "address": "fa:16:3e:65:2e:f0", "network": {"id": "bd7e2bc5-5658-41b4-ad8f-293f4d69cb3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1463697059-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "454c5d1e28064c4794db28a10ee5a012", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap95fbce57-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:45:16.567474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Releasing lock "refresh_cache-864ecced-20b1-4ddc-ae7c-87146d360f86" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 10:45:16.568505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf880a62-8bfc-4db4-857a-f59c6f5ed025 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action" status: 202 len: 0 microversion: 2.1 time: 2.689341 Aug 29 10:45:16.574601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1245/2458] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:13 2022] POST /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86/action => generated 0 bytes in 2691 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 10:45:16.574922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:16.576339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:16.585378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.586150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.587473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.588567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.589080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.589657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.828188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:16.841670 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b51edec-7f69-4eeb-bca5-4df3cb55f359 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.270509 Aug 29 10:45:16.845372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1246/2459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:16 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:16.854514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:16.855104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:16.873421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.877452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.878069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.879751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.880314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.881458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.924246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] HTTP exception thrown: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Request method failure captured: Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 HTTP/1.1 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhbCLeVtNmTHF31-ItQDu4dR4JXacRrIsVCSOMbpmkT6jrVuX8rLvuVhfz__e3MJ2PInAm7Q1v2oqQ29V93iH2vrYVQoGoQw02Ig36RJVnD-CGh72g-CrDz4doiCCtzkLbi-E4RrPCD7PCfxZ6NoY_yh2qkREWt8fQPg0olr4_-3Zo Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 615f56cde3bf42649a599f66eaeaca6f Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '817fec32-3127-4f17-90cc-e74790899f58'} Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:16.926945 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:16.930726 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:16.932548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Returning 404 to user: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:16.936749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c24d7073-afe9-4e50-929b-0838ce18020e tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "DELETE /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 404 len: 111 microversion: 2.1 time: 0.089087 Aug 29 10:45:16.939090 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1247/2460] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:16 2022] DELETE /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:16.948446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:16.951048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:16.971834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.972426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.973551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:16.975433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:16.975923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:16.976362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.044787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c440f814-94f0-4e70-b92c-d2d74d1d1a39 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 204 len: 0 microversion: 2.1 time: 0.772568 Aug 29 10:45:17.046239 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1214/2461] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:16 2022] DELETE /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:17.051592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f77b66f7-b4ee-4894-8b38-dd3ecdc62ab9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c7002820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:17.108566 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f77b66f7-b4ee-4894-8b38-dd3ecdc62ab9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.060740 Aug 29 10:45:17.109669 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1215/2462] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:17 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:17.114785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:17.115503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 817fec32-3127-4f17-90cc-e74790899f58] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:17.122967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.123678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.124300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.125244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.127367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.127875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.142893 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] HTTP exception thrown: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Request method failure captured: Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 HTTP/1.1 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhbCLeVtNmTHF31-ItQDu4dR4JXacRrIsVCSOMbpmkT6jrVuX8rLvuVhfz__e3MJ2PInAm7Q1v2oqQ29V93iH2vrYVQoGoQw02Ig36RJVnD-CGh72g-CrDz4doiCCtzkLbi-E4RrPCD7PCfxZ6NoY_yh2qkREWt8fQPg0olr4_-3Zo Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 615f56cde3bf42649a599f66eaeaca6f Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '817fec32-3127-4f17-90cc-e74790899f58'} Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:17.144832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Returning 404 to user: Instance 817fec32-3127-4f17-90cc-e74790899f58 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:17.148943 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c59e487-406c-4e8e-ac85-c1d06f2c90f8 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58" status: 404 len: 111 microversion: 2.1 time: 0.036567 Aug 29 10:45:17.152860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1216/2463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:17 2022] GET /compute/v2.1/servers/817fec32-3127-4f17-90cc-e74790899f58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:17.155957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:17.156941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:17.168067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.168524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.169006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.172017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.172560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.173089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.218741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:17.313123 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc17f95b-c3e4-42a3-bcb8-b579538d02ef tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 204 len: 0 microversion: 2.1 time: 0.161317 Aug 29 10:45:17.313810 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1217/2464] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:17 2022] DELETE /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:17.317811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:17.321203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e4eae74-689e-41f9-ae6e-21b58850998f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '.version_select at 0x7f66c78daa60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:17.327612 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-435289b1-ec8a-4ab4-89f8-63a3acdc49fe tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1317 microversion: 2.1 time: 0.386778 Aug 29 10:45:17.338700 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1248/2465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:16 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:17.344849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:17.345668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:17.354263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.355353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.355819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.357463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:17.357978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:17.358538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:17.531976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:17.540474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:17.541954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:17.543138 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16fab2a2-a5c6-45e6-85ed-ed37f82afde5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.203213 Aug 29 10:45:17.543719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1249/2466] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:17 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:17.549461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-944353638", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "f0e277bb-7983-4d32-9041-e842f755bb17"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:17.605212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] validate_networks() for [('f0e277bb-7983-4d32-9041-e842f755bb17', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:45:18.420568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:45:18.421171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:45:18.421390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:45:18.421832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:45:18.422508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:45:18.432078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.432888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.433541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.435612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.437041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.438277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.464422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:45:18.471171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Getting quotas for user e2bcddcae75e410786962c142abebf34 and project eb3c97fcda0046039fbc060f2051dcb9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:45:18.488515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:45:18.491262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:45:18.573625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c2913408-50a5-4be3-9078-d7501a901d9b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024732 Aug 29 10:45:18.574847 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1250/2467] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:45:18.581884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:18.582761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:18.594942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.595541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.596056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.596768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.597502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.598286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.668579 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2e4eae74-689e-41f9-ae6e-21b58850998f tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/6fa1c8f3-b32e-48c8-8ffe-340c48b6431a" status: 202 len: 0 microversion: 2.1 time: 1.353344 Aug 29 10:45:18.672164 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1218/2468] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:45:17 2022] DELETE /compute/v2.1/os-floating-ips/6fa1c8f3-b32e-48c8-8ffe-340c48b6431a => generated 0 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:45:18.674538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd75d88-63e1-441e-8d84-aa355a7d15ee", "name": "network-vif-unplugged", "status": "completed", "tag": "60f39c1c-b970-4b6a-862b-4681bfa43d81"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:18.686071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.686867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.687488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.699711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] Creating event network-vif-unplugged:60f39c1c-b970-4b6a-862b-4681bfa43d81 for instance dbd75d88-63e1-441e-8d84-aa355a7d15ee on n-h2-854121-10 Aug 29 10:45:18.706866 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e8221bc3-5a0a-4b3e-a1d7-c8ac332d0ea2 req-0a59d709-966d-411e-a632-065d8b1532ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035731 Aug 29 10:45:18.708225 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1219/2469] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:18.715503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:18.728371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.729083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.729737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.751679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] Creating event network-changed:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:45:18.760419 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-aefb0e6e-1e84-41a1-a032-72abfad35c06 req-0a0e0793-6163-4a75-9d23-2348814ac82b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050499 Aug 29 10:45:18.765857 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1220/2470] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:18.771743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14333209-2031-474a-b134-c68e76ae3824 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c7002820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:18.830375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:18.841279 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf0b6881-ffa3-488e-be8c-b92b20ebc466 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1317 microversion: 2.1 time: 0.264118 Aug 29 10:45:18.842068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1251/2471] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:18 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:18.847496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14333209-2031-474a-b134-c68e76ae3824 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.080046 Aug 29 10:45:18.852871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:18.853528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:18.854916 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1221/2472] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:18 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:18.860745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:18.861435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:18.871314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.871814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.877097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.877755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.878290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.879022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.879110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.879562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.879723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:18.879992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.880668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:18.881172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:18.960062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:18.968983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:18.970648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:18.972064 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-647d2e35-bdbc-4653-9792-b992b6dbab4a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.116149 Aug 29 10:45:18.972788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1222/2473] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:18 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:18.978038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-025113e8-0c7e-4fbc-9145-1f9c67aa6245 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:18.978834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-025113e8-0c7e-4fbc-9145-1f9c67aa6245 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:19.100898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-025113e8-0c7e-4fbc-9145-1f9c67aa6245 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:19.108372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-025113e8-0c7e-4fbc-9145-1f9c67aa6245 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1207 microversion: 2.1 time: 0.134326 Aug 29 10:45:19.110562 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1223/2474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:18 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1207 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:19.124541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:19.125364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:19.149951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.150600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.155348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.156195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.156733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.157167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.211856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:19.244886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:19.259174 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2f6f7ab-ea84-4d14-b5da-10fe0bc29cc6 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1467 microversion: 2.1 time: 0.413217 Aug 29 10:45:19.275489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1252/2475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:18 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:19.281930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:19.282805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:19.290104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.290965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.291583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.293230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.294021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.294747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.425361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3af66f9f-d3d1-48ab-9fe9-155cb1d6c271 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "DELETE /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 204 len: 0 microversion: 2.1 time: 0.311218 Aug 29 10:45:19.427417 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1224/2476] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:19 2022] DELETE /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:19.446995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:19.448369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:19.461468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce767e4f-4924-489c-a920-b0096bd04ce5 tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1620 microversion: 2.1 time: 0.184425 Aug 29 10:45:19.470439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.470941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.471387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.472099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.472559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.472990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.479239 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1253/2477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:19 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1620 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:19.640625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-475085448", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["ec53f44c-01e4-4b61-8350-cea8fd318518"]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:19.719181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:19.730446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:45:19.730887 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d67ed92c-6c69-4718-af60-82d82be9ddd4 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1525 microversion: 2.1 time: 0.288268 Aug 29 10:45:19.733018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1225/2478] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:19 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1525 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:19.863011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dffb8727-394a-4ca9-921a-8630ed6601fa tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f53ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:19.947906 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dffb8727-394a-4ca9-921a-8630ed6601fa tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.087974 Aug 29 10:45:19.957763 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1226/2479] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:19 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:19.964419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:19.965575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:19.974085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.975382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.976103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:19.978357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:19.979617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:19.980265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.136543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:45:20.137378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:45:20.138016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:45:20.138765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:45:20.139513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:45:20.164750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.165375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.166042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.167043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.167464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.167963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.206842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:45:20.223398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:45:20.254506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:45:20.256752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:45:20.347203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.356489 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03e5126f-aaba-4e31-80a5-2ab817efec74 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1505 microversion: 2.1 time: 0.397165 Aug 29 10:45:20.373748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1227/2480] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:19 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:20.374762 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ae63ef8-0e4d-42d7-9b5d-3f1e48fca8a0 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738633 Aug 29 10:45:20.377545 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1254/2481] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:45:20.386727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.387614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.391015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.391737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.396072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.396730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.397054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.397842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.399017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.399017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.400400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.401037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.401600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.402798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.403420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.405337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.503682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.514814 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55346c3e-64a5-4ff4-840e-96141e0235ae tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1259 microversion: 2.1 time: 0.135974 Aug 29 10:45:20.515795 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1255/2482] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:20 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:20.526815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.548110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.550269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.552585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.552933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.557278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8e39ced-80cc-4e78-8d96-fb3d1e83a20b tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.182337 Aug 29 10:45:20.573362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1228/2483] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:20 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:20.573362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a47d7244-2100-4cb2-bd4d-61a853889617 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.573362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a47d7244-2100-4cb2-bd4d-61a853889617 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.601101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.602762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.604149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.609006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.611134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.612036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.681109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:20.730826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a47d7244-2100-4cb2-bd4d-61a853889617 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:20.747082 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a47d7244-2100-4cb2-bd4d-61a853889617 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1216 microversion: 2.1 time: 0.180377 Aug 29 10:45:20.751645 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1229/2484] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:20 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:20.785873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.787545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.805868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.808214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.811824 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a2f284f-fc3b-4274-9f46-e9bab73f365a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 204 len: 0 microversion: 2.1 time: 0.292948 Aug 29 10:45:20.814571 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1256/2485] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:20 2022] DELETE /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:20.815290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.820952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.822918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.823510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.843586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:20.871808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.876266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.879282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.917060 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] Creating event network-vif-unplugged:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:45:20.936113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-62b8f85d-2438-40a9-a98a-2a2519aa4d8e req-f231c918-6f2f-4225-b64c-f473dbd1f9aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114079 Aug 29 10:45:20.937150 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1257/2486] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:20.944911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:20.946796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:20.958857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.959812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.960661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:20.962530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:20.965421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:20.970746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.661988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:21.669422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:21.677114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7aeafdbd-0a2a-4a16-9503-a1021c68cbce tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1525 microversion: 2.1 time: 0.923244 Aug 29 10:45:21.678002 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1230/2487] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:20 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1525 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:21.685214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fef1bce5-0e05-4879-a19f-f2133f821d43 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f9c040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:21.734045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:21.743708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-856294e5-f5f3-4ef8-8bb8-4c22d31bc5f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1511 microversion: 2.1 time: 0.803605 Aug 29 10:45:21.745071 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1258/2488] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:20 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1511 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:21.763742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fef1bce5-0e05-4879-a19f-f2133f821d43 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.083615 Aug 29 10:45:21.767060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd75d88-63e1-441e-8d84-aa355a7d15ee", "name": "network-vif-deleted", "tag": "60f39c1c-b970-4b6a-862b-4681bfa43d81"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:21.774680 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1231/2489] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:21 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:21.780866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:21.781739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:21.788149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:21.788858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:21.789302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.790194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:21.790821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:21.791400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.794377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:21.794540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:21.794889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.819940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] Creating event network-vif-deleted:60f39c1c-b970-4b6a-862b-4681bfa43d81 for instance dbd75d88-63e1-441e-8d84-aa355a7d15ee on n-h2-854121-10 Aug 29 10:45:21.826958 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c5ec0e3d-c5bb-490e-bb39-9c20bf20599a req-57322e16-9f48-4477-ba74-ccd9dd7f3112 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080473 Aug 29 10:45:21.828450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1259/2490] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:21.833969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:21.834844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:21.841913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:21.842616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:21.843230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.844085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:21.844739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:21.845312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:21.849860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:21.947573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:21.964517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:21.966112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:21.972192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6622b302-ee72-4742-b9c6-058920b91f7f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.141974 Aug 29 10:45:21.993420 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1260/2491] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:21 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:21.998604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:21.999033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:22.005389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.006117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.006703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:22.008208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.008824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.009546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:22.086402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:22.096576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-17796a64-009f-480a-8892-d1c70505d1c7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1267 microversion: 2.1 time: 0.320529 Aug 29 10:45:22.102939 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1232/2492] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:21 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:22.235417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:22.245076 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b42374c-4bc3-4980-85e5-28b6255b12f1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1268 microversion: 2.1 time: 0.250517 Aug 29 10:45:22.246977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1261/2493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:21 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:22.701599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:22.702628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:22.714754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.716771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.721718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:22.722917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.723598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.724318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:22.770477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:22.772249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:22.795737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.796791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.798760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:22.801839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:22.803195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:22.804210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:23.570326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:23.590202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10e9a738-ab71-4e78-b65d-a5229b7a2ec3 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1525 microversion: 2.1 time: 0.887020 Aug 29 10:45:23.597433 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1233/2494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:22 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1525 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:23.613836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26a0d456-29ed-4c86-b2aa-1bf7a4748702 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6ebd280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:23.715548 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-26a0d456-29ed-4c86-b2aa-1bf7a4748702 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.115967 Aug 29 10:45:23.722065 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1234/2495] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:23 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:23.728610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:23.739490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089c491c-4d5b-46f0-841b-f04a161b9068", "name": "network-vif-plugged", "status": "completed", "tag": "043cc140-449c-47a1-b030-fdd429a26e32"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:23.751040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dd4f5cd-d03f-4175-b3b3-df22cd2e53bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1511 microversion: 2.1 time: 0.986432 Aug 29 10:45:23.765227 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1262/2496] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:22 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1511 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:23.779282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:23.780165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:23.780758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:23.797955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:23.798842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:23.820501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] Creating event network-vif-plugged:043cc140-449c-47a1-b030-fdd429a26e32 for instance 089c491c-4d5b-46f0-841b-f04a161b9068 on n-h2-854121-10 Aug 29 10:45:23.820735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:23.820984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:23.833087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:23.836125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:23.836837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:23.837872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:23.839885 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-befe34d2-7bbc-48e5-91fd-8242c14e1c99 req-10ae6688-d55d-4714-ac95-22c09ad08302 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114983 Aug 29 10:45:23.842626 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1235/2497] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:23.859635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:23.865686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:23.880078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:23.880507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:23.880954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:23.881658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:23.884425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:23.886186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.276104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:24.290969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:24.293845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:24.296256 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-007fa8dd-fb8e-4e4e-9270-00f9720b3769 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.527186 Aug 29 10:45:24.300116 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1263/2498] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:23 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:24.324986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:24.327876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:24.343936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.344443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.344883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.345595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.346206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.350551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.637487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:24.641553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:24.690339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8708571-fc97-4c0c-a510-f145c29769c8 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.846116 Aug 29 10:45:24.691338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-93a7c9e7-e74a-4650-8768-df331ddc4463 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1274 microversion: 2.1 time: 0.389881 Aug 29 10:45:24.693850 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1264/2499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:24 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1274 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:24.708076 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1236/2500] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:23 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:24.717599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de87605b-3cef-45a8-b1f0-ce3c0c3be2ee", "name": "network-vif-deleted", "tag": "628e4687-e050-422e-a779-9db9a22d5f9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:24.724095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864ecced-20b1-4ddc-ae7c-87146d360f86", "name": "network-vif-deleted", "tag": "95fbce57-72b7-45ad-bece-e8308aca8135"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:24.731555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.732824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.733468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.751702 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] Creating event network-vif-deleted:628e4687-e050-422e-a779-9db9a22d5f9b for instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee on n-h2-854121-10 Aug 29 10:45:24.758230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4d50aa5e-4cfc-4d58-9d83-568b7cd556a4 req-e671faa8-a5fb-4379-addf-340b857530de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048667 Aug 29 10:45:24.759279 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1237/2501] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:24.761321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.767352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.769587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.790223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:24.792499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:24.802664 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] Creating event network-vif-deleted:95fbce57-72b7-45ad-bece-e8308aca8135 for instance 864ecced-20b1-4ddc-ae7c-87146d360f86 on n-h1-854121-10 Aug 29 10:45:24.814240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0e57b135-eddf-4ac8-910a-a22ad15e91e0 req-09244003-4499-4a73-86e7-0c0998f15dde service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116890 Aug 29 10:45:24.820062 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1265/2502] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:24.845867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f76314d4-4c0e-4ff0-9e44-772178bf6046 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c755f670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:24.846930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.850130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.854208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.855646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.856350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.857684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.899695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:24.900605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:24.902119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:24.903020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lazy-loading 'fault' on Instance uuid 864ecced-20b1-4ddc-ae7c-87146d360f86 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:45:24.969217 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f76314d4-4c0e-4ff0-9e44-772178bf6046 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.146514 Aug 29 10:45:24.971028 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1266/2503] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:24 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:24.999096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:25.000215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:25.019651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.020961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.026964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.028013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.029849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.034038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.044554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615f56cde3bf42649a599f66eaeaca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454c5d1e28064c4794db28a10ee5a012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:25.060326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-965326fa-99c6-4e1c-b662-745b1e12fd43 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 200 len: 1313 microversion: 2.1 time: 0.299352 Aug 29 10:45:25.070997 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1238/2504] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:24 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:25.105246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.106076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.106874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.107361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lazy-loading 'fault' on Instance uuid de87605b-3cef-45a8-b1f0-ce3c0c3be2ee {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:45:25.262695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:25.277569 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77b8e1e2-9760-424c-af87-1d9aa7c4a2b7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 200 len: 1307 microversion: 2.1 time: 0.302866 Aug 29 10:45:25.281637 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1267/2505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:24 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:25.327502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:25.328278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:25.347898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.350940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.351510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.352986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.361739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.362636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.570993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:25.583938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:25.588312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:25.596076 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65883e4b-0393-4642-b4c4-daf3785d1826 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.273400 Aug 29 10:45:25.597957 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1239/2506] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:25 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:25.720391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:25.721161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:25.721884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:25.722132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:25.731251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.737088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.738507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.739509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.740859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.741590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.742298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.743046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.743508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:25.748339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:25.750319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:25.753204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.305496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:26.326164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b395b202-029d-4506-b813-b120c729e60b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.610274 Aug 29 10:45:26.347420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:26.348068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1268/2507] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:25 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:26.355121 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdfe8f73-2877-493b-8346-a41db9e6f9d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.637749 Aug 29 10:45:26.355719 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1240/2508] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:25 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:26.362758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:26.363370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] [instance: 864ecced-20b1-4ddc-ae7c-87146d360f86] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:26.367365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8b4be1e-0a7f-4068-98a2-d75676bfe336 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f1ed30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:26.377123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.377609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.378130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.378835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.379290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.379714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.444601 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] HTTP exception thrown: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Request method failure captured: Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 HTTP/1.1 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhbCLeVtNmTHF31-ItQDu4dR4JXacRrIsVCSOMbpmkT6jrVuX8rLvuVhfz__e3MJ2PInAm7Q1v2oqQ29V93iH2vrYVQoGoQw02Ig36RJVnD-CGh72g-CrDz4doiCCtzkLbi-E4RrPCD7PCfxZ6NoY_yh2qkREWt8fQPg0olr4_-3Zo Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/454c5d1e28064c4794db28a10ee5a012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 454c5d1e28064c4794db28a10ee5a012 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283733630 Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 615f56cde3bf42649a599f66eaeaca6f Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283733630-project Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '864ecced-20b1-4ddc-ae7c-87146d360f86'} Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.449392 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. Aug 29 10:45:26.454527 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.460122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] Returning 404 to user: Instance 864ecced-20b1-4ddc-ae7c-87146d360f86 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:26.461182 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-918b957a-f87e-4b34-8ab1-063f2c96b683 tempest-FloatingIPsAssociationTestJSON-283733630 tempest-FloatingIPsAssociationTestJSON-283733630-project] 10.222.0.47 "GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86" status: 404 len: 111 microversion: 2.1 time: 0.104546 Aug 29 10:45:26.461963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1241/2509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:26 2022] GET /compute/v2.1/servers/864ecced-20b1-4ddc-ae7c-87146d360f86 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:26.473183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:26.484208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:26.490636 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8b4be1e-0a7f-4068-98a2-d75676bfe336 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.148928 Aug 29 10:45:26.491228 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1269/2510] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:26 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:26.500512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.501009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.501448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.506398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.506888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.507328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.551347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee HTTP/1.1 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'de87605b-3cef-45a8-b1f0-ce3c0c3be2ee'} Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:26.555163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:26.559653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43a99e3a-8716-43ee-a748-830fb0aba9c9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 404 len: 111 microversion: 2.1 time: 0.088166 Aug 29 10:45:26.576815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:26.577614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:26.582256 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1242/2511] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:26 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:26.592538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.593983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.598487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.599778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.600406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.601227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.620231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:26.621092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:26.641217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.642379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.650207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.654200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:26.654858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:26.660128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:26.970938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.012582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.017887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.021904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-157d5e4c-e056-413d-a95e-e811d2dc37d5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.405832 Aug 29 10:45:27.024827 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1243/2512] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:26 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:27.038872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949a7f2f-35f9-4884-bdb2-2b8563cda967", "tag": "bc1891b4-5a92-4c42-9cad-202346f66e30"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:27.060662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.061167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.061611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.085056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] Creating event network-changed:bc1891b4-5a92-4c42-9cad-202346f66e30 for instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 on n-h2-854121-10 Aug 29 10:45:27.103627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-160b07a0-65f1-4f97-93f7-c90cc914f7fa req-e5b09d94-e1ff-44e1-af6c-3a86781fd7ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072535 Aug 29 10:45:27.104598 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1244/2513] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:27.115573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.140413 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4033f99-d23c-450a-ad31-56c081816221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.577449 Aug 29 10:45:27.141419 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1270/2514] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:26 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:27.355489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:27.356117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:27.363225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c357c6d5-6fea-48c7-820f-5c33b8a767d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c357c6d5-6fea-48c7-820f-5c33b8a767d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 163 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": 12345, "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 12345 Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:45:27.367541 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 10:45:27.374511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:27.381489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.382219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.382767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c357c6d5-6fea-48c7-820f-5c33b8a767d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:27.383575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.383985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c357c6d5-6fea-48c7-820f-5c33b8a767d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024861 Aug 29 10:45:27.384786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.385173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1271/2515] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:27.386330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.391400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.397025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:27.397848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:27.402929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:27.411571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.412488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.413190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.414219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.414830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.415406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.781570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.794824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb079963-a108-4670-b4ed-1e8d2a35aa81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.442904 Aug 29 10:45:27.795683 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1245/2516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:27 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:27.805294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:27.811417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:27.820064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:27.820829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.821322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.821775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.822671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:27.824052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:27.824785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:27.836498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11d29946-1ef8-4607-952c-b7c7a672d27f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.449638 Aug 29 10:45:27.840313 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1272/2517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:27 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:27.871893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a46282c-ffe8-40de-a00c-d6d85b7ce5a5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e50a60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:27.928892 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a46282c-ffe8-40de-a00c-d6d85b7ce5a5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.068430 Aug 29 10:45:27.931098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1273/2518] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:27 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:28.030917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:28.040816 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15f70785-7182-4f80-ae92-ad1abc2e93e7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.243732 Aug 29 10:45:28.042180 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1246/2519] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:27 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:28.051641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:28.052244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:28.061373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.062150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.062608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.063536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.064337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.064767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.065317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:28.066071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:28.069592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:28.074639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.075901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.078069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.079108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.079782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.080417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.221611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:28.241380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:28.243156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:28.250098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9cb187b6-3654-4c59-884f-ae34b8b83001 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.196694 Aug 29 10:45:28.251198 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1274/2520] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:28 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:28.329026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:28.338285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e49ef334-efec-44b9-8040-6f82d632a24a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.278306 Aug 29 10:45:28.354587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1247/2521] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:28 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:28.803123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b86aaa-6cee-4eb3-81a6-088381649e08", "tag": "f6ed8e15-be80-4416-80d1-6aada775af1b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:28.815919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:28.816509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:28.832344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.848614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.852688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.855228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.855718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.856289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.857535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.865241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.870465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.908115 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] Creating event network-changed:f6ed8e15-be80-4416-80d1-6aada775af1b for instance 93b86aaa-6cee-4eb3-81a6-088381649e08 on n-h1-854121-10 Aug 29 10:45:28.932192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2f708c2b-40d2-418a-bcbf-cedb49dc41c6 req-064ac814-d704-4199-b578-186485a63c1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132848 Aug 29 10:45:28.933353 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1275/2522] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:28.939638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:28.940568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:28.948353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.948844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.949279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:28.950067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:28.950680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:28.951181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:29.265884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:29.276755 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b840ad2-6fcb-4cfe-a3fd-a0e889c033aa tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.464880 Aug 29 10:45:29.292531 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1248/2523] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:28 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:29.298704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bbcf580-4580-4623-9c4d-2b5dd9c7470d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f535e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:29.340400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:29.352879 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0e3911f-2378-4303-973a-2ad88c1d0d2b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.414981 Aug 29 10:45:29.353779 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1276/2524] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:28 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:29.361584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:29.362737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:29.382601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:29.392012 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6bbcf580-4580-4623-9c4d-2b5dd9c7470d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.097361 Aug 29 10:45:29.392932 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1249/2525] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:29 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:29.400084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:29.403250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:29.404494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:29.407329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:29.408104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:29.581867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:29.601574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:29.609448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:29.613869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-95c496ba-c891-41b6-9904-6e11b01fe42c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.258804 Aug 29 10:45:29.622731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1277/2526] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:29 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:30.147779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-261235965", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:30.267960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:45:30.300814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:30.302185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:30.308201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:30.309230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=14 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:30.331259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:30.346585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:30.347299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:30.348229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:30.348996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:30.349594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:30.736491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:31.172003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:31.182804 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d1362ba1-4dcc-46d5-9753-19a0b091ff19 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.886689 Aug 29 10:45:31.184029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1278/2527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:30 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:31.200465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:31.203366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:31.213850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.214475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.216848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.221670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.222371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.222935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.569644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:31.584533 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04f9b7bf-147f-4456-a8cd-f7b79542ee97 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.398305 Aug 29 10:45:31.591175 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1279/2528] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:31 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:31.596305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2cb13126-bb02-4f65-8c96-ab5643363a28 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6c51ca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:31.679280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2cb13126-bb02-4f65-8c96-ab5643363a28 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.086787 Aug 29 10:45:31.680292 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1280/2529] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:31 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:31.685628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:31.690824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:31.705519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.710611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.711419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.712455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.713132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.713799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.834522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:31.844905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:31.850205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:31.854166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5d9abf9-7570-4666-8a24-1913b2ca943a tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.172631 Aug 29 10:45:31.856159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1281/2530] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:31 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:31.861577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:45:31.862141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:45:31.862882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:45:31.863295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:45:31.863705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:45:31.864995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41af49ed-1257-4abb-bf89-d27504bec3fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1837114769", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3ba80a82-7e1c-439f-9ab6-5612a4160a73", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:31.880420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.880910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.881345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.886332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:31.886834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:31.887282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:31.954635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:45:31.973717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:45:32.009164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:45:32.010597 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-41af49ed-1257-4abb-bf89-d27504bec3fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. Aug 29 10:45:32.012774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41af49ed-1257-4abb-bf89-d27504bec3fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 358 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1837114769", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3ba80a82-7e1c-439f-9ab6-5612a4160a73", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: exception: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1837114769', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '3ba80a82-7e1c-439f-9ab6-5612a4160a73'}], 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:32.018996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41af49ed-1257-4abb-bf89-d27504bec3fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Block Device 3ba80a82-7e1c-439f-9ab6-5612a4160a73 is not bootable. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41af49ed-1257-4abb-bf89-d27504bec3fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.164795 Aug 29 10:45:32.024732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1282/2531] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:32.034389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:32.035107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:32.051181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.051808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.052331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.053118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.053836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.054432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.140581 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97b799da-780c-426a-8cc4-c85cb746f70d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227507 Aug 29 10:45:32.150132 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1250/2532] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:45:32.168740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d59ffd0f-a2df-4da8-b379-8f174b224e22 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:32.175092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d59ffd0f-a2df-4da8-b379-8f174b224e22 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:32.353206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d59ffd0f-a2df-4da8-b379-8f174b224e22 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:32.362894 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d59ffd0f-a2df-4da8-b379-8f174b224e22 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1214 microversion: 2.1 time: 0.211163 Aug 29 10:45:32.383139 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1251/2533] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:32 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:32.392299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:32.393221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:32.412085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.412747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.415588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.416587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.417218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.417810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.424149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:32.432085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:32.438933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79befc49-8b1c-404b-9461-131d66739859 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.406218 Aug 29 10:45:32.445518 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1283/2534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:32.478631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:32.484794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:32.524168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.527894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.528640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.530719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:32.554724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:32.555211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:32.960214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:32.978743 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f1713c5-6028-4985-922f-0c5f3a26c187 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.594089 Aug 29 10:45:32.992251 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1252/2535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:32 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:32.995991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:33.018750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:33.030237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.046580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.049404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.050399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.051035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.053831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.126253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.134459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9af0bebd-75f0-4de5-bf97-765bae5a0fdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.663425 Aug 29 10:45:33.140077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1284/2536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:33.162154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9a933b9-9678-4cac-aa0a-e833b6f81ba8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c7485700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:33.263948 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9a933b9-9678-4cac-aa0a-e833b6f81ba8 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.121638 Aug 29 10:45:33.264542 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1285/2537] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:33 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:33.275827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:33.282712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:33.307476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.307987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.312951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.314182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.318145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.319827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.495788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.513332 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed66da25-4ccf-45c3-bf98-c22a62e7bbf5 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.524907 Aug 29 10:45:33.514896 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1253/2538] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:32 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:33.535097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:33.536660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:33.554290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.555743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.559404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.561120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:33.562322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:33.563631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:33.626564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.641245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.648008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.658641 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b93dadc-fb3a-43a3-977e-b7f661164237 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.385548 Aug 29 10:45:33.660188 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1286/2539] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:33 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:33.761408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:33.775032 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50ea5d94-1e6e-43e0-b19e-a36f0a8a3f2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1218 microversion: 2.1 time: 0.253639 Aug 29 10:45:33.777848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1254/2540] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:33 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:34.002449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:34.003293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:34.031569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.034540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.035201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.036977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.040407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.041129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.280087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-341021fd-dc87-4706-89e2-9be78cff5766 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f04f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:34.401062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-341021fd-dc87-4706-89e2-9be78cff5766 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.125381 Aug 29 10:45:34.402334 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1255/2541] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:34 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:34.444289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:34.457587 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b6bf9cf-5d36-40d2-8f93-6d5ff26ee521 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.460531 Aug 29 10:45:34.475993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1287/2542] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:33 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:34.539036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:34.539816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:34.562097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.563363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.566289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.567971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.570908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.578209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.586370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:34.683995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:34.685663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:34.697357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.698016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.698560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.706339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:34.714451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:34.715389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:34.947144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:34.998589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:35.003772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:35.009135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f5a2b94-8b24-4bff-bd54-9875e431657d tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.329011 Aug 29 10:45:35.010077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1288/2543] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:34 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:45:35.023332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:35.031772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:35.053326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:35.055900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:35.061543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:35.063168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:35.064392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:35.067103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:35.080059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:35.100399 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62864379-7a04-42f2-af8a-5b7664dd615b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.555031 Aug 29 10:45:35.101544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1256/2544] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:34 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:35.212652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:35.223144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b99f276-7e2c-47f4-a817-13e067b2fa6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1266 microversion: 2.1 time: 0.210732 Aug 29 10:45:35.225080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1289/2545] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:35 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:35.418219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6d8fffd-19cf-41b4-b41c-6cd2c9c27552 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e35280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:35.483691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:35.484493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:35.492990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:35.501050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:35.501751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:35.506646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:35.508538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:35.511332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:35.523965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6d8fffd-19cf-41b4-b41c-6cd2c9c27552 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.110246 Aug 29 10:45:35.526358 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1257/2546] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:35 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:35.837568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:35.858602 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e3d5694f-4cc8-4dde-8685-84991f67f52b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.374252 Aug 29 10:45:35.860489 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1290/2547] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:35 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:36.039432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:36.040326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:36.050575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.051072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.051514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.052224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.052678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.053104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.123129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:36.125342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:36.133780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.156373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.163712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.164732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.165383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.166162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.567546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:36.586914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:36.594124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:36.598078 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c08ff8a2-d01c-4958-a366-70fc6486c8a2 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1365 microversion: 2.47 time: 0.561915 Aug 29 10:45:36.600572 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1258/2548] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1365 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:36.629909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:36.632405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:36.660127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.665218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.666413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.667775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.671107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.671550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.784330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:36.794616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43f6d65c-cc1c-494e-82a4-cc16acb08b5a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.676087 Aug 29 10:45:36.811064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1291/2549] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:36.832893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f50277f7-23c9-43ae-8174-fcb32287487b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1834672871", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "destination_type": "local"}, {"source_type": "volume", "uuid": "19e317f8-d593-4527-a5fc-b2e80cfcf7e1", "destination_type": "invalid"}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f50277f7-23c9-43ae-8174-fcb32287487b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 495 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1834672871", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "destination_type": "local"}, {"source_type": "volume", "uuid": "19e317f8-d593-4527-a5fc-b2e80cfcf7e1", "destination_type": "invalid"}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1834672871', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '19e317f8-d593-4527-a5fc-b2e80cfcf7e1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:36.846701 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:36.851036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f50277f7-23c9-43ae-8174-fcb32287487b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:36.852657 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f50277f7-23c9-43ae-8174-fcb32287487b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034084 Aug 29 10:45:36.853115 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1292/2550] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:36 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:36.862427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b35de29b-03a0-433c-88ea-3debba1f08b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e7e0d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:36.875237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:36.911281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d402d4af-e33d-482a-a6d2-9ef522c054a7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1272 microversion: 2.1 time: 0.307873 Aug 29 10:45:36.922582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b35de29b-03a0-433c-88ea-3debba1f08b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.068346 Aug 29 10:45:36.923231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1293/2551] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:36.931794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1259/2552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:36.939633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a7f2f-35f9-4884-bdb2-2b8563cda967", "name": "network-vif-plugged", "status": "completed", "tag": "bc1891b4-5a92-4c42-9cad-202346f66e30"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:36.940265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:36.942025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:36.949009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.949763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.950029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.952218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.952492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.953260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.953857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:36.954523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:36.955101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:36.971061 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] Creating event network-vif-plugged:bc1891b4-5a92-4c42-9cad-202346f66e30 for instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 on n-h2-854121-10 Aug 29 10:45:36.996386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c326f3e1-23e3-4ab6-970b-0ffed0239d05 req-2f5dac53-6445-402a-ba21-199419e290fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071644 Aug 29 10:45:36.998125 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1294/2553] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:37.003635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:37.004582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:37.011283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.011774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.012421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.014142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.014777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.015207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.365589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.382476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-951397e3-9d90-48c8-9fef-66d786d71d4a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.449360 Aug 29 10:45:37.383770 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1260/2554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:37.411113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:37.412553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:37.423265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.426845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.427422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.428407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.429087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.430330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.440870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.460500 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3802c1b4-7991-44b7-bc08-cf891687588d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.458454 Aug 29 10:45:37.461851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1295/2555] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:36 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:37.629886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:37.630814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:37.651383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.656005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.657038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.659498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.661073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.662921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.864651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.874420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.876173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.877547 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0a0f1cf-5d6d-4134-9e49-421023cf90db tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1371 microversion: 2.47 time: 0.252815 Aug 29 10:45:37.893818 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1296/2556] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:37 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:37.894017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:37.894571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:37.902464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.902979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.903433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.904349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:37.904829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:37.905271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:37.934237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:37.955919 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4d8c585-ddc2-455a-924d-d16e53ec6cb1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.549553 Aug 29 10:45:37.956568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1261/2557] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:37 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:45:37.962346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:37.964305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:37.995347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.001260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.002058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.003918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.004412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.004862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.178827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:38.199498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d0bff46-6725-4764-852b-70b9201928d8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1272 microversion: 2.1 time: 0.241366 Aug 29 10:45:38.212007 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1262/2558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:37 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:38.219986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5cc9f21-ccdd-4376-bd1d-5c1a75a68c24 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e83f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.276343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5cc9f21-ccdd-4376-bd1d-5c1a75a68c24 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.063197 Aug 29 10:45:38.277409 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1263/2559] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:38.283159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53e1a2ee-d1f0-4338-bfb4-8add49f3e98a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-775402998", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53e1a2ee-d1f0-4338-bfb4-8add49f3e98a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 491 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-775402998", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-775402998', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.288868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 10:45:38.292127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:38.299735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53e1a2ee-d1f0-4338-bfb4-8add49f3e98a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:38.301181 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53e1a2ee-d1f0-4338-bfb4-8add49f3e98a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022536 Aug 29 10:45:38.302486 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1264/2560] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:38 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:38.312017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.316840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:38.325302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.326573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.327417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.328887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.335237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.335876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.535114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:38.544418 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3541f431-1cb6-445d-84b1-bc9bae60d6c1 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1307 microversion: 2.1 time: 0.654794 Aug 29 10:45:38.550370 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1297/2561] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:37 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1307 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:38.556368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.557163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:38.569056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.570280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.571441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.572663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.573482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.574148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.620503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:38.634408 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6c9d700-eea2-4044-89ef-7b42ab51f285 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.327412 Aug 29 10:45:38.649727 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1265/2562] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:38.814599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d0cf1d2-8dd8-4239-92d7-034e7138f74e tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] Calling method '.version_select at 0x7f66c6e83160>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.844254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:38.862698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d0cf1d2-8dd8-4239-92d7-034e7138f74e tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] 10.222.0.47 "GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde" status: 200 len: 784 microversion: 2.1 time: 0.217902 Aug 29 10:45:38.863482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1266/2563] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde => generated 784 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:38.876287 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae8464ae-9261-456d-bc44-d7255931c887 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.324070 Aug 29 10:45:38.889629 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1298/2564] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:38.891952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb45f149-6986-48c0-8d02-b579d59e51ed tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] Calling method '.version_select at 0x7f66c6e30160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.901669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:38.903080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:38.916150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.916842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.917445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:38.918378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:38.918990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:38.920322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.038558 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb45f149-6986-48c0-8d02-b579d59e51ed tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] 10.222.0.47 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.160592 Aug 29 10:45:39.040123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1299/2565] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/images => generated 445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:39.048156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.049002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:39.057283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.058007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.058613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.059692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.061615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.062259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.209136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:39.220624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:39.222260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:39.223481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2624a68-279f-41d7-8975-dcb7f0a5590f tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1371 microversion: 2.47 time: 0.182259 Aug 29 10:45:39.224045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1300/2566] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:39.242645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b86aaa-6cee-4eb3-81a6-088381649e08", "name": "network-vif-plugged", "status": "completed", "tag": "f6ed8e15-be80-4416-80d1-6aada775af1b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:39.257827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.258333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.258772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.273946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:39.284299 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-289a97cf-fba0-40d3-925c-c5e422f3cdc7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.407407 Aug 29 10:45:39.298595 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1267/2567] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:38 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:39.302529 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] Creating event network-vif-plugged:f6ed8e15-be80-4416-80d1-6aada775af1b for instance 93b86aaa-6cee-4eb3-81a6-088381649e08 on n-h1-854121-10 Aug 29 10:45:39.314955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a19a9162-7b7b-49b1-acd8-be335efa909c tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] Calling method '.version_select at 0x7f66c6f53310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.326881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f36e5ac2-2855-4fe6-ba40-1e5af980a898 req-438ea3a0-b907-4ff3-a9d3-24f9ee6e82af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086957 Aug 29 10:45:39.329404 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1301/2568] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:39.336378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.337890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:39.347468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.349384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.350060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.351150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.352422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.353036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.404270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a19a9162-7b7b-49b1-acd8-be335efa909c tempest-ListImagesTestJSON-297415446 tempest-ListImagesTestJSON-297415446-project] 10.222.0.47 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.103175 Aug 29 10:45:39.404941 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1268/2569] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:39.428040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-82d2cf4f-cc0a-428c-bd36-a293bc0eb85e tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c78daa60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.534765 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-82d2cf4f-cc0a-428c-bd36-a293bc0eb85e tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.122689 Aug 29 10:45:39.540244 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1269/2570] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:39.570938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-759d04fe-04af-4d9a-9d60-ded61e73651f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-759d04fe-04af-4d9a-9d60-ded61e73651f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 416 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.584194 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-759d04fe-04af-4d9a-9d60-ded61e73651f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:39.588656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-759d04fe-04af-4d9a-9d60-ded61e73651f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.024683 Aug 29 10:45:39.596589 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1270/2571] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:39 2022] POST /compute/v2.1/servers => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:45:39.607670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.609010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:39.616961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.617911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.618533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.619709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.620393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.620989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.874194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:39.890647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-05034a83-220f-4a5f-8674-ab14fcf78be6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.559562 Aug 29 10:45:39.891689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1302/2572] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:39.896526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:39.897141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:39.909081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.909581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.922487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.923534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:39.924027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:39.924467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:39.994509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.004469 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80b0a059-5ee5-4248-aeee-8af58abe609f tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1485 microversion: 2.1 time: 0.406744 Aug 29 10:45:40.005605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1271/2573] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1485 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:40.011381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:40.012186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:40.019337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.020014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.026175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.027258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.035075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.035790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.307277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.325077 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f7acda2-3ca0-41bf-b7b6-ba766cc7a909 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.432037 Aug 29 10:45:40.335958 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1303/2574] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:39 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:40.354193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1342527106"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:40.361063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:40.372184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.373333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.373903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.374737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.375276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.375898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.415577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.426545 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88e2b29b-0c3e-4fca-b797-862399250d40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1316 microversion: 2.1 time: 0.419483 Aug 29 10:45:40.434525 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1272/2575] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:40 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:40.451439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:40.452215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:40.483222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.485115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.486346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.489420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.490450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.493640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.657290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.672712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:40.678670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.685449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.688664 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-311a7c7c-e759-4735-84d7-8ad4478758c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1356 microversion: 2.47 time: 0.251558 Aug 29 10:45:40.707009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1273/2576] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:40 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1356 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:40.707009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:40.707009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:40.714652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.715470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.716041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.717531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.718012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.718624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.762148 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64a33b7a-d161-49d4-9b01-800863fab4db tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "POST /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967/action" status: 202 len: 0 microversion: 2.1 time: 0.423711 Aug 29 10:45:40.764147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1304/2577] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:40 2022] POST /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 10:45:40.774337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fbea16de-14d5-4ba9-839c-8875a115b9ce tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6f1ea60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:40.854056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fbea16de-14d5-4ba9-839c-8875a115b9ce tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.088197 Aug 29 10:45:40.855093 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1305/2578] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:40 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:40.863117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e94d3df-82d8-4c9b-be9b-1d8a8f06118d", "tag": "9e32fde7-2546-4ea0-8a5d-324d5460c796"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:40.877521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.877776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.878631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.891133 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] Creating event network-changed:9e32fde7-2546-4ea0-8a5d-324d5460c796 for instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d on n-h2-854121-10 Aug 29 10:45:40.897271 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9992ff8f-226b-4b67-ac28-c6a4a95fbfeb req-a75b6be9-c819-4b67-8ed7-c2a5bcdbddcd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Aug 29 10:45:40.901110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1306/2579] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:40.907431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:40.915397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:40.917114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Searching by: {'deleted': False, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:45:40.932960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.935433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.935433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:40.935691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:40.936423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:40.938345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.118664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:45:41.163477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.173979 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8b86e1f-2e48-45f7-b2ff-f4571495120c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.475373 Aug 29 10:45:41.189753 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1274/2580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:40 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:41.203602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44964c79-cc73-4606-8e78-bda5ffb5c7aa tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6f95d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.274792 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44964c79-cc73-4606-8e78-bda5ffb5c7aa tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f" status: 200 len: 1414 microversion: 2.1 time: 0.090158 Aug 29 10:45:41.277114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.280301 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1275/2581] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:41 2022] GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:41.288511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.289241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.290523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.296812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.297814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:41.306425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.308657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.312590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.313660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.315449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.317047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.319244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.319707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.458493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fdb177d3-b8fe-4826-a4a7-4724fe849da5 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.555856 Aug 29 10:45:41.459249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1307/2582] 10.222.0.47 () {60 vars in 1187 bytes} [Mon Aug 29 10:45:40 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:41.463726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4beb9270-69b9-446c-84f5-d7274b33f37a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e50a60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.542135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4beb9270-69b9-446c-84f5-d7274b33f37a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f" status: 200 len: 1414 microversion: 2.1 time: 0.081953 Aug 29 10:45:41.542721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1308/2583] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:41 2022] GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:41.562236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69932253-c0c6-4e9f-bb97-36fda6ad90ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1151875170", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": -1, "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:41.595616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-69932253-c0c6-4e9f-bb97-36fda6ad90ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Flavor -1 could not be found. Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69932253-c0c6-4e9f-bb97-36fda6ad90ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 206 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1151875170", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": -1, "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: exception: Flavor -1 could not be found. Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1151875170', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': -1, 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:41.600227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 29 10:45:41.607365 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:41.611147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69932253-c0c6-4e9f-bb97-36fda6ad90ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:41.612470 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69932253-c0c6-4e9f-bb97-36fda6ad90ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068623 Aug 29 10:45:41.616863 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1309/2584] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:45:41.624651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.625675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:41.638284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.639140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.639961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.640986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.641882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.643478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.746014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.757368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b667f4a2-7ce2-443f-b8aa-787ecb6c7688 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.475809 Aug 29 10:45:41.758192 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1276/2585] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:41 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:41.762934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.767280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:41.783469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.784160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.784601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.785313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.785796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.786237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.822881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:41.892391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:41.913255 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6d2fe99-f7cd-4f08-9bf4-6d4af28b3cce tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1466 microversion: 2.1 time: 0.287865 Aug 29 10:45:41.913945 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1310/2586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:41 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:41.925980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-713196a4-7b88-470f-be9d-9005b6f78f5e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c7517d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.927519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:41.949663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c07938ee-f9ef-4afc-adee-d0e077e236c6 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 204 len: 0 microversion: 2.47 time: 0.189834 Aug 29 10:45:41.951119 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1277/2587] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:45:41 2022] DELETE /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:45:41.959425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:41.960671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:41.969822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.970519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.971338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:41.972338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:41.972994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:41.974392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.170850 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-713196a4-7b88-470f-be9d-9005b6f78f5e tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f" status: 204 len: 0 microversion: 2.1 time: 0.255801 Aug 29 10:45:42.171442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1311/2588] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:41 2022] DELETE /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:42.176354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ad1e551-c981-4994-ac0d-ae96bafa80e9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6c55670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.251748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ad1e551-c981-4994-ac0d-ae96bafa80e9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.078997 Aug 29 10:45:42.254528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1312/2589] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:42.265620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.266270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:42.289781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.290280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.290988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.293373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.293373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.293373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.362346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:42.572694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:42.583199 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-796cf42e-db07-4215-a131-c9f740327c3c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.630630 Aug 29 10:45:42.587769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1278/2590] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:41 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:42.595421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.596260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:42.619779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.620607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.621200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.622159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.623017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.623639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.624453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25d02d22-5e29-4898-af2a-545a091e8aff tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1619 microversion: 2.1 time: 0.368610 Aug 29 10:45:42.626374 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1313/2591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1619 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:42.634226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7923be85-4940-4858-9b05-5364e85523d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6bfdf70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.652425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:42.682468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-7923be85-4940-4858-9b05-5364e85523d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Image not found. Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7923be85-4940-4858-9b05-5364e85523d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f HTTP/1.1 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1f038151-b97b-492d-8af7-f8affb0f539f'} Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1f038151-b97b-492d-8af7-f8affb0f539f Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 10:45:42.690094 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f038151-b97b-492d-8af7-f8affb0f539f could not be found. Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:45:42.693766 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:42.702337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7923be85-4940-4858-9b05-5364e85523d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:42.703795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7923be85-4940-4858-9b05-5364e85523d0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f" status: 404 len: 62 microversion: 2.1 time: 0.073399 Aug 29 10:45:42.708547 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1314/2592] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:42.720206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.723476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:42.742785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.743676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.744625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.745615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.746330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.746988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.759681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:42.782105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:42.784147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:42.789503 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ec924db-2e7f-4f9b-9d9d-b314f0941a17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1362 microversion: 2.47 time: 0.197894 Aug 29 10:45:42.805001 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1279/2593] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:42.813552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:42.814563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:42.822051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.825204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.826699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:42.828068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:42.830391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:42.834911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:43.621262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:43.632529 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b8f11c8-4a9c-4a53-b4b5-eda930ae5fb9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1497 microversion: 2.1 time: 0.826095 Aug 29 10:45:43.654143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1280/2594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1497 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:43.660462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:43.666021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:43.680825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:43.681552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:43.682562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:43.683505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:43.686520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:43.687153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:43.732544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:43.748357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9529506a-b754-4b26-aa3c-0bcc5a1917db tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 1.037734 Aug 29 10:45:43.751212 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1315/2595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:42 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:43.756038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2137033391", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ec53f44c-01e4-4b61-8350-cea8fd318518"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:43.896589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:45:44.276172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:45:44.276853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:45:44.277508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:45:44.278113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:45:44.278719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:45:44.305388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.314720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.315396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.316558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.319171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.319932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.375257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:45:44.376817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:44.383896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Getting quotas for user b36d8457b2f84ac296a26d06922ddc7a and project 0c15797a6a384952a37fe2ca744e22a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:45:44.400738 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-60c7e371-3dbc-4d14-91d8-6c692435cbf8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.745128 Aug 29 10:45:44.417299 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1281/2596] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:43 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:44.417299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9259d9b5-f65f-47a9-a462-ef787e024c88 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6d8a5e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:44.417595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:45:44.423576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:45:44.516441 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9259d9b5-f65f-47a9-a462-ef787e024c88 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1454 microversion: 2.1 time: 0.110387 Aug 29 10:45:44.517475 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1282/2597] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:44 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:44.524343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:44.524961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:44.544364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.544903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.545687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.547085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.547574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.548008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.557363 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9021704-42e5-427a-b871-e2fed3170764 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804901 Aug 29 10:45:44.566399 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1316/2598] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:45:44.580863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2086beab-52d7-4023-bf9f-b44e0971e4fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65530895", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2086beab-52d7-4023-bf9f-b44e0971e4fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 171 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65530895", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-65530895', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi -1 Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:45:44.599637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:44.603908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2086beab-52d7-4023-bf9f-b44e0971e4fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:44.604883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2086beab-52d7-4023-bf9f-b44e0971e4fd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.036276 Aug 29 10:45:44.608207 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1317/2599] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:44 2022] POST /compute/v2.1/servers => generated 145 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:44.649982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae831d45-a5b4-48ed-ae23-14244b7b7369 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:44.654420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae831d45-a5b4-48ed-ae23-14244b7b7369 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:44.733436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:44.759670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:44.772559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:44.780145 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-788ab2fe-3a3b-473b-8ef0-fd821c59d2cc tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1362 microversion: 2.47 time: 0.261606 Aug 29 10:45:44.786748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1283/2600] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:44 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:44.800747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:44.803809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:44.820214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.824141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.827437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.828670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.829393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.830305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.941961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae831d45-a5b4-48ed-ae23-14244b7b7369 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:44.959427 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae831d45-a5b4-48ed-ae23-14244b7b7369 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1217 microversion: 2.1 time: 0.350073 Aug 29 10:45:44.965463 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1318/2601] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:44 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1217 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:44.983440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:44.984315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:44.993333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.993861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.994732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:44.995604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:44.996221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:44.997142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:45.475518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:45.503436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7538677e-109c-4676-97ff-8240f68ae25f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.714613 Aug 29 10:45:45.519517 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1284/2602] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:44 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:45.534337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:45.535244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:45.549989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:45.550485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:45.550924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:45.551630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:45.552080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:45.552498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:45.742681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:45.753753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-22972f3f-6849-495b-9326-eaa7458af4d7 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1503 microversion: 2.1 time: 0.785700 Aug 29 10:45:45.771979 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1319/2603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:44 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1503 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:45.785642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:45.786964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:45.806330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:45.807788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:45.808408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:45.812033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:45.813081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:45.814327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.051326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.061384 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97be4fef-3320-45ac-a35c-76e89e4d0742 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.537081 Aug 29 10:45:46.066122 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1285/2604] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:45 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.072991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d807a02e-a5d4-464f-9b58-1664a5ec8cb6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e9c9d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.134549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d807a02e-a5d4-464f-9b58-1664a5ec8cb6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1463 microversion: 2.1 time: 0.065963 Aug 29 10:45:46.135493 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1286/2605] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1463 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.146090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.146947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.154109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.154892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.155485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.156358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.157014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.157776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.197284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.198111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.198707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.199320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lazy-loading 'fault' on Instance uuid 0b812f0d-9efd-42b3-8235-996a4ce07392 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:45:46.226139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.243238 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-26ab2932-1505-4877-a6f8-384e709f3d83 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.467090 Aug 29 10:45:46.244867 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1320/2606] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:45 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.265289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.267510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.285148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.287251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.287730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.289986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.290683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.292502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.323121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.337778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.343019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.349299 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-314df2cb-e99d-456b-a69b-78544b6cb528 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 200 len: 1367 microversion: 2.47 time: 0.211244 Aug 29 10:45:46.371717 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1287/2607] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:46.374399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44555a31-411b-4087-92d2-4ec00dc991ff tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6ef9a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.456106 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44555a31-411b-4087-92d2-4ec00dc991ff tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 200 len: 1463 microversion: 2.1 time: 0.094045 Aug 29 10:45:46.466119 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1288/2608] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.473907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3083d44b-2462-404f-94cd-74e4a7954123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1628198462", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:46.482333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.493486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac85c491-7df5-4bf2-826c-343b4b713632 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1269 microversion: 2.1 time: 0.243980 Aug 29 10:45:46.501913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3083d44b-2462-404f-94cd-74e4a7954123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 10:45:46.517789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1321/2609] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.517789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.517789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3083d44b-2462-404f-94cd-74e4a7954123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 216 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1628198462", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1628198462', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:46.526872 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 10:45:46.531589 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.532090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.533872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3083d44b-2462-404f-94cd-74e4a7954123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:46.535972 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3083d44b-2462-404f-94cd-74e4a7954123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.066107 Aug 29 10:45:46.547540 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1289/2610] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:46.564587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.566820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.585184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.585959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.586479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.588128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.590362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.590892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.839116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.848555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:46.856182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d41c52e-1eb3-44cf-b055-22fbdc5bb76a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1468 microversion: 2.1 time: 0.348200 Aug 29 10:45:46.858209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c1ff73c-e00e-49f0-b28e-d84530649cc0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.309368 Aug 29 10:45:46.859377 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1290/2611] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.864179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:46.864974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.871136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.871783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.872354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.873862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.874471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.875030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.875320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1322/2612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1468 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:46.892965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1153160967"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:46.903364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:46.910956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.911832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.912539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:46.914507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:46.915312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:46.915995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.084884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:47.096347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0285dd3d-d272-43cd-b05e-509e2c422c3a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1485 microversion: 2.1 time: 0.235650 Aug 29 10:45:47.098108 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1291/2613] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:46 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1485 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:47.110785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.113240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:47.156630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.162162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.162822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.164576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.166769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.170718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.329661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90147bb6-17c5-4acd-8def-a34ac446aebb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "POST /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3/action" status: 202 len: 0 microversion: 2.1 time: 0.440533 Aug 29 10:45:47.330420 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1323/2614] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:46 2022] POST /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 10:45:47.338184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.345471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:47.379693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.382476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.383096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.385732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.386966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.393319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.686774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:47.713489 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28efca8b-9642-45f9-b793-d62b7fc3767b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.612274 Aug 29 10:45:47.718554 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1292/2615] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:47 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:47.743206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.760023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:47.761951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:47.768420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fbbde20-af58-4cb0-9f79-bcaa4fd93b35 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.435346 Aug 29 10:45:47.772331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.773024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.773685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.775407 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1324/2616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:47 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:47.775910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.776554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.778213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.780803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a7f2f-35f9-4884-bdb2-2b8563cda967", "name": "network-vif-plugged", "status": "completed", "tag": "bc1891b4-5a92-4c42-9cad-202346f66e30"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:47.791316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:47.796316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.796803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.797226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.831426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:47.832093 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] Creating event network-vif-plugged:bc1891b4-5a92-4c42-9cad-202346f66e30 for instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 on n-h2-854121-10 Aug 29 10:45:47.848216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8d967311-0731-447f-a3df-2e16d2ba5034 req-69aeb131-d306-4e5c-999c-249ea451c2f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061368 Aug 29 10:45:47.851492 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1325/2617] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:47.864745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-948d1f03-8768-4bf4-92b8-042b8920544f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb12b820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.945413 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-948d1f03-8768-4bf4-92b8-042b8920544f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.092390 Aug 29 10:45:47.946494 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1326/2618] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:47 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:47.961627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.964801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: 0b812f0d-9efd-42b3-8235-996a4ce07392] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:47.970113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a57ad3fc-011e-4c7c-9da8-4f40f04d9859 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 204 len: 0 microversion: 2.1 time: 0.248833 Aug 29 10:45:47.971310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1293/2619] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:47 2022] DELETE /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:47.983463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:47.984085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.984804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:47.986823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.987335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.990377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.990871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.994453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.995182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.995803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.996736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:47.996936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:47.997617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:47.998785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.044057 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] HTTP exception thrown: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Request method failure captured: Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 HTTP/1.1 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJihFRGP8VYxtotQRqXLXBP3_zD16Os4AHYEtloSAKyNzMQHYzfuopvcpyo3BTk2NNKfmcXuXbj6qQde6i1K-NPMYYNPSyFd4EfjHWui4NhW_Ar0_AqGzQVxxkbRof4JKtjJoUNuyu6PU35cFs0G4yoCJPnFK9hcu3CWEh9FMPwLOuI Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a3689137fc344b2b9f136f4917cc75f8 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a3689137fc344b2b9f136f4917cc75f8 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerShowV247Test-1101547842-project Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: d2d08ba84dc446bbbe3ebf2365d66ce9 Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerShowV247Test-1101547842-project Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '0b812f0d-9efd-42b3-8235-996a4ce07392'} Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.046767 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. Aug 29 10:45:48.050657 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.053191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Returning 404 to user: Instance 0b812f0d-9efd-42b3-8235-996a4ce07392 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:48.054285 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91ee9207-8bfa-4aba-9933-58bc92d7ef24 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392" status: 404 len: 111 microversion: 2.47 time: 0.106860 Aug 29 10:45:48.058782 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1327/2620] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:47 2022] GET /compute/v2.1/servers/0b812f0d-9efd-42b3-8235-996a4ce07392 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:48.065988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1274146888", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-key-1889586406", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:48.144295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] validate_networks() for [('96920ae8-fae5-466a-acdc-c8ef40245e0b', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:45:48.318985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:48.340545 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eef53e36-efde-4ca2-8467-993211bbeedf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1275 microversion: 2.1 time: 0.367712 Aug 29 10:45:48.359855 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1294/2621] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:47 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1275 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:48.367586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cca2f00a-beea-47c5-a24f-b3350f4496a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e9cca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:48.394648 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cca2f00a-beea-47c5-a24f-b3350f4496a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Image not found. Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cca2f00a-beea-47c5-a24f-b3350f4496a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f HTTP/1.1 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '1f038151-b97b-492d-8af7-f8affb0f539f'} Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f038151-b97b-492d-8af7-f8affb0f539f to delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f038151-b97b-492d-8af7-f8affb0f539f could not be found. Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.397104 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:45:48.400917 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.404308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cca2f00a-beea-47c5-a24f-b3350f4496a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:48.405793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cca2f00a-beea-47c5-a24f-b3350f4496a6 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f" status: 404 len: 62 microversion: 2.1 time: 0.044555 Aug 29 10:45:48.407785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1295/2622] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:48 2022] DELETE /compute/v2.1/images/1f038151-b97b-492d-8af7-f8affb0f539f => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:48.413661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:48.414773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:48.428976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.429894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.430611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.431780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.432441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.433129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.469549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:48.552804 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Invalid key_name provided. Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 247 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1274146888", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-key-1889586406", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid key_name provided. Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1274146888', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'key_name': 'tempest-key-1889586406', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1889586406 not found for user 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.554872 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid key_name provided. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a849501f-0752-4985-94f5-16844b56cc80 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.496232 Aug 29 10:45:48.560824 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1328/2623] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:45:48.568946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:48.570585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:48.582149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.587248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.587885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.588795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.592963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.593924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.596129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:48.637271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c738ca2-fdc5-4779-8945-29bb73704d8c tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8" status: 204 len: 0 microversion: 2.47 time: 0.226593 Aug 29 10:45:48.640967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:48.642046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1296/2624] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:45:48 2022] DELETE /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:45:48.667743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:48.671799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:48.690488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.691255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.693149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.707041 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Instance is already in deleting state, ignoring this request Aug 29 10:45:48.707996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.708582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.709032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.709170 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae40db83-a416-4b59-bbc1-032699155325 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 204 len: 0 microversion: 2.1 time: 0.147877 Aug 29 10:45:48.710262 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1329/2625] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:48 2022] DELETE /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:48.717413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:48.718647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:48.730335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.731170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.731829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.733377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:48.734272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:48.734861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:48.764358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:48.768405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:48.975577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:48.991138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:48.994986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:48.998495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b626de8-2979-4b7b-ad82-ac4e0c3f9577 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8" status: 200 len: 1363 microversion: 2.47 time: 0.284804 Aug 29 10:45:48.999091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1330/2626] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:48 2022] GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:49.020712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:49.021583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:49.031163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.032141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.032883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.034060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.035343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.036092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.081690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:49.094501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fd0eae8a-efa2-41d0-aa85-f1655e4c75ac tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.451149 Aug 29 10:45:49.109256 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1297/2627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:48 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.109256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:49.109256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:49.109256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.110418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.110949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.111758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.112426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.115418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.338105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:49.346628 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b3edf5e-5ed9-4372-b370-cf58b4b8503b tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1491 microversion: 2.1 time: 0.330819 Aug 29 10:45:49.361933 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1331/2628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:48 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1491 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.367901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49da5bc0-51a8-4c67-aef6-c0eddaf8fabf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66308b0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:49.432723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49da5bc0-51a8-4c67-aef6-c0eddaf8fabf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.069429 Aug 29 10:45:49.434198 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1332/2629] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:49 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.440366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:49.441032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:49.448328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.448818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.449252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.450048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.450543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.451535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.466738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:49.474572 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-814eacc4-b9f8-46cd-8ca1-86ca0f423e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.377126 Aug 29 10:45:49.487985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1298/2630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:49 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.494389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:49.495009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:49.502397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.502890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.503331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.504054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:49.504510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:49.504935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:49.913988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:49.925674 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-18cbdc31-c91f-4cc3-91f4-aa4d31a9e786 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.490356 Aug 29 10:45:49.926502 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1333/2631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:49 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.952271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:49.965246 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-08fff0ec-5bd6-4dd8-a419-599f813190f5 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.475830 Aug 29 10:45:49.972540 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1299/2632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:49 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:49.999304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a7f2f-35f9-4884-bdb2-2b8563cda967", "name": "network-vif-unplugged", "status": "completed", "tag": "bc1891b4-5a92-4c42-9cad-202346f66e30"}, {"server_uuid": "089c491c-4d5b-46f0-841b-f04a161b9068", "name": "network-vif-unplugged", "status": "completed", "tag": "043cc140-449c-47a1-b030-fdd429a26e32"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:50.026165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:50.027652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:50.028296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:50.055047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Creating event network-vif-unplugged:bc1891b4-5a92-4c42-9cad-202346f66e30 for instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 on n-h2-854121-10 Aug 29 10:45:50.056021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] Creating event network-vif-unplugged:043cc140-449c-47a1-b030-fdd429a26e32 for instance 089c491c-4d5b-46f0-841b-f04a161b9068 on n-h2-854121-10 Aug 29 10:45:50.064539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-17749dea-d13a-4260-9a51-25f22ab4172f req-f57d137c-5484-4fc6-a4fe-32987097470a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.072659 Aug 29 10:45:50.066934 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1300/2633] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:50.073260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:50.075196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:50.083092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:50.083876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:50.084764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:50.085652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:50.086464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:50.087118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:50.144662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d8a5ff3-79bb-4ba6-9c96-b473f94c9c9c tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6f79820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-439056753", "description": "tempest-description-1639497502"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:50.463557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:50.473117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:50.474901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d08ba84dc446bbbe3ebf2365d66ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3689137fc344b2b9f136f4917cc75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:50.476223 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d0ebae7-80f6-4127-8122-14b407f21e17 tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8" status: 200 len: 1363 microversion: 2.47 time: 0.407846 Aug 29 10:45:50.476858 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1301/2634] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:50 2022] GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:45:50.486653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223911089", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:50.727228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Neutron security group does_not_exist not found {{(pid=128682) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 29 10:45:50.728321 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 257 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223911089", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-223911089', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 29 10:45:50.754481 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:50.758741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:50.768469 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e5bb5fa-582b-4973-824a-daf9e9e09fc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.278443 Aug 29 10:45:50.768469 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1302/2635] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:45:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:50.771542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:50.774555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:50.785371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:50.787423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:50.788158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:50.789240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:50.790238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:50.790918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:50.925789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcddcae75e410786962c142abebf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3c97fcda0046039fbc060f2051dcb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:50.930851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d8a5ff3-79bb-4ba6-9c96-b473f94c9c9c tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.003181 Aug 29 10:45:50.939402 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1334/2636] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:50.939402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b6b0149-8a53-4493-a733-54185549944f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb12b0d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:50.959604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74d5ddb8-f06a-4565-9aa8-ffbbdb71d598 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 200 len: 1449 microversion: 2.1 time: 0.199142 Aug 29 10:45:50.964948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1303/2637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:50 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 1449 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:50.991148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:50.998534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:51.012782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.013681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.014582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.015488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.016118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.016893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.034367 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b6b0149-8a53-4493-a733-54185549944f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.100555 Aug 29 10:45:51.034964 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1335/2638] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:50 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:51.046682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:51.047308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:51.062746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.063315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.063815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.064722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.065550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.066154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.491550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:51.507131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:51.525389 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bdf3772a-d946-4119-9019-0bbd559910b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.482494 Aug 29 10:45:51.526110 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1336/2639] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:51 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:51.528435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77c4093f-05b6-4cfd-9eb4-3c7a74d6eb40 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.546669 Aug 29 10:45:51.532095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0d0cf52-4852-4993-84f9-fccff91382c7 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6c55f70>, body: {"security_group_rule": {"parent_group_id": "9786b3cf-42f7-4135-af1a-d1a9bfbb3300", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:51.543924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1304/2640] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:50 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:51.552362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:51.554942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:51.562531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.563363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.563963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.564865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.565879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.566506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:51.921979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:51.932405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2efff55a-b0fc-49ad-aa4f-5521b78d4f44 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.386570 Aug 29 10:45:51.947984 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1305/2641] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:51 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:51.961416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949a7f2f-35f9-4884-bdb2-2b8563cda967", "name": "network-vif-deleted", "tag": "bc1891b4-5a92-4c42-9cad-202346f66e30"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:51.987342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:51.987832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:51.988272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.017946 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] Creating event network-vif-deleted:bc1891b4-5a92-4c42-9cad-202346f66e30 for instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 on n-h2-854121-10 Aug 29 10:45:52.025429 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-11a09763-a12e-4787-aa91-ef56846d2672 req-a345c32f-c2a8-4e8b-a34f-34ebb8f78b57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075276 Aug 29 10:45:52.026240 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1306/2642] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:52.032564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.033416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] [instance: e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:52.039874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.040652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.041335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.042276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.044731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.045859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.065831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] HTTP exception thrown: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Request method failure captured: Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 HTTP/1.1 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJihFRGP8VYxtotQRqXLXBP3_zD16Os4AHYEtloSAKyNzMQHYzfuopvcpyo3BTk2NNKfmcXuXbj6qQde6i1K-NPMYYNPSyFd4EfjHWui4NhW_Ar0_AqGzQVxxkbRof4JKtjJoUNuyu6PU35cFs0G4yoCJPnFK9hcu3CWEh9FMPwLOuI Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: a3689137fc344b2b9f136f4917cc75f8 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3689137fc344b2b9f136f4917cc75f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: a3689137fc344b2b9f136f4917cc75f8 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerShowV247Test-1101547842 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerShowV247Test-1101547842-project Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d2d08ba84dc446bbbe3ebf2365d66ce9 Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerShowV247Test-1101547842-project Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8'} Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.067950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. Aug 29 10:45:52.072091 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.073753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] Returning 404 to user: Instance e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:52.074836 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9ec5faa-a4fc-41f1-b12d-9c5cf92796fd tempest-ServerShowV247Test-1101547842 tempest-ServerShowV247Test-1101547842-project] 10.222.0.47 "GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8" status: 404 len: 111 microversion: 2.47 time: 0.047161 Aug 29 10:45:52.076498 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1307/2643] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:45:52 2022] GET /compute/v2.1/servers/e09a328e-4bc6-4cec-8fa9-8f0ad4a3bfd8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:45:52.083043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.084163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:52.092496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.093853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.094509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.095624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.096498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.097213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.298040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0d0cf52-4852-4993-84f9-fccff91382c7 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.770563 Aug 29 10:45:52.299175 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1337/2644] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:45:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:52.313154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.314201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 949a7f2f-35f9-4884-bdb2-2b8563cda967] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:52.327848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.328857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.332353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.333830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.334315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.335914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.369949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 HTTP/1.1 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '949a7f2f-35f9-4884-bdb2-2b8563cda967'} Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.371864 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. Aug 29 10:45:52.376442 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.379056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance 949a7f2f-35f9-4884-bdb2-2b8563cda967 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:52.379924 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d2a6422-fb1d-4796-b1b6-5b7835ace202 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967" status: 404 len: 111 microversion: 2.1 time: 0.071997 Aug 29 10:45:52.380471 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1338/2645] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:52 2022] GET /compute/v2.1/servers/949a7f2f-35f9-4884-bdb2-2b8563cda967 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:52.392609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a518840e-5849-49cb-a1ec-07b56ecc274a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e7bf70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.472096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a518840e-5849-49cb-a1ec-07b56ecc274a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.085217 Aug 29 10:45:52.473911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1339/2646] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:52 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:52.479396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e94d3df-82d8-4c9b-be9b-1d8a8f06118d", "name": "network-vif-plugged", "status": "completed", "tag": "9e32fde7-2546-4ea0-8a5d-324d5460c796"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:52.492520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.493367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.494183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.507407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:52.515508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] Creating event network-vif-plugged:9e32fde7-2546-4ea0-8a5d-324d5460c796 for instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d on n-h2-854121-10 Aug 29 10:45:52.523691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-64227b31-37f2-4184-b669-98fa82997dc0 req-9cc7c7c9-fb59-48a3-80b5-57195ff74b84 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047185 Aug 29 10:45:52.524525 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1340/2647] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:52.524646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97b57655-76ce-40b3-b889-4693be4bc1e4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.446776 Aug 29 10:45:52.525510 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1308/2648] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:52 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:52.539132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b7889c4-0053-4504-9d68-6b0f4f81e132 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c7134dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-277377204", "description": "tempest-description-1589205732"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:52.556510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4ee182a-d9f8-413a-b843-363ae19cfec3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6e7bf70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.586541 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b4ee182a-d9f8-413a-b843-363ae19cfec3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Image not found. Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4ee182a-d9f8-413a-b843-363ae19cfec3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 HTTP/1.1 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7'} Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 to delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 could not be found. Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.588721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4ee182a-d9f8-413a-b843-363ae19cfec3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:52.593374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4ee182a-d9f8-413a-b843-363ae19cfec3 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7" status: 404 len: 62 microversion: 2.1 time: 0.048947 Aug 29 10:45:52.595744 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1341/2649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:52 2022] DELETE /compute/v2.1/images/a7830ac4-25c8-4931-bc0f-f5d1cdeeeae7 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:52.601977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.602882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ee47a616-1efe-4921-bd1a-b11934443435] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:52.612274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/ee47a616-1efe-4921-bd1a-b11934443435 HTTP/1.1 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ee47a616-1efe-4921-bd1a-b11934443435'} Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.614629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. Aug 29 10:45:52.619478 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:52.621163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance ee47a616-1efe-4921-bd1a-b11934443435 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:52.622390 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b51aef37-6931-412a-807a-aad12ec0a636 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ee47a616-1efe-4921-bd1a-b11934443435" status: 404 len: 111 microversion: 2.1 time: 0.025326 Aug 29 10:45:52.628989 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1342/2650] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:52 2022] DELETE /compute/v2.1/servers/ee47a616-1efe-4921-bd1a-b11934443435 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:52.634392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:52.635243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:52.643626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.644357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.644960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:52.645901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:52.646524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:52.647110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.003478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:53.005977 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b7889c4-0053-4504-9d68-6b0f4f81e132 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.479141 Aug 29 10:45:53.007446 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1309/2651] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:53.012627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.016488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:53.021275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8da0031b-ed5b-43a8-a770-83bf4d37b60d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.390917 Aug 29 10:45:53.023424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1343/2652] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:52 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:53.041987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.046142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.046933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.047892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.048546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.049131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.056126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.059665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:53.090152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.090954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.092068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.093593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.094220 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee HTTP/1.1 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'dbd75d88-63e1-441e-8d84-aa355a7d15ee'} Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:53.095845 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:53.100343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1105ed8a-17a4-4951-b1a1-9beebc54ce20 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 404 len: 111 microversion: 2.1 time: 0.088600 Aug 29 10:45:53.104567 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1310/2653] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:53 2022] DELETE /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:53.112826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.113772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:53.116811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.117624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.120291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.120785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.121225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.122143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.122670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.123795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.472916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:53.491091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a774525-67b2-4c41-9746-0c30459bf386 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.466336 Aug 29 10:45:53.491684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1344/2654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:53 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:53.518410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-475f1174-0202-453d-8397-1b43394641b7 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c66308b0>, body: {"security_group_rule": {"parent_group_id": "402bdd90-a539-470a-91ee-593c85d1ac8d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:53.524048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:53.538676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c11a735-748c-46d6-bf67-311b6b093cb7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.432489 Aug 29 10:45:53.557831 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1311/2655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:53 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:53.568478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.570202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: dbd75d88-63e1-441e-8d84-aa355a7d15ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:53.580243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.581539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.582775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.583811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.584500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.585286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.605719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee HTTP/1.1 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'dbd75d88-63e1-441e-8d84-aa355a7d15ee'} Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.611360 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. Aug 29 10:45:53.617444 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:53.621133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance dbd75d88-63e1-441e-8d84-aa355a7d15ee could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:53.624695 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bc02e420-73fe-4de6-b17a-97d9948432b0 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee" status: 404 len: 111 microversion: 2.1 time: 0.064548 Aug 29 10:45:53.626231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1312/2656] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:53 2022] GET /compute/v2.1/servers/dbd75d88-63e1-441e-8d84-aa355a7d15ee => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:53.651981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46734487-a325-43ed-a71e-3a02a2e5be25 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e97e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.789456 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46734487-a325-43ed-a71e-3a02a2e5be25 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.161736 Aug 29 10:45:53.793276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1313/2657] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:53 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:53.808427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:53.809658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:53.840939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.843252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.845163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:53.848237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:53.850544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:53.851293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.161774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-475f1174-0202-453d-8397-1b43394641b7 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.668974 Aug 29 10:45:54.162359 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1345/2658] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:45:53 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:54.168171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff538d4e-9c80-475a-8ea7-10c97fa10f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c6f05310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.221196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ff538d4e-9c80-475a-8ea7-10c97fa10f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Image not found. Aug 29 10:45:54.221904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff538d4e-9c80-475a-8ea7-10c97fa10f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 HTTP/1.1 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: exception: Image not found. Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'bb3f362f-a31a-47ae-8c1a-9bafa7b6b255'} Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 to delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 could not be found. Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.223965 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff538d4e-9c80-475a-8ea7-10c97fa10f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Image not found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff538d4e-9c80-475a-8ea7-10c97fa10f0a tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255" status: 404 len: 62 microversion: 2.1 time: 0.061949 Aug 29 10:45:54.229119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1346/2659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:54 2022] DELETE /compute/v2.1/images/bb3f362f-a31a-47ae-8c1a-9bafa7b6b255 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:54.240661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.245209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:54.258583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.259079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.259522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.260231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.260688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.261118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.261761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4a14c98-36c4-4f1c-9e75-b4741dbf67b6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.463951 Aug 29 10:45:54.263155 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1314/2660] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:53 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:54.272040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7193d8c7-12e9-495e-9ad0-ebf95fa82131", "tag": "8236e36b-c24f-45bd-88b5-1104303cf773"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:54.287414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.288581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.289240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.311277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] Creating event network-changed:8236e36b-c24f-45bd-88b5-1104303cf773 for instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 on n-h2-854121-10 Aug 29 10:45:54.319278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-87790eb8-01d0-4c2a-a5fa-676373ba4566 req-7555347a-9f71-4ab9-b1aa-f21d53ccba69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052266 Aug 29 10:45:54.321408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1315/2661] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:54.330565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-585d92cb-a0ed-4ad9-b930-bd883b9d5bb4 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c7002e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1194380341", "description": "tempest-description-1863321575"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:54.357007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:54.697876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:54.719164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c731d061-9ed3-448d-81a5-9a17e37ac9c9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1314 microversion: 2.1 time: 0.482942 Aug 29 10:45:54.719851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1347/2662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:54 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:54.730946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.733783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:54.745373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.747017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.748721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.750386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.753324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.755115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.782602 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 HTTP/1.1 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd893f51a-b42d-4a2b-8b42-3dbdbd98cf81'} Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:54.784996 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.789282 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.792533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:54.793845 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-defa560b-4012-4f81-b88c-0cfbbdad6bb4 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 404 len: 111 microversion: 2.1 time: 0.071986 Aug 29 10:45:54.795426 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1348/2663] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:54 2022] DELETE /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:54.800808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.802868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:45:54.803688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9223372036854775808 could not be found. Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9223372036854775808'} Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.805807 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.809572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.809572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:54.809572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:54.809572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 29 10:45:54.809572 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.814733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:54.815924 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80c0178b-b7f8-4fda-a68b-7c03f3aa8e5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019197 Aug 29 10:45:54.817955 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1349/2664] 10.222.0.47 () {58 vars in 1188 bytes} [Mon Aug 29 10:45:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:54.824613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.825448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:54.839973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.840653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.841597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.842844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.843587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.844444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.910913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-585d92cb-a0ed-4ad9-b930-bd883b9d5bb4 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.587621 Aug 29 10:45:54.912099 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1316/2665] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:54 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:54.917501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:54.919221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: d893f51a-b42d-4a2b-8b42-3dbdbd98cf81] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:54.938052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.939359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.942641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.944121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:54.945130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:54.947123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:54.974840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:54.992790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 HTTP/1.1 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd893f51a-b42d-4a2b-8b42-3dbdbd98cf81'} Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:54.994821 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. Aug 29 10:45:55.000896 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.003871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:55.013670 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29bcb980-7061-47f0-aad2-4e39bf29a4b9 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81" status: 404 len: 111 microversion: 2.1 time: 0.099664 Aug 29 10:45:55.018190 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1317/2666] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:54 2022] GET /compute/v2.1/servers/d893f51a-b42d-4a2b-8b42-3dbdbd98cf81 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:55.023148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1341af3d-be3c-4f03-aa60-a1089d974f5f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e97af0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:55.096856 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1341af3d-be3c-4f03-aa60-a1089d974f5f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.077343 Aug 29 10:45:55.098509 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1318/2667] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:55 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:55.103249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:55.114595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:55.131516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:55.132257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:55.132975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:55.134284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:55.135112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:55.135622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:55.490957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:55.504653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e3d5d551-2951-451f-af9e-c2ef4cd4f0eb tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.685305 Aug 29 10:45:55.507998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1350/2668] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:54 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:55.558431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bfc3ea1-41d0-4ed7-8ef6-a7e801542a14 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66cafd0ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1989852421", "description": "tempest-description-974663989"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:55.668063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:55.686569 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d022cd0d-1937-44fd-aa57-ce1e4649dcf6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.586799 Aug 29 10:45:55.689084 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1319/2669] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:55 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:55.707345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd5307ff-ff05-418d-8753-a68368d6b077 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '.version_select at 0x7f66c7134b80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:55.755006 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-dd5307ff-ff05-418d-8753-a68368d6b077 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Image not found. Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd5307ff-ff05-418d-8753-a68368d6b077 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc HTTP/1.1 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: exception: Image not found. Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '77cd8157-7d0d-4e85-a06f-e99f5357b1fc'} Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 77cd8157-7d0d-4e85-a06f-e99f5357b1fc to delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77cd8157-7d0d-4e85-a06f-e99f5357b1fc could not be found. Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.758073 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 10:45:55.764803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:45:55.768230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd5307ff-ff05-418d-8753-a68368d6b077 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Image not found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:55.769537 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd5307ff-ff05-418d-8753-a68368d6b077 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc" status: 404 len: 62 microversion: 2.1 time: 0.077330 Aug 29 10:45:55.770806 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1320/2670] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:55 2022] DELETE /compute/v2.1/images/77cd8157-7d0d-4e85-a06f-e99f5357b1fc => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:55.782032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:55.783040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:55.804505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:55.805503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:55.806246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:55.808615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:55.810549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:55.811790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.456090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:56.476975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9b50c99-c3bf-401c-976d-5091a509fbfb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.704736 Aug 29 10:45:56.496389 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1321/2671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:55 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:56.502924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:56.503803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:56.510301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.511046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.511699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.512614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.513958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.514602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.570848 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bfc3ea1-41d0-4ed7-8ef6-a7e801542a14 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.031173 Aug 29 10:45:56.579279 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1351/2672] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:56.579279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:56.579279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:56.591066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.592216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.592852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.593593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.594086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.594986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.630472 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 HTTP/1.1 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e4c690b-cc07-4f8c-b5df-e84a85777ac2'} Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:56.632071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:56.635934 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.641340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:56.642533 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-780fd027-3daf-4254-b4e7-a6d0e5aa8472 tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 404 len: 111 microversion: 2.1 time: 0.069868 Aug 29 10:45:56.643322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1352/2673] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:56 2022] DELETE /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:56.650021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-plugged", "status": "completed", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:56.683044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.683784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.684228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.703943 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] Creating event network-vif-plugged:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:45:56.713777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f8af0766-f89c-4f9c-bf43-97ef9343ad75 req-c8ce7a51-1232-486e-89ff-08a84c493540 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066840 Aug 29 10:45:56.715162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1353/2674] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:56.750166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b37c50d9-8321-4fe7-9520-403a060f65c3 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6d995e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:56.855102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b37c50d9-8321-4fe7-9520-403a060f65c3 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.137782 Aug 29 10:45:56.856454 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1354/2675] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:56 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:56.885074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:56.885625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Failed to fetch instance by id -1 {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:45:56.887853 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance -1 could not be found. Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance -1 could not be found. Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '-1'} Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:56.892742 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:56.898291 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:56.898291 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:56.898291 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 29 10:45:56.898291 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:56.900782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:56.906926 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3eba58c5-3510-4099-855e-1af92e8b4d47 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.041033 Aug 29 10:45:56.908074 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1355/2676] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:45:56 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:45:56.916270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:56.918548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:56.938516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.941259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.942471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:56.944968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:56.948261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:56.949370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.063946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:57.077435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e18045dc-626f-43a1-9fdc-8c2f24f48a20 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1501 microversion: 2.1 time: 0.578001 Aug 29 10:45:57.080109 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1322/2677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:56 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1501 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:57.089177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-71d48492-d67e-4cc8-b728-ddac11b396f1 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6e9c3a0>, body: {"security_group_rule": {"parent_group_id": "78416dc9-1382-4620-8497-f653ac7ffe63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "40cdac44-41c6-447b-8342-36ce9ed39c3a"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:57.292991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:57.302305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0298177-c7f3-4c8b-b083-d1014e88828a tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.392697 Aug 29 10:45:57.302896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1356/2678] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:56 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:57.321781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:57.322879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] [instance: 7e4c690b-cc07-4f8c-b5df-e84a85777ac2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:57.330803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.331523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.332161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.333205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.333920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.334827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.357637 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] HTTP exception thrown: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Request method failure captured: Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 HTTP/1.1 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJfc4vlhZBIFnk1M6Hc-EfLcykZ2y120dTImighKxVy-J2_XUlPgVRjcDTJeSYQL4RN6ckHyDQBm7gGy18x5N00gmFWEz4IMc4aHfgReNZUW4zo8spi4M5kahcnvPiF6H6e4SPajaLl1otwcjQBnSdnZXWQC6uhwjARpLfS5-PSWcSA Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/eb3c97fcda0046039fbc060f2051dcb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: eb3c97fcda0046039fbc060f2051dcb9 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesTestJSON-1903857042 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e2bcddcae75e410786962c142abebf34 Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesTestJSON-1903857042-project Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7e4c690b-cc07-4f8c-b5df-e84a85777ac2'} Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:57.359223 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] Returning 404 to user: Instance 7e4c690b-cc07-4f8c-b5df-e84a85777ac2 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66373b45-ad38-4cb9-b15f-226daaf73ead tempest-ImagesTestJSON-1903857042 tempest-ImagesTestJSON-1903857042-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2" status: 404 len: 111 microversion: 2.1 time: 0.045636 Aug 29 10:45:57.363045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1357/2679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:57 2022] GET /compute/v2.1/servers/7e4c690b-cc07-4f8c-b5df-e84a85777ac2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:57.366095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:57.378886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:57.393367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.394026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.394628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.395715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.399306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.400625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.638921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:57.653240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1ad7336-2861-4952-a44d-b082383b9221 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.291025 Aug 29 10:45:57.671788 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1358/2680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:57 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:57.678811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:57.682674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:57.699481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.704137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.704885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.705773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.709103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.709694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.771111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:45:57.876462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-71d48492-d67e-4cc8-b728-ddac11b396f1 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.792334 Aug 29 10:45:57.877071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1323/2681] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:45:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:57.881557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:57.882202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:57.913125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.918027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.920668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:57.922128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:57.928194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:57.928949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.016888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec983e9c-906b-4c0c-8f3e-1f2a505f47bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 204 len: 0 microversion: 2.1 time: 0.343360 Aug 29 10:45:58.018070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1359/2682] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:45:57 2022] DELETE /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:45:58.024126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-488529b5-5248-4332-9f52-aaba20432ce5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6318d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:58.109062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-488529b5-5248-4332-9f52-aaba20432ce5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.089189 Aug 29 10:45:58.110082 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1360/2683] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:58 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:58.121473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b1fa1d2-ea33-49fa-9a98-feed47a9d0fa tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6318670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1124530024", "description": "tempest-description-518830457"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:58.254119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:58.269140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1913a6e1-81dc-4159-951b-f13d11466ea6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.390826 Aug 29 10:45:58.285841 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1324/2684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:57 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:58.285841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:58.285841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:58.305906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.307913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.308391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.313430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.314073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.314583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.368410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:58.384657 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b1fa1d2-ea33-49fa-9a98-feed47a9d0fa tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.272209 Aug 29 10:45:58.395711 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1361/2685] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:58.401229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:58.402201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: c5021c6c-dfcd-4ccd-8394-6955bc71c2f7] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:58.420793 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/c5021c6c-dfcd-4ccd-8394-6955bc71c2f7/action HTTP/1.1 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 19 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: {"forceDelete": {}} Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c5021c6c-dfcd-4ccd-8394-6955bc71c2f7', 'body': {'forceDelete': {}}} Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:45:58.428804 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:45:58.432700 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:45:58.432700 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:45:58.432700 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. Aug 29 10:45:58.432700 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:45:58.434491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance c5021c6c-dfcd-4ccd-8394-6955bc71c2f7 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:45:58.436478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-75a1ca02-6933-4d3b-94dc-60b3b9ec306c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/c5021c6c-dfcd-4ccd-8394-6955bc71c2f7/action" status: 404 len: 111 microversion: 2.1 time: 0.038898 Aug 29 10:45:58.437281 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1362/2686] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:45:58 2022] POST /compute/v2.1/servers/c5021c6c-dfcd-4ccd-8394-6955bc71c2f7/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:45:58.448257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:58.449287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:58.461364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.461923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.462498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.463209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.463676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.464101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.727434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:58.746683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-061c4eaf-0d0e-4531-8b9c-169bffbc61c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1507 microversion: 2.1 time: 0.468207 Aug 29 10:45:58.762774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1325/2687] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:58 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:58.773427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c4c3059b-c9d2-451b-9d01-0e57f656bb54 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c66fdaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1051164934", "description": "tempest-description-1498759056"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:58.826477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:58.841499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbe0f197-ab8d-491e-aa2a-14f02caaf891 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.402516 Aug 29 10:45:58.842286 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1363/2688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:58 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:58.855245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:58.861111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:58.875422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.877187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.877917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:58.878892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:58.879579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:58.880245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:59.116074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:45:59.147843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ba8ea0f6-dcb0-42f8-889e-ba2261bde845 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.301665 Aug 29 10:45:59.151587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1364/2689] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:58 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:59.173884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7193d8c7-12e9-495e-9ad0-ebf95fa82131", "name": "network-vif-plugged", "status": "completed", "tag": "8236e36b-c24f-45bd-88b5-1104303cf773"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:45:59.189558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:59.190407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:59.191149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:59.232539 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] Creating event network-vif-plugged:8236e36b-c24f-45bd-88b5-1104303cf773 for instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 on n-h2-854121-10 Aug 29 10:45:59.242151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c4c3059b-c9d2-451b-9d01-0e57f656bb54 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.476983 Aug 29 10:45:59.243294 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1326/2690] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:45:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:59.248609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24de0774-4366-4119-96cd-e698d5ada7c5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66fde50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:59.254616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-56faf69b-9575-41d4-a241-02be7e55c118 req-33609c47-22cf-4895-b07f-53d2dcbaa4be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099252 Aug 29 10:45:59.257672 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1365/2691] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:45:59.285487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:45:59.288666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:45:59.303253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:59.304937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:59.306125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:59.307822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:45:59.308747 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24de0774-4366-4119-96cd-e698d5ada7c5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.064239 Aug 29 10:45:59.309451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:45:59.310676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:45:59.318135 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1327/2692] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:45:59 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:45:59.320153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:45:59.323418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5006b463-55c8-48df-89de-26393e89fc13 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6f045e0>, body: {"security_group_rule": {"parent_group_id": "126b686e-fa27-4555-af6f-9c4d2a165332", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d8abb0b3-a5f1-4639-88fd-63ad068fca7a"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:00.616843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:00.634560 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89e58740-490e-499b-8ef1-2c334dc50b9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 1.372129 Aug 29 10:46:00.635786 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1366/2693] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:45:59 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:00.641997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:00.657474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:00.677002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:00.678699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:00.679173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:00.681006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:00.681490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:00.684900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:00.910475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:00.926011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b991c645-6432-4c8b-98ca-aa638b4e891f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1507 microversion: 2.1 time: 0.288877 Aug 29 10:46:00.926857 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1367/2694] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:00 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:00.934961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:00.942388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:00.949372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:00.952795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:00.957948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:00.958792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:00.959277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:00.959720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:01.438547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5006b463-55c8-48df-89de-26393e89fc13 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.118318 Aug 29 10:46:01.439466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1328/2695] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:45:59 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:01.449233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33fb9bcb-efc2-4e4d-ba07-bbdcdeb0b4af tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6d8a790>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:01.480485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:01.495355 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32f32a78-1e79-475a-9679-1b76982d51be tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1317 microversion: 2.1 time: 0.567060 Aug 29 10:46:01.498962 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1368/2696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:00 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:01.513165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:01.518327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 3c768be6-76ce-441b-b385-b330e9ca5156] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:01.534331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/3c768be6-76ce-441b-b385-b330e9ca5156/action HTTP/1.1 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 39 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: {"os-getConsoleOutput": {"length": 10}} Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3c768be6-76ce-441b-b385-b330e9ca5156', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:01.543556 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. Aug 29 10:46:01.550011 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:01.550543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33fb9bcb-efc2-4e4d-ba07-bbdcdeb0b4af tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.108561 Aug 29 10:46:01.550543 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1329/2697] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:01 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:01.551712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 3c768be6-76ce-441b-b385-b330e9ca5156 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:01.552989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aeeb7bc3-f261-45d4-92d6-1a84c9ca59f3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/3c768be6-76ce-441b-b385-b330e9ca5156/action" status: 404 len: 111 microversion: 2.1 time: 0.052659 Aug 29 10:46:01.554277 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1369/2698] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:01 2022] POST /compute/v2.1/servers/3c768be6-76ce-441b-b385-b330e9ca5156/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:01.559886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-69d69c53-122b-4d19-88a7-9fe5113ef154 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c6e97670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:01.564928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:01.568104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:01.590769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:01.593476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:01.596350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:01.600926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:01.601676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:01.603449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.256189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:02.268679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a372211-84ff-4290-a4af-d55df702b0a3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.710110 Aug 29 10:46:02.271558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1370/2699] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:01 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:02.276761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:02.277638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:02.301300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.303711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.304354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.305122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.307392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.307916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.393733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.393733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.393733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.394136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'fault' on Instance uuid 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:02.508286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:02.522211 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6aa8401e-4ae2-440d-9d6a-b56292b7282b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 200 len: 1304 microversion: 2.1 time: 0.249184 Aug 29 10:46:02.523029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1371/2700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:02 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:02.538024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e94d3df-82d8-4c9b-be9b-1d8a8f06118d", "name": "network-vif-deleted", "tag": "9e32fde7-2546-4ea0-8a5d-324d5460c796"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:02.566381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.569052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.569535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.597656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] Creating event network-vif-deleted:9e32fde7-2546-4ea0-8a5d-324d5460c796 for instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d on n-h2-854121-10 Aug 29 10:46:02.604645 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d2ac3864-e69b-43ba-9a7b-84b41f8e2b8b req-8b6fd950-448d-4ca7-9beb-07769cd76af1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079705 Aug 29 10:46:02.605598 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1372/2701] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:02.613349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:02.613894 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-69d69c53-122b-4d19-88a7-9fe5113ef154 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/d8abb0b3-a5f1-4639-88fd-63ad068fca7a" status: 202 len: 0 microversion: 2.1 time: 1.062745 Aug 29 10:46:02.614356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:02.615140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1330/2702] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:01 2022] DELETE /compute/v2.1/os-security-groups/d8abb0b3-a5f1-4639-88fd-63ad068fca7a => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:02.623774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.625006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.625590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.625926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:02.626854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.627477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.628070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.628592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:02.670818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.672155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.673160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.674169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:02.674858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:02.675526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:02.974841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:02.992625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e743dff8-9871-49d8-be08-ef220dedd43d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.385464 Aug 29 10:46:02.993229 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1373/2703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:02 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:03.004709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-945ac2b6-ed07-42f7-a7e0-84adea7aa9be tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cb12b0d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:03.110093 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-945ac2b6-ed07-42f7-a7e0-84adea7aa9be tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.110965 Aug 29 10:46:03.111961 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1374/2704] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:02 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:03.126095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-650154f0-fa3f-4c97-853c-21123b1aaabf tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c62dbca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:03.251571 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-650154f0-fa3f-4c97-853c-21123b1aaabf tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/126b686e-fa27-4555-af6f-9c4d2a165332" status: 200 len: 247 microversion: 2.1 time: 0.137236 Aug 29 10:46:03.252678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1375/2705] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:46:03 2022] GET /compute/v2.1/os-security-groups/126b686e-fa27-4555-af6f-9c4d2a165332 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:03.257867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:03.259082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: c11c898e-4a56-4c41-9fed-3622003fc880] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:03.274824 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/c11c898e-4a56-4c41-9fed-3622003fc880 HTTP/1.1 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c11c898e-4a56-4c41-9fed-3622003fc880'} Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:03.276521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance c11c898e-4a56-4c41-9fed-3622003fc880 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:03.281909 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-728121cd-0fa7-48a3-a1d2-979632143c58 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/c11c898e-4a56-4c41-9fed-3622003fc880" status: 404 len: 111 microversion: 2.1 time: 0.024095 Aug 29 10:46:03.289360 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1376/2706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:03 2022] GET /compute/v2.1/servers/c11c898e-4a56-4c41-9fed-3622003fc880 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:03.297440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b47e0c15-b94b-414a-8015-b51c9b842665 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c62dbca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-958681397", "description": "tempest-description-1234191841"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:03.701407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:03.718386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36b6fed3-6749-4308-aa3a-7bede3c39264 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1467 microversion: 2.1 time: 1.100410 Aug 29 10:46:03.719669 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1331/2707] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:02 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1467 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:03.726224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:03.727236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:03.736179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:03.736670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:03.738051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:03.738935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:03.739489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:03.740827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.213224 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b47e0c15-b94b-414a-8015-b51c9b842665 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.919473 Aug 29 10:46:04.214574 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1377/2708] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:46:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:04.223822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:04.225549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:04.259298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.264341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.268393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.271723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.275707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.279719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.281680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:04.291021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f799e0e-fd62-4266-a3f0-194b8988b99f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.569424 Aug 29 10:46:04.296388 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1332/2709] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:03 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:04.308833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:04.309929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:04.334977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.340092 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:46:04.343622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.344117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d HTTP/1.1 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6e94d3df-82d8-4c9b-be9b-1d8a8f06118d'} Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:04.345159 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:46:04.349289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:04.349842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.349842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.349842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.352578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:04.353773 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2afd0917-bf57-4ca7-b7c2-97b62e409df3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 404 len: 111 microversion: 2.1 time: 0.137892 Aug 29 10:46:04.355482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1378/2710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:04 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:04.368349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb2f1dce-6a03-4868-81d9-bded0bec2bfe tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62dbaf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:04.453526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb2f1dce-6a03-4868-81d9-bded0bec2bfe tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.091504 Aug 29 10:46:04.456989 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1379/2711] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:04 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:04.468642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f36d5fd-160e-4331-bc3c-3257f406c49f tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66c6300d30>, body: {"security_group_rule": {"parent_group_id": "91204b99-b83f-434a-9b89-8399f3e3eba1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:04.764940 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d305c040-c030-4b76-b0fb-30545485db4e tempest-ServersOnMultiNodesTest-1670330314 tempest-ServersOnMultiNodesTest-1670330314-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1620 microversion: 2.1 time: 0.467135 Aug 29 10:46:04.773411 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1333/2712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:04 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1620 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:04.778601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:04.783122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:04.795682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.796364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.796992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:04.797915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:04.798525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:04.799098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:05.256204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:05.271715 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23d76c71-cc86-4c0c-abc6-40ba07c70e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.494929 Aug 29 10:46:05.277720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1334/2713] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:04 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:05.300846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-115129343", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:05.368540 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f36d5fd-160e-4331-bc3c-3257f406c49f tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.910159 Aug 29 10:46:05.370222 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1380/2714] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:46:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:05.375909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:05.376657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:05.401602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:05.404573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:05.405886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:05.407076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:05.410807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:05.412518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:05.463216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:46:05.509147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:05.740856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8765ae3-61d0-4357-bf9e-672d515c6717 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 204 len: 0 microversion: 2.1 time: 0.369267 Aug 29 10:46:05.745741 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1381/2715] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:05 2022] DELETE /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:05.752651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-011bf8fe-e4d4-44c1-a5b8-2de013350d70 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Action: 'create', calling method: .version_select at 0x7f66cb12bee0>, body: {"security_group_rule": {"parent_group_id": "91204b99-b83f-434a-9b89-8399f3e3eba1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:06.650421 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-011bf8fe-e4d4-44c1-a5b8-2de013350d70 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.903040 Aug 29 10:46:06.651128 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1382/2716] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:46:05 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:06.669105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a9e9279-6e34-423a-8c1f-2d174898d126 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cafd0790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:06.837004 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a9e9279-6e34-423a-8c1f-2d174898d126 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.184792 Aug 29 10:46:06.845364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1383/2717] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:06 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:06.854222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a419012-38c5-42aa-a77c-a77a4ba02ba4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-288268605", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:06.884022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:46:06.884598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:46:06.885240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:46:06.891184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:46:06.891980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a419012-38c5-42aa-a77c-a77a4ba02ba4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 237 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-288268605", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-288268605', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.894961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a419012-38c5-42aa-a77c-a77a4ba02ba4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1a419012-38c5-42aa-a77c-a77a4ba02ba4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.057960 Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1384/2718] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:06.903207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:06.907210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:06.907375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:06.907869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:06.909311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:06.909892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:06.910423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:06.915828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:06.922162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:06.922709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:06.923438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:06.923926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:06.924338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:06.971082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:46:07.014427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:46:07.057105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:46:07.067347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:46:07.181967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3dfdbf83-67a6-437e-b9ab-1d9ec0b47c41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900785 Aug 29 10:46:07.183192 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1335/2719] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:46:07.188683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b2c32e0f-09fe-46fd-80f0-f1fe564d2fdd tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c6e43430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:07.272990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:07.288533 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e5667c08-9c9b-47be-b7a5-1eaf762abcda tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1473 microversion: 2.1 time: 0.388170 Aug 29 10:46:07.302897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1385/2720] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:06 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:07.308642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:07.309455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:07.316901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:07.317625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:07.318240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:07.319122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:07.319730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:07.320325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:07.619838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b2c32e0f-09fe-46fd-80f0-f1fe564d2fdd tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/91204b99-b83f-434a-9b89-8399f3e3eba1" status: 200 len: 664 microversion: 2.1 time: 0.435411 Aug 29 10:46:07.620428 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1336/2721] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:46:07 2022] GET /compute/v2.1/os-security-groups/91204b99-b83f-434a-9b89-8399f3e3eba1 => generated 664 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:07.634455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a48218d-b0ff-4be2-ad42-2b4933cdfbd7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:07.635075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a48218d-b0ff-4be2-ad42-2b4933cdfbd7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:08.249374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5a48218d-b0ff-4be2-ad42-2b4933cdfbd7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:08.267344 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a48218d-b0ff-4be2-ad42-2b4933cdfbd7 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1214 microversion: 2.1 time: 0.635863 Aug 29 10:46:08.270250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1337/2722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:07 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1214 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:08.274704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:08.281312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83ab1231-7190-4f19-a3bb-419be9bddd9e tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c64add30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:08.295029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72747d80-2b4f-430a-be29-5183e592f50a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.987443 Aug 29 10:46:08.296485 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1386/2723] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:07 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:08.320534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7cb30c3-94d5-4d3f-ac40-da268e9ddac0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6299e50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:08.467687 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7cb30c3-94d5-4d3f-ac40-da268e9ddac0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.167918 Aug 29 10:46:08.480920 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1387/2724] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:08 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:08.488566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:08.491116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:08.501318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:08.502151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:08.502904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:08.505386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:08.506624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:08.507239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:09.024057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:09.032527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83ab1231-7190-4f19-a3bb-419be9bddd9e tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/57a7ac20-e7be-4366-a396-f229211996d1" status: 202 len: 0 microversion: 2.1 time: 0.761147 Aug 29 10:46:09.033136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1338/2725] 10.222.0.47 () {58 vars in 1287 bytes} [Mon Aug 29 10:46:08 2022] DELETE /compute/v2.1/os-security-group-rules/57a7ac20-e7be-4366-a396-f229211996d1 => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:09.036490 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-493cc3d8-510f-48e6-8f8b-0edd9d033152 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1473 microversion: 2.1 time: 0.551962 Aug 29 10:46:09.037283 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1388/2726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:08 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1473 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:09.040324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:09.040965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:09.049029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00e98b88-2c96-4214-a6f7-9525f2decf47 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c758f550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:09.069321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:09.069863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:09.070317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:09.077262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:09.078260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:09.078970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:09.446297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:09.459858 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d6176a7e-5197-4c6c-8284-2fc51213ab7f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.425485 Aug 29 10:46:09.463964 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1339/2727] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:09 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:09.475292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:09.476129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:09.492566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:09.493235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:09.493914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:09.495841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:09.497889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:09.500696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:09.948220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:09.958134 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c94c5cd2-abab-4a63-9c4c-58659ef12d43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1266 microversion: 2.1 time: 0.492785 Aug 29 10:46:09.962794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1340/2728] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:09 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:09.985858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fedb22c5-8a3c-4fb2-951e-7a52cd56e2d2 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c64ad700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:10.085490 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fedb22c5-8a3c-4fb2-951e-7a52cd56e2d2 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.121324 Aug 29 10:46:10.086423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1341/2729] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:09 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:10.092133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d966a3c-4f27-4581-8a41-a5a06f0fff90 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2101466388", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d966a3c-4f27-4581-8a41-a5a06f0fff90 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 235 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2101466388", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2101466388', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.107912 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 10:46:10.112910 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:10.124378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d966a3c-4f27-4581-8a41-a5a06f0fff90 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:10.125823 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d966a3c-4f27-4581-8a41-a5a06f0fff90 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.038251 Aug 29 10:46:10.127049 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1342/2730] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:10 2022] POST /compute/v2.1/servers => generated 133 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:10.135059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7193d8c7-12e9-495e-9ad0-ebf95fa82131", "name": "network-vif-deleted", "tag": "8236e36b-c24f-45bd-88b5-1104303cf773"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:10.178562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.179346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.179945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.221065 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] Creating event network-vif-deleted:8236e36b-c24f-45bd-88b5-1104303cf773 for instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 on n-h2-854121-10 Aug 29 10:46:10.238722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6f58be0a-e025-4bca-9b58-41d32a3f59d1 req-32ef5b09-a19a-4f65-a134-378d445628c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109933 Aug 29 10:46:10.242241 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1343/2731] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:10.263128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:10.264810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:10.275734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.276511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.277129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.278056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.279370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.279999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.364215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.365047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.365694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.366669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lazy-loading 'fault' on Instance uuid 7193d8c7-12e9-495e-9ad0-ebf95fa82131 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:10.403362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00e98b88-2c96-4214-a6f7-9525f2decf47 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/91204b99-b83f-434a-9b89-8399f3e3eba1" status: 202 len: 0 microversion: 2.1 time: 1.361617 Aug 29 10:46:10.405869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1389/2732] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:09 2022] DELETE /compute/v2.1/os-security-groups/91204b99-b83f-434a-9b89-8399f3e3eba1 => generated 0 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:10.411622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:10.412659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:10.432347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.437687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.440481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.454720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:10.455624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:10.456356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:10.467255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:10.496092 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f41e7f25-a721-44a3-b872-3c231253920e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 200 len: 1307 microversion: 2.1 time: 0.252030 Aug 29 10:46:10.499189 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1344/2733] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:10 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:10.516453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c64ad8b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:11.309143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:46:11.310019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Neutron security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:46:11.313233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] HTTP exception thrown: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.313233 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Request method failure captured: Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-security-groups/d8abb0b3-a5f1-4639-88fd-63ad068fca7a HTTP/1.1 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjdlt26w1d6iZMHaIOl9VZPOTfzI4tZ0-JSor2f7oHYFuXgDVJ74bZr48HUJmTLGUFQvLCxcXyzDtUN0SZJe1qfNt1krRA0d0GQbpjCGtWK9-IsLjXOtoEGzlA2PI7MvOo4ay5TIwnTlOFZ_jGMfT4_e1UeJ9SvTkx0RC9aiSl30pE Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 291c700f5de3468c85dc2fa580831f8a Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1455893256 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/291c700f5de3468c85dc2fa580831f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_291c700f5de3468c85dc2fa580831f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/291c700f5de3468c85dc2fa580831f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/291c700f5de3468c85dc2fa580831f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1455893256 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 291c700f5de3468c85dc2fa580831f8a Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1455893256 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupRulesTestJSON-1455893256-project Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2a093138a3f944ffaabed83cec4e468e Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1455893256-project Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd8abb0b3-a5f1-4639-88fd-63ad068fca7a'} Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:46:11.327984 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] Aug 29 10:46:11.332106 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:11.338673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Returning 404 to user: Security group d8abb0b3-a5f1-4639-88fd-63ad068fca7a does not exist Aug 29 10:46:11.338673 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-03a59d72-215f-4457-9b45-30c768c084b6'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:11.339453 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6862c2ad-5d14-43ee-89ff-c8107bfabd25 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/d8abb0b3-a5f1-4639-88fd-63ad068fca7a" status: 404 len: 194 microversion: 2.1 time: 0.838921 Aug 29 10:46:11.343876 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1345/2734] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:10 2022] DELETE /compute/v2.1/os-security-groups/d8abb0b3-a5f1-4639-88fd-63ad068fca7a => generated 194 bytes in 840 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:11.347368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:11.351281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:11.366866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:11.367375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:11.367821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:11.369026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:11.369491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:11.369952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:11.679337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:11.712313 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4062b7e-0426-462c-a950-4c758bea6443 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 1.304821 Aug 29 10:46:11.712920 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1390/2735] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:10 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:12.033197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:12.041179 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3d7df0c-4a76-4b78-b922-4b8d6eb8782e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.700316 Aug 29 10:46:12.050009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1346/2736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:11 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:12.055024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67029b77-22e8-4623-bd54-c423d6c6c1b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e9ca60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:12.134107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd190e3a-85d9-4bdc-ad90-5e31b4beaded tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: .version_select at 0x7f66c62a8c10>, body: {"keypair": {"name": "tempest-keypair-1348994504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZjIH1cevZhHmHoAkmhIOIYa3sRdLX1zo2DL+FDSWnB8unegSqlxOJnq+37AjAKE7k/GctO9Kk2UhmW0LRLGhAB551YuW3EKyDyWlMFNwZkCAC9XOj7gvNz+btHxKucNQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:12.165386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:12.182930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67029b77-22e8-4623-bd54-c423d6c6c1b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.131518 Aug 29 10:46:12.184499 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1347/2737] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:12 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:12.192895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa892ba3-14f9-418d-8c40-20ae31e4f74e tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c64a5e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:12.217807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fd190e3a-85d9-4bdc-ad90-5e31b4beaded tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:46:12.234779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fd190e3a-85d9-4bdc-ad90-5e31b4beaded tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:46:12.275983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd190e3a-85d9-4bdc-ad90-5e31b4beaded tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.559624 Aug 29 10:46:12.283691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1391/2738] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:46:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:12.306376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:12.309406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7193d8c7-12e9-495e-9ad0-ebf95fa82131] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:12.332124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.339317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.339916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:12.340663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.341265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.342792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:12.368196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 HTTP/1.1 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7193d8c7-12e9-495e-9ad0-ebf95fa82131'} Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:12.370250 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. Aug 29 10:46:12.374843 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:12.377164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance 7193d8c7-12e9-495e-9ad0-ebf95fa82131 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:12.378414 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b279fc5e-bb8b-43b7-87d5-f1bcd2c7249e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131" status: 404 len: 111 microversion: 2.1 time: 0.090919 Aug 29 10:46:12.382548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1392/2739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:12 2022] GET /compute/v2.1/servers/7193d8c7-12e9-495e-9ad0-ebf95fa82131 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:12.390520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:12.391488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:12.398562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.399395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.400020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:12.400969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.402116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.402919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:12.900132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:12.916623 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd05a060-716c-4a37-8fbe-7c47521ba7bd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.532723 Aug 29 10:46:12.927640 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1393/2740] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:12 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:12.933623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:12.934474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:12.949825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.955191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.955983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:12.956939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:12.958664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:12.959354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:13.020681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:13.068003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:13.072186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa892ba3-14f9-418d-8c40-20ae31e4f74e tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/126b686e-fa27-4555-af6f-9c4d2a165332" status: 202 len: 0 microversion: 2.1 time: 0.885234 Aug 29 10:46:13.073489 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1348/2741] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:12 2022] DELETE /compute/v2.1/os-security-groups/126b686e-fa27-4555-af6f-9c4d2a165332 => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:13.084512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:13.085885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: e667ae73-74c1-4e33-91e7-2fbfdac5680f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:13.111892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/e667ae73-74c1-4e33-91e7-2fbfdac5680f/action HTTP/1.1 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 13 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: {"pause": {}} Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e667ae73-74c1-4e33-91e7-2fbfdac5680f', 'body': {'pause': {}}} Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:13.126729 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance e667ae73-74c1-4e33-91e7-2fbfdac5680f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed82896c-c5e2-4354-928a-f9631cb723e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/e667ae73-74c1-4e33-91e7-2fbfdac5680f/action" status: 404 len: 111 microversion: 2.1 time: 0.055836 Aug 29 10:46:13.135351 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1349/2742] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:13 2022] POST /compute/v2.1/servers/e667ae73-74c1-4e33-91e7-2fbfdac5680f/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:13.160568 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-947e765f-9d87-4946-a414-9260af8fdf06 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 204 len: 0 microversion: 2.1 time: 0.237553 Aug 29 10:46:13.161449 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1394/2743] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:12 2022] DELETE /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:13.164837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:13.165486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:13.183589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c2e0f9c-3348-4c59-aa18-c4d7d425bd1a tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c65c8160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:13.198708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:13.205985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:13.211678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:13.212759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:13.213784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:13.214480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:13.663665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:13.676922 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7a07424-d8c6-42ca-af67-3cd9b42f735d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.541381 Aug 29 10:46:13.678026 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1350/2744] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:13 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:13.694242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:13.694788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:13.705971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:13.708638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:13.709197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:13.710322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:13.710812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:13.712741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:14.571956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:14.587014 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99efa40b-4ad7-4d38-8e16-0519c51387fb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.906620 Aug 29 10:46:14.587885 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1351/2745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:13 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:14.617292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c2e0f9c-3348-4c59-aa18-c4d7d425bd1a tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/40cdac44-41c6-447b-8342-36ce9ed39c3a" status: 202 len: 0 microversion: 2.1 time: 1.454800 Aug 29 10:46:14.621126 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1395/2746] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:13 2022] DELETE /compute/v2.1/os-security-groups/40cdac44-41c6-447b-8342-36ce9ed39c3a => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:14.621495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:14.622152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:14.623652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6ef518d1-868f-4100-83ec-6b2192bd64b7 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66cafd0280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:14.641997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:14.642486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:14.642922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:14.654821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:14.655411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:14.656031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:14.773160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6ef518d1-868f-4100-83ec-6b2192bd64b7 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.153904 Aug 29 10:46:14.773773 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1396/2747] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:14 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:14.778584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f67395-9c30-472c-86be-3c5eb7b82574", "tag": "2dc638cb-5d19-4737-b686-61c0bc12aff1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:14.815523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:14.818295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:14.818912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:14.845159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] Creating event network-changed:2dc638cb-5d19-4737-b686-61c0bc12aff1 for instance 98f67395-9c30-472c-86be-3c5eb7b82574 on n-h2-854121-10 Aug 29 10:46:14.852516 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-faa45f03-c2ec-4de7-87b1-a0add1d81894 req-ad396a07-389f-4a6e-80d4-419cae1287df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077336 Aug 29 10:46:14.855760 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1397/2748] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:14.871903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:14.872928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:14.893652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:14.894562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:14.896553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:14.897532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:14.903148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:14.904049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:15.040288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:15.049242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a75d4710-f429-47b5-a636-30a9516543b7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1472 microversion: 2.1 time: 0.448622 Aug 29 10:46:15.050636 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1352/2749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:14 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:15.055586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b82607a1-9058-43df-b4f3-2e923e16d420 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c7002310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:15.307532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:15.322624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-29d7be4e-804a-4244-abb2-d70d265714b5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.449577 Aug 29 10:46:15.342551 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1398/2750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:14 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:15.347504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:15.348129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:15.379349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:15.383990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:15.384701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:15.386022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:15.386638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:15.387204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:15.832028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:15.843777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6cc0e0ca-f705-4be2-863c-78788fed7a3f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.498361 Aug 29 10:46:15.846479 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1399/2751] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:15 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:15.872227 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b82607a1-9058-43df-b4f3-2e923e16d420 tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/78416dc9-1382-4620-8497-f653ac7ffe63" status: 202 len: 0 microversion: 2.1 time: 0.819885 Aug 29 10:46:15.874587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1353/2752] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:15 2022] DELETE /compute/v2.1/os-security-groups/78416dc9-1382-4620-8497-f653ac7ffe63 => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:15.878789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:15.879907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d512281a-c3c8-4e4f-9456-79f27f035170 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66fd550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:15.880648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:15.894501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:15.896364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:15.897111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:15.898313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:15.899134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:15.899778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:15.962945 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d512281a-c3c8-4e4f-9456-79f27f035170 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1455 microversion: 2.1 time: 0.086889 Aug 29 10:46:15.975868 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1354/2753] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:15 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:15.988592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d08b8a2b-e546-45f6-b61e-44b4d27e0d7f tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c6e97af0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:16.051221 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-278e8fb1-875e-41a8-ba1b-5af2f541be63 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.199221 Aug 29 10:46:16.055211 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1400/2754] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:15 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:16.062874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:16.064550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:16.081766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.082522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.083120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.084397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.085027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.085614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.431101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d08b8a2b-e546-45f6-b61e-44b4d27e0d7f tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/402bdd90-a539-470a-91ee-593c85d1ac8d" status: 202 len: 0 microversion: 2.1 time: 0.460181 Aug 29 10:46:16.431776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1355/2755] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:15 2022] DELETE /compute/v2.1/os-security-groups/402bdd90-a539-470a-91ee-593c85d1ac8d => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:16.437516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:16.438436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:16.464539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:16.472364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:16.476533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.481267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.485545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.486007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00849f04-7d2f-4850-afa8-b7aa563e0676 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1511 microversion: 2.1 time: 0.428887 Aug 29 10:46:16.487197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1401/2756] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:16 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:16.494531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64b3f8a7-8b83-49d1-9e0d-161c2d06b74c tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] Calling method '.version_select at 0x7f66c65c8550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:16.499673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.500410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.504503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.754281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:16.764042 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a3d1230-8608-4aec-9572-3cb56b977cf2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 200 len: 1430 microversion: 2.1 time: 0.330296 Aug 29 10:46:16.777083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1356/2757] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:16 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 1430 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:16.866800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:16.867570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:16.882543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.883615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.884931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.886623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:16.887102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:16.887537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:16.965381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:17.214165 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64b3f8a7-8b83-49d1-9e0d-161c2d06b74c tempest-SecurityGroupRulesTestJSON-1455893256 tempest-SecurityGroupRulesTestJSON-1455893256-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/9786b3cf-42f7-4135-af1a-d1a9bfbb3300" status: 202 len: 0 microversion: 2.1 time: 0.725122 Aug 29 10:46:17.214752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1402/2758] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:16 2022] DELETE /compute/v2.1/os-security-groups/9786b3cf-42f7-4135-af1a-d1a9bfbb3300 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:17.223099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a08fd73-bd29-4768-9359-bbc1108f04e0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c63184c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:17.364837 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a08fd73-bd29-4768-9359-bbc1108f04e0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1464 microversion: 2.1 time: 0.148816 Aug 29 10:46:17.366274 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1403/2759] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:17 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:17.396046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b86aaa-6cee-4eb3-81a6-088381649e08", "name": "network-vif-deleted", "tag": "f6ed8e15-be80-4416-80d1-6aada775af1b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:17.436030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:17.442550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:17.444082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:17.487860 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] Creating event network-vif-deleted:f6ed8e15-be80-4416-80d1-6aada775af1b for instance 93b86aaa-6cee-4eb3-81a6-088381649e08 on n-h1-854121-10 Aug 29 10:46:17.499910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ddfc7f43-92bd-40c5-bb58-9f27cf3389b5 req-90b96413-25ac-4010-bbfc-ac2fdf5423d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132158 Aug 29 10:46:17.504224 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1404/2760] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:17.513101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5eb94093-d4f8-467c-8baf-04e15935cf29 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62a81f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:17.580850 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5eb94093-d4f8-467c-8baf-04e15935cf29 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 200 len: 1464 microversion: 2.1 time: 0.074919 Aug 29 10:46:17.581903 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1405/2761] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:17 2022] GET /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:17.590156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1439642516", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db70ecf5-8fd1-4a4e-acd4-79d8294a110e"}], "security_groups": [{"name": "tempest-securitygroup--235900264"}], "key_name": "tempest-keypair-1348994504", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:17.734386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:17.749668 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d019330f-59fd-4ca3-8628-f2dafff4736d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.887111 Aug 29 10:46:17.753757 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1357/2762] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:16 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:17.759852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:17.760761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:17.771447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:17.773256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:17.774606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:17.776138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:17.776815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:17.778799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:17.973662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] validate_networks() for [('db70ecf5-8fd1-4a4e-acd4-79d8294a110e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:46:18.266516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:18.300536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:18.312493 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c13d8196-48ea-4d34-902f-85450c2fbd7c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1491 microversion: 2.1 time: 0.557152 Aug 29 10:46:18.313448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1358/2763] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:17 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1491 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:18.319588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:18.320593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:18.330525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.331315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.332052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.333016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.334328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.335409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.795683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:18.803592 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4411758-0301-4317-85cc-efd4eb752fdd tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 1467 microversion: 2.1 time: 0.488596 Aug 29 10:46:18.804335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1359/2764] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:18 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 1467 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:18.809138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:18.809893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 93b86aaa-6cee-4eb3-81a6-088381649e08] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:18.817142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.817972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.818656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.819598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.820274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.821399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.826193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:18.836834 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 HTTP/1.1 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '93b86aaa-6cee-4eb3-81a6-088381649e08'} Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:18.838827 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. Aug 29 10:46:18.842588 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.844394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance 93b86aaa-6cee-4eb3-81a6-088381649e08 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:18.845489 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-45e075ce-3271-455e-8c7f-2c923b31b6a4 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08" status: 404 len: 111 microversion: 2.1 time: 0.039920 Aug 29 10:46:18.846298 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1360/2765] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:18 2022] GET /compute/v2.1/servers/93b86aaa-6cee-4eb3-81a6-088381649e08 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:18.851655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:18.852537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:18.859628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.860530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.861408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.862415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.863097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.863743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.902892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'pause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state paused Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 13 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: {"pause": {}} Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'pause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state paused Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'pause': {}}} Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state paused. Cannot pause while the instance is in this state. Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state paused Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:18.905380 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state paused Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'pause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state paused {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c10ea1d-d7d1-41f6-8e23-c969bdef21bc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 143 microversion: 2.1 time: 0.060342 Aug 29 10:46:18.910043 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1361/2766] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:18 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 143 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:46:18.917895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:18.918508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:18.935905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.936800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.937410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:18.939185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:18.940125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:18.940301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.092933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:46:19.093439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:46:19.096214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:46:19.096656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:46:19.097078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:46:19.112273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.112769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.113206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.114026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.114853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.115595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.138650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:46:19.150844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:46:19.180766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:46:19.183433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:46:19.231044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:19.242517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33af1c8d-6f49-4154-808c-d66d73a7f177 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.332635 Aug 29 10:46:19.243201 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1362/2767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:18 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:19.259714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7cc8616f-0ad0-4111-b4c3-f42a787428ad tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.675691 Aug 29 10:46:19.260372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1406/2768] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:46:19.271697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:19.272205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:19.285568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fa4102e-7304-44b8-a69c-6afb886853b7 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c64a5670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:19.294033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.294636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.295215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.295941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.296408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.296982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.377512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:19.574614 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c9027741-8189-4620-951b-f9fa92fa9929 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 204 len: 0 microversion: 2.1 time: 0.306467 Aug 29 10:46:19.579425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1407/2769] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:19 2022] DELETE /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:19.586523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:19.587489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:19.599530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.600233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.600794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.605091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.605665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.608503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.624706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fa4102e-7304-44b8-a69c-6afb886853b7 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?changes-since=2022-08-29T10%3A44%3A17Z" status: 200 len: 1902 microversion: 2.1 time: 0.348400 Aug 29 10:46:19.625980 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1363/2770] 10.222.0.47 () {58 vars in 1199 bytes} [Mon Aug 29 10:46:19 2022] GET /compute/v2.1/images?changes-since=2022-08-29T10%3A44%3A17Z => generated 1902 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:19.647557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-82a56ae0-3d27-4e31-923a-e03b06722b99 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:19.648665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-82a56ae0-3d27-4e31-923a-e03b06722b99 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:19.804979 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0ae0c62-819c-449a-b656-b985ee670d34 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.223591 Aug 29 10:46:19.806447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1408/2771] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:19 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:19.831169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:19.832162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:19.847871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.848876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.850082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.852122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:19.852960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:19.853623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:19.902505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-82a56ae0-3d27-4e31-923a-e03b06722b99 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:19.912249 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-82a56ae0-3d27-4e31-923a-e03b06722b99 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1242 microversion: 2.1 time: 0.284831 Aug 29 10:46:19.912838 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1364/2772] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:19 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:19.930961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f319b0cc-d25b-4709-91a1-48d54ea50fcb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c663f310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.078187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f319b0cc-d25b-4709-91a1-48d54ea50fcb tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1726825577" status: 200 len: 485 microversion: 2.1 time: 0.159415 Aug 29 10:46:20.079047 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1365/2773] 10.222.0.47 () {58 vars in 1231 bytes} [Mon Aug 29 10:46:19 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1726825577 => generated 485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:20.096606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.097229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:20.124785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.125230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.125673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.126407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.126869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.127291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.318744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:20.330151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d188cb7a-5cac-48da-9a69-e3fe1a0b3d3c tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1473 microversion: 2.1 time: 0.521997 Aug 29 10:46:20.341601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1409/2774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:19 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1473 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:20.376318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1c9717c-8958-4b50-8f3f-0a9e07d0999a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6258dc0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.544326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:20.550118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1c9717c-8958-4b50-8f3f-0a9e07d0999a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?server=32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 958 microversion: 2.1 time: 0.191608 Aug 29 10:46:20.557780 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74ce2c44-83c7-4eb1-b90b-430fb210129c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1498 microversion: 2.1 time: 0.464993 Aug 29 10:46:20.558649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1410/2775] 10.222.0.47 () {58 vars in 1209 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/images?server=32772407-795e-4019-a744-e129e43c0bf3 => generated 958 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:20.561356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1366/2776] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1498 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:20.581736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f67395-9c30-472c-86be-3c5eb7b82574", "name": "network-vif-plugged", "status": "completed", "tag": "2dc638cb-5d19-4737-b686-61c0bc12aff1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:20.583383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.588615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:20.607686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.616854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.619439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.620112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.622619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.623937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.628428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.630432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.631188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.672134 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] Creating event network-vif-plugged:2dc638cb-5d19-4737-b686-61c0bc12aff1 for instance 98f67395-9c30-472c-86be-3c5eb7b82574 on n-h2-854121-10 Aug 29 10:46:20.699588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-70ee68e3-f8b5-49bc-ac08-62b1a864766c req-32f64cc9-d3c8-4a85-a112-faa5136c2c77 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134264 Aug 29 10:46:20.700213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1367/2777] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:20.707637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29a0e026-52a3-43b9-99ee-91e207367963 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c7002790>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.825953 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29a0e026-52a3-43b9-99ee-91e207367963 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 484 microversion: 2.1 time: 0.122539 Aug 29 10:46:20.826849 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1368/2778] 10.222.0.47 () {58 vars in 1317 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068 => generated 484 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:20.850529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d139ff9-fbfc-49ce-914d-562820fca8d5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e369d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.942186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d139ff9-fbfc-49ce-914d-562820fca8d5 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 484 microversion: 2.1 time: 0.095999 Aug 29 10:46:20.943238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1369/2779] 10.222.0.47 () {58 vars in 1303 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068 => generated 484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:20.952388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:20.953156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:20.972325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.973344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.975554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:20.976733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:20.986745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:20.987353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:21.260301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:21.272588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4274c209-a75c-49de-8d2d-904b402ee7bd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1238 microversion: 2.1 time: 0.325542 Aug 29 10:46:21.274977 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1370/2780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1238 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:21.304290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4cb40a40-052a-4d91-8ba4-29c6336021df tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c663f430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:21.322225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:21.366852 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e6b76fe4-3c6b-4e81-bc4b-b022ac0da3c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.801346 Aug 29 10:46:21.368563 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1411/2781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:20 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:21.380045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:21.383966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:21.398093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:21.401868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:21.406988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:21.407940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:21.408596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:21.409188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:21.604587 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4cb40a40-052a-4d91-8ba4-29c6336021df tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.312206 Aug 29 10:46:21.617518 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1371/2782] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:46:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:21.623853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:21.624969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:21.635782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:21.638372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:21.639589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:21.640533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:21.641422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:21.642102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:21.960886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:21.986030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-76229f72-1696-4f5a-986d-514312ae85b8 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1473 microversion: 2.1 time: 0.604789 Aug 29 10:46:21.986976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1412/2783] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:21 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1473 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:21.994518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46bb492f-09af-49fc-8688-71a8cfc7389c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6300280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.089027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46bb492f-09af-49fc-8688-71a8cfc7389c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.098348 Aug 29 10:46:22.098818 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1413/2784] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:46:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:22.112858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b160dfd8-5de7-43cb-aac7-0c8673a9b557 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62685e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.287464 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b160dfd8-5de7-43cb-aac7-0c8673a9b557 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.178476 Aug 29 10:46:22.288860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1414/2785] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:46:22 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:22.298589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.299521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:22.307837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.308546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.308681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:22.309277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:22.311525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.313315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.313976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:22.319949 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a955a473-3f8f-4b16-b628-625fd0bf13fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.700963 Aug 29 10:46:22.321924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1372/2786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:21 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:22.330154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9463998-1e65-410b-8d1f-195310c817ac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c663f310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.455070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:22.461736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9463998-1e65-410b-8d1f-195310c817ac tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?changes-since=2022-08-29T10%3A44%3A09Z" status: 200 len: 6334 microversion: 2.1 time: 0.138476 Aug 29 10:46:22.465058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5c090883-d492-40b1-a864-8f294a1a6f0d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1300 microversion: 2.1 time: 0.172834 Aug 29 10:46:22.467517 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1415/2787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:22 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:22.475536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1373/2788] 10.222.0.47 () {58 vars in 1220 bytes} [Mon Aug 29 10:46:22 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-29T10%3A44%3A09Z => generated 6334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:22.476783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.477567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:22.491404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:22.492341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:22.496182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.497190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.497963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:22.499677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.500391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.501052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:22.501174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.501778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.502338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:22.503137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:22.503698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:22.504227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.163761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:23.176871 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-931021c6-dbe6-4341-8090-b411d0d89ba6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1314 microversion: 2.1 time: 0.696842 Aug 29 10:46:23.177535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1374/2789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:22 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:23.209563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87ed9596-29d7-4f32-90f8-18c5e1fc89c4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66fdaf0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:23.280528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87ed9596-29d7-4f32-90f8-18c5e1fc89c4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1726825577" status: 200 len: 665 microversion: 2.1 time: 0.079565 Aug 29 10:46:23.281126 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1375/2790] 10.222.0.47 () {58 vars in 1252 bytes} [Mon Aug 29 10:46:23 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1726825577 => generated 665 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:23.292050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}, {"server_uuid": "31ae26be-5b3e-4efd-b98c-afe870e6cf80", "name": "network-vif-unplugged", "status": "completed", "tag": "d3a9a770-c5a2-4991-a281-5d18327015fb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:23.321924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:23.340400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.343498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed6ff3a5-f4d2-401d-ab99-abe7d8b29c03 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.872911 Aug 29 10:46:23.344186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.345630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.365879 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1416/2791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:22 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:23.371777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ae26be-5b3e-4efd-b98c-afe870e6cf80", "name": "network-vif-deleted", "tag": "d3a9a770-c5a2-4991-a281-5d18327015fb"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:23.398114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.398878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.401242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.420587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:23.429817 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Creating event network-vif-unplugged:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:46:23.430550 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] Creating event network-vif-unplugged:d3a9a770-c5a2-4991-a281-5d18327015fb for instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 on n-h1-854121-10 Aug 29 10:46:23.431447 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] Creating event network-vif-deleted:d3a9a770-c5a2-4991-a281-5d18327015fb for instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 on n-h1-854121-10 Aug 29 10:46:23.448862 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-483d306d-c0d4-4015-b55b-5def63d2c1f3 req-d6542f28-b7fb-42f1-a9c5-73e9b236ed0c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.165004 Aug 29 10:46:23.450502 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1376/2792] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:23.465360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:23.466525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:23.467375 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f7e973b2-22b7-4eec-b30f-25a2c05459ae req-bbbed545-b5f1-4252-b854-f5e81a951c1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092655 Aug 29 10:46:23.468278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1417/2793] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:23.481974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.486576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6be72eaa-20ef-48d8-9b4d-d1b071c4e63a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6300310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:23.501437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.502178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.503088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.504198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.505161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.585161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.586045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.586045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.590204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lazy-loading 'fault' on Instance uuid 31ae26be-5b3e-4efd-b98c-afe870e6cf80 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:23.650289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6be72eaa-20ef-48d8-9b4d-d1b071c4e63a tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1466 microversion: 2.1 time: 0.170957 Aug 29 10:46:23.656038 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1418/2794] 10.222.0.47 () {58 vars in 1338 bytes} [Mon Aug 29 10:46:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1466 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:23.664508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:23.676003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:23.692200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.698931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.699912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.701141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.702567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.703235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.744861 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action HTTP/1.1 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 28 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: {"reboot": {"type": "SOFT"}} Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'de87605b-3cef-45a8-b1f0-ce3c0c3be2ee', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:23.746929 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:23.754440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:23.757521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:23.758679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-884a714f-6aeb-42ce-b6a3-fbbe22d4e5ff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action" status: 404 len: 111 microversion: 2.1 time: 0.101469 Aug 29 10:46:23.765693 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1419/2795] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:23 2022] POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:23.777334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:23.779784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:23.816103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.818512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.821108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.824895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:23.829604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:23.834655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:23.869590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:23.878640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53c6e22b-f8d9-48ce-98db-f27e773d7014 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 200 len: 1307 microversion: 2.1 time: 0.424580 Aug 29 10:46:23.882497 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1377/2796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:23 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:23.890618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f785afa-07d7-4703-ab61-baa287e60d33 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6e9c5e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:24.144265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:24.157523 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a025efe8-8739-4393-b3f1-af4bddf20459 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1300 microversion: 2.1 time: 0.389862 Aug 29 10:46:24.170158 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f785afa-07d7-4703-ab61-baa287e60d33 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1466 microversion: 2.1 time: 0.285810 Aug 29 10:46:24.171691 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1378/2797] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Aug 29 10:46:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1466 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:24.178010 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1420/2798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:23 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1300 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:24.182551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:24.183383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:24.204036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:24.208654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:24.209465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:24.210372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:24.221593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:24.222415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:24.392359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-826454217", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "e7bb2194-fb7d-43c4-ad2e-2214924e47cc"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:24.473048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:24.475854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] validate_networks() for [('e7bb2194-fb7d-43c4-ad2e-2214924e47cc', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:46:24.481951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1f9a791-3b95-4f20-8121-4a1233037c52 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.307205 Aug 29 10:46:24.482695 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1379/2799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:24 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:24.498954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-293e2bd5-979b-4370-8f5c-ac8e562f9be9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c66fd820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:24.785056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-293e2bd5-979b-4370-8f5c-ac8e562f9be9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.298502 Aug 29 10:46:24.823484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1380/2800] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:46:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:24.831027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:24.831927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:24.855172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:24.856300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:24.857649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:24.858765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:24.860278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:24.860950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:25.307054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:25.314812 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b143cd16-6996-46ed-8959-2c97b3112cf5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1500 microversion: 2.1 time: 0.489965 Aug 29 10:46:25.315645 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1381/2801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:24 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1500 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:25.320706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:25.321529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:25.328089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:25.329115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:25.330055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:25.331049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:25.331709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:25.332428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:25.525873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:46:25.527306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:46:25.534177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:46:25.534689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:46:25.536349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:46:25.556647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:25.557430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:25.561643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:25.562932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:25.564420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:25.566716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:25.623967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Getting quotas for project 50391e881280432787980aa5c4907d00. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:46:25.629851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Getting quotas for user 56fea7b97c5346198762a703f1c3d7e1 and project 50391e881280432787980aa5c4907d00. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:46:25.662065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:46:25.668267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:46:25.797659 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1a054023-b799-427e-bc88-a66440b85fba tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615931 Aug 29 10:46:25.798826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1421/2802] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:46:25.811536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf5d7a48-995c-40bb-9f21-4aac0088171f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6258790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:25.985130 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf5d7a48-995c-40bb-9f21-4aac0088171f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.184851 Aug 29 10:46:25.993766 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1422/2803] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:46:25 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:25.993766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:26.006638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 31ae26be-5b3e-4efd-b98c-afe870e6cf80] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:26.025632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.027532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.028173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.031133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.032085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.032541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.069262 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 HTTP/1.1 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '31ae26be-5b3e-4efd-b98c-afe870e6cf80'} Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:26.071167 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. Aug 29 10:46:26.075647 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.079663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance 31ae26be-5b3e-4efd-b98c-afe870e6cf80 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:26.083658 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad343fb7-c2e6-48c8-ad08-47c11308fb73 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80" status: 404 len: 111 microversion: 2.1 time: 0.094225 Aug 29 10:46:26.087472 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1423/2804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:25 2022] GET /compute/v2.1/servers/31ae26be-5b3e-4efd-b98c-afe870e6cf80 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:26.110114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:26.110992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:26.118282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.119417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.123681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.124668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.125339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.126051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.748423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:26.760194 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d92caf6-de95-4d3a-833e-fcf165270427 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 1.442342 Aug 29 10:46:26.763008 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1382/2805] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:25 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:26.775680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-91d637fd-3498-4a9e-8366-f32eeae813bd tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:26.780717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-91d637fd-3498-4a9e-8366-f32eeae813bd tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:26.844589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:26.857980 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9dfa81af-9752-4a84-8f77-1e4b2893b1ac tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.767809 Aug 29 10:46:26.859259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1424/2806] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:26 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:26.867812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91c8be60-b257-40ea-a142-068b5596171c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62585e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:26.908439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-91d637fd-3498-4a9e-8366-f32eeae813bd tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:26.915906 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-91d637fd-3498-4a9e-8366-f32eeae813bd tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1215 microversion: 2.1 time: 0.151212 Aug 29 10:46:26.916501 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1383/2807] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:26 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:26.931575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:26.932380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:26.941736 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91c8be60-b257-40ea-a142-068b5596171c tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde" status: 200 len: 784 microversion: 2.1 time: 0.080339 Aug 29 10:46:26.945175 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1425/2808] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 10:46:26 2022] GET /compute/v2.1/images/2f170d57-7e4d-481e-9b6b-0fb69678ffde => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:26.952280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.953334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.955379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.957252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:26.963526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:26.968287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: e81eb33e-4990-414f-8a0d-6398d7fb0d10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:26.979868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:26.980606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:26.981490 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/e81eb33e-4990-414f-8a0d-6398d7fb0d10/action HTTP/1.1 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 28 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: {"reboot": {"type": "SOFT"}} Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e81eb33e-4990-414f-8a0d-6398d7fb0d10', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. Aug 29 10:46:26.985169 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. Aug 29 10:46:26.990942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:26.994823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance e81eb33e-4990-414f-8a0d-6398d7fb0d10 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:26.996913 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56594032-2e0c-44dd-8911-618cd1b2fbf4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/e81eb33e-4990-414f-8a0d-6398d7fb0d10/action" status: 404 len: 111 microversion: 2.1 time: 0.050849 Aug 29 10:46:26.998781 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1426/2809] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:26 2022] POST /compute/v2.1/servers/e81eb33e-4990-414f-8a0d-6398d7fb0d10/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:27.008950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-facc09d3-0931-4d66-80f6-9b56bc5530bc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6284550>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:27.104581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:27.109233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-facc09d3-0931-4d66-80f6-9b56bc5530bc tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.109228 Aug 29 10:46:27.110052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1427/2810] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:46:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:27.128438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:27.132084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:27.141794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:27.163390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:27.164338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:27.164338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:27.165043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:27.176166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:27.179327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:27.302333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7feb4e6d-198f-468d-b1f0-c0e1d332338d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f" status: 204 len: 0 microversion: 2.1 time: 0.384170 Aug 29 10:46:27.303491 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1384/2811] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:26 2022] DELETE /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:27.310535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50e2ebf4-982c-423c-a4bb-454791f08c8f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c648ee50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:28.030687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:28.046172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e35c2a9-df68-4bfe-9304-631f94828523 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.932544 Aug 29 10:46:28.047500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1428/2812] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:27 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:28.065349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e84f4fb-ead3-47cf-82d1-48637080f1ff", "tag": "a359ca53-7be2-4e90-b120-a61430700f9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:28.087981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.089120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.092260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.111352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] Creating event network-changed:a359ca53-7be2-4e90-b120-a61430700f9b for instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff on n-h1-854121-10 Aug 29 10:46:28.116558 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ce27c035-0630-4d7d-8c5d-6c0947bd4082 req-794aee0b-af3f-4a66-8ad3-4540b02fe644 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067475 Aug 29 10:46:28.117333 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1429/2813] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:28.125093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:28.132726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:28.153048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.153647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.154736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.155459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.155914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.156342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.237820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:28.408369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd398dc9-0210-4fd8-a1e2-5b69a66e1c63 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 204 len: 0 microversion: 2.1 time: 0.276754 Aug 29 10:46:28.414285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1430/2814] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:28 2022] DELETE /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:28.421536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:28.422559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:28.431344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.431813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.433246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.434017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.434485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.434911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.578413 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50e2ebf4-982c-423c-a4bb-454791f08c8f tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f" status: 204 len: 0 microversion: 2.1 time: 1.273462 Aug 29 10:46:28.579322 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1385/2815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:27 2022] DELETE /compute/v2.1/images/03f393e6-7bf1-40d1-8693-bdecf9f9431f => generated 0 bytes in 1275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:28.589507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:28.590275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:28.613649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.616047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.618670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.621529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.622333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.626101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.751897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:28.760226 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f0f408d-c166-4bcb-805e-ddc13896916f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.344096 Aug 29 10:46:28.760808 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1431/2816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:28 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:28.768557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:28.770812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:28.776558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:28.785308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.786110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.787243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96f07b11-a4f3-4f73-b1bc-de54cd667ca5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1267 microversion: 2.1 time: 0.206844 Aug 29 10:46:28.787886 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1386/2817] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:28 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:28.788649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.789618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.790353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.791215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.793069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef920921-01ff-4d96-860a-4c7af32e1646"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:28.797294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:28.805823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.807071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.807726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:28.808675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:28.809312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:28.810784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.117555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:29.127243 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32872bf0-7751-4703-9af3-b182f766bcd1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.364042 Aug 29 10:46:29.127946 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1432/2818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:28 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:29.147624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:29.148913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:29.168101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.171089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.172483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.173637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.174355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.175075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.339477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:29.360881 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9dab115d-e502-4fdc-88a6-a1cbb068a2fb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571232 Aug 29 10:46:29.362736 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1387/2819] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:46:28 2022] POST /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:29.389455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4037c70d-d267-4fab-acb6-d96dd577f202 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c663f0d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:29.796861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:29.810849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac5011cd-4f74-4335-ada4-8011a56c1a56 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f" status: 200 len: 1475 microversion: 2.1 time: 0.681623 Aug 29 10:46:29.828599 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1433/2820] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:29 2022] GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f => generated 1475 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:29.846748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:29.856699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:29.878345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.878801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.883535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.908112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.908847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.909307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.932424 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action HTTP/1.1 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 65 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'de87605b-3cef-45a8-b1f0-ce3c0c3be2ee', 'body': {'rebuild': {'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde'}}} Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 10:46:29.935954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:46:29.940776 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:29.944202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:29.945232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c58221c8-308e-4454-bfd7-16a67ac5fe8d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action" status: 404 len: 111 microversion: 2.1 time: 0.115324 Aug 29 10:46:29.946991 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1434/2821] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:29 2022] POST /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee/action => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:29.952936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:29.954648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:29.963349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.965779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.967040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:29.968144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:29.969011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:29.969662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:30.268555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:30.282597 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56de37d9-a6e6-4e2e-986a-0f6c8562f753 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.334326 Aug 29 10:46:30.297896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1435/2822] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:29 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:30.304714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:30.305690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:30.319441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:30.320400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:30.320944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:30.321791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:30.322513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:30.323099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:30.579506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4037c70d-d267-4fab-acb6-d96dd577f202 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd" status: 204 len: 0 microversion: 2.1 time: 1.214638 Aug 29 10:46:30.580410 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1388/2823] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:29 2022] DELETE /compute/v2.1/images/029a99fb-7713-4333-852c-fba77d870cbd => generated 0 bytes in 1217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:30.586216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:30.587075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:30.605410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:30.606815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:30.609169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:30.610059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:30.610525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:30.613434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:31.175247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:31.183041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:31.189630 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1a9a3b3-c54d-4eca-a6d9-f20eb4a7906e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.607944 Aug 29 10:46:31.202408 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6dcd6716-3fbe-46a8-8a81-e8fd912df3b6 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.911862 Aug 29 10:46:31.204772 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1389/2824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:30 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:31.205300 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1436/2825] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:30 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:31.209646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d9f98c-962c-4329-b37a-ffc99828ed5f", "name": "network-vif-deleted", "tag": "40ff8956-3d8e-4789-bc62-b416db7c2a2e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:31.225667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1e299f8-88df-43f7-8011-a5a8a41c90ff tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62a8940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:31.242385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:31.243288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:31.243962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:31.270017 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] Creating event network-vif-deleted:40ff8956-3d8e-4789-bc62-b416db7c2a2e for instance a0d9f98c-962c-4329-b37a-ffc99828ed5f on n-h2-854121-10 Aug 29 10:46:31.283952 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dd16b6d7-cfa5-4611-b913-ecda51a64151 req-eebe8e74-6de3-40a3-addb-c67fada43332 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077805 Aug 29 10:46:31.284792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1390/2826] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:31.296438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:31.299539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: a0d9f98c-962c-4329-b37a-ffc99828ed5f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:31.316217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:31.316715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:31.317162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:31.317907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:31.318361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:31.318790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:31.354332 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f HTTP/1.1 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a0d9f98c-962c-4329-b37a-ffc99828ed5f'} Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:31.356038 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. Aug 29 10:46:31.360425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:31.364368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance a0d9f98c-962c-4329-b37a-ffc99828ed5f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:31.368059 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf68d3f2-aa95-49ae-9cb1-133cf485456e tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f" status: 404 len: 111 microversion: 2.1 time: 0.081902 Aug 29 10:46:31.369243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1391/2827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:31 2022] GET /compute/v2.1/servers/a0d9f98c-962c-4329-b37a-ffc99828ed5f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:31.382737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:31.383652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:31.399099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:31.399800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:31.400427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:31.401356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:31.402028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:31.402645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.052729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:32.065478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1fde2ceb-9daa-4f9f-aad5-7a46002339fe tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.692788 Aug 29 10:46:32.088962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1392/2828] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:31 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:32.109419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:32.112538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.129276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.130843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.131527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.136105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.139648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.140466 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1e299f8-88df-43f7-8011-a5a8a41c90ff tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c" status: 204 len: 0 microversion: 2.1 time: 0.932543 Aug 29 10:46:32.140934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.141026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1437/2829] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:31 2022] DELETE /compute/v2.1/images/088543f8-10e2-46dc-b94c-545ed9bf084c => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:32.147193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:32.148310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.163812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.164326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.167040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.167837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.170672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.171144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.407493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:32.411269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:32.418784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5721382c-c174-4354-9098-6aaf97927d81 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 200 len: 1432 microversion: 2.1 time: 0.276314 Aug 29 10:46:32.421120 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1438/2830] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:32 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 1432 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:32.445025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8e6679d-31f9-4531-8832-06d0c1ae9145 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.351543 Aug 29 10:46:32.445993 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1393/2831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:32 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:32.454098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:32.461643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: daad7665-9e4a-47c7-bd8c-f0eea07994ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.463303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:32.478888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. Aug 29 10:46:32.479878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/daad7665-9e4a-47c7-bd8c-f0eea07994ce/action HTTP/1.1 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 65 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'daad7665-9e4a-47c7-bd8c-f0eea07994ce', 'body': {'rebuild': {'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde'}}} Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:32.483602 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. Aug 29 10:46:32.487721 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:32.493594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance daad7665-9e4a-47c7-bd8c-f0eea07994ce could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:32.494852 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-638bf2b8-3970-4771-a756-c54b50b79493 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/daad7665-9e4a-47c7-bd8c-f0eea07994ce/action" status: 404 len: 111 microversion: 2.1 time: 0.056789 Aug 29 10:46:32.498766 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1439/2832] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:32 2022] POST /compute/v2.1/servers/daad7665-9e4a-47c7-bd8c-f0eea07994ce/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:32.506591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.508650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.509458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.513896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edfacb93-70d5-4012-bc30-d523d4f9ad17", "tag": "56809eaa-f72b-4b4c-a2ab-ed766b469f41"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:32.515486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.520060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.520897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.573482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.574009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.574452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.609840 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] Creating event network-changed:56809eaa-f72b-4b4c-a2ab-ed766b469f41 for instance edfacb93-70d5-4012-bc30-d523d4f9ad17 on n-h2-854121-10 Aug 29 10:46:32.616418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:32.620547 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7828d608-7001-4ce3-af2e-89a7024bd972 req-4730bdfe-0141-47c5-9937-9075e255edb4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117935 Aug 29 10:46:32.624986 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1440/2833] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:32.633856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:32.640090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.660940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.662035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.665691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.666662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.668797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.669440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.851197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ab3139d-2a1c-4c07-84f0-4399d907a9b4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 204 len: 0 microversion: 2.1 time: 0.402531 Aug 29 10:46:32.854906 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1394/2834] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:32 2022] DELETE /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:32.869493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:32.885612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:32.908057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.908575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.909026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:32.910220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:32.911750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:32.912196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.551688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:33.570676 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a325fe4d-c1b6-407c-bbdc-31f1995a1bc7 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.943550 Aug 29 10:46:33.572413 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1441/2835] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:32 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:33.580178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:33.581006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:33.600909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.601432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.601907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.602775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.603244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.603668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.720982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:33.739625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-13f981e7-d8c9-4783-9bbb-631f47b63f1a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.882594 Aug 29 10:46:33.740360 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1395/2836] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:33.750003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:33.753225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:33.761894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.763031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.763756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.764737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.765687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.766398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.784908 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f HTTP/1.1 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9c538ce3-5bf5-4b58-ae7c-1da21b710e1f'} Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:33.787337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:33.792047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:33.793386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb3165a4-9ded-4120-b2bc-375228071b67 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f" status: 404 len: 111 microversion: 2.1 time: 0.048038 Aug 29 10:46:33.794511 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1396/2837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:33 2022] GET /compute/v2.1/servers/9c538ce3-5bf5-4b58-ae7c-1da21b710e1f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:33.800030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:33.801093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:33.807698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.808313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.809018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.816971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:33.817860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:33.818688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:33.966199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:33.975729 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eadd8afe-64c8-46d0-bc88-92972ad23ba0 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1474 microversion: 2.1 time: 0.401955 Aug 29 10:46:33.991648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1442/2838] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:33 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1474 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:33.999973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.001208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.009369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.010166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.011038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.012041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.012653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.014406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.067905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:34.082064 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba30b6ef-7419-4a7e-9095-3b5d1a6b657e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.285800 Aug 29 10:46:34.083258 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1397/2839] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:33 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:34.088861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23a3f3e0-1b63-4726-8ff4-7dd09302e9ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.135994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23a3f3e0-1b63-4726-8ff4-7dd09302e9ac tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/d3d93d67-1f7b-49c2-b1b5-b68dff202be2" status: 204 len: 0 microversion: 2.1 time: 0.051390 Aug 29 10:46:34.137131 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1398/2840] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:46:34 2022] DELETE /compute/v2.1/os-server-groups/d3d93d67-1f7b-49c2-b1b5-b68dff202be2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:34.146941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.150002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.162034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.162809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.163714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.164726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.165610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.166825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.197352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:34.318230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89c82814-d8ad-47b1-ac7a-799de4fa2ae9 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 204 len: 0 microversion: 2.1 time: 0.176101 Aug 29 10:46:34.322305 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1399/2841] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:34 2022] DELETE /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:34.328138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.328722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.335484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.335767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.336131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.336827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.337277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.337718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.347342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:34.355093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:34.362882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a63b29f7-d2d8-49ff-bff0-b0b90d748a5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.364707 Aug 29 10:46:34.367001 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1443/2842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:33 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:34.390773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:34.391663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 8517e3db-f1c7-4653-9d5b-d618c4351501] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.406234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/8517e3db-f1c7-4653-9d5b-d618c4351501/action HTTP/1.1 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 15 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: {"restore": {}} Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8517e3db-f1c7-4653-9d5b-d618c4351501', 'body': {'restore': {}}} Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:34.409785 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:34.414273 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:34.414273 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:34.414273 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. Aug 29 10:46:34.414273 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:34.414631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 8517e3db-f1c7-4653-9d5b-d618c4351501 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:34.418367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:34.419369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f90f5cc3-3d42-4b95-948d-40b1517fa190 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/8517e3db-f1c7-4653-9d5b-d618c4351501/action" status: 404 len: 111 microversion: 2.1 time: 0.037154 Aug 29 10:46:34.421138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1444/2843] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:34 2022] POST /compute/v2.1/servers/8517e3db-f1c7-4653-9d5b-d618c4351501/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:46:34.431645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.432435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.444416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.445019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.446608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.447543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.449058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.449918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.502465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:34.516205 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8117a210-fadf-4e2f-b245-c6ba87853229 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 204 len: 0 microversion: 2.1 time: 0.192349 Aug 29 10:46:34.517118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1400/2844] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:34 2022] DELETE /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:34.525928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.526875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.540087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.540761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.541214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.542316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.542789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.543222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.802438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:34.827679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:34.836468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45a4b11f-515f-4702-a6b0-954744493835 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.394304 Aug 29 10:46:34.837242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-022ebfa2-b85b-4bac-926c-8ff6baa2c799 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1475 microversion: 2.1 time: 0.315958 Aug 29 10:46:34.838962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1401/2845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:34 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1475 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:34.840452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1445/2846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:34 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:34.843960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.844774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.851861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.852562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.853149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.854242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.854850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.855178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c538ce3-5bf5-4b58-ae7c-1da21b710e1f", "name": "network-vif-deleted", "tag": "1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:34.855623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.896457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.898095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.898559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.922904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] Creating event network-vif-deleted:1c1cf8d9-1b9e-48ac-b4d9-85603f4b11a6 for instance 9c538ce3-5bf5-4b58-ae7c-1da21b710e1f on n-h1-854121-10 Aug 29 10:46:34.929023 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8ae68ad4-0a19-4abe-87be-c38bd5b97c7e req-9f229e5d-18c0-4909-8646-aa68f27e8e1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086922 Aug 29 10:46:34.930218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1446/2847] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:34.937433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:34.939094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:34.946038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.946808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.947966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:34.948877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:34.949530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:34.950161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.161755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:35.173325 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d94b55b2-da72-465b-b89e-ed237b93fbbf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.333088 Aug 29 10:46:35.186686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1402/2848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:34 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:35.186686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:35.186686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:35.200976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.201468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.202324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.203247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.203868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.204713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.236625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:35.281900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:35.292431 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a959367f-8af1-4a80-a346-a73669655308 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.360815 Aug 29 10:46:35.313223 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1447/2849] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:34 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:35.324606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:35.328210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:35.349356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.349947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.350395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.352377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.353023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.353622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.595074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:35.647700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:35.687157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:35.699384 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f97808d-d680-4320-8983-ccbb89f999a6 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1474 microversion: 2.1 time: 0.522332 Aug 29 10:46:35.699985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1403/2850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:35 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1474 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:35.714388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:35.714934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:35.726043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.726300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.726681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.727396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.727854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.728280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.787213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'restore' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: {"restore": {}} Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'restore' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'restore': {}}} Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state active. Cannot restore while the instance is in this state. Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:35.789434 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:35.794187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'restore' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:35.798448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76caec2c-3cb0-4d83-ada2-72e61cb27cdc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 145 microversion: 2.1 time: 0.092834 Aug 29 10:46:35.798448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1404/2851] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:35 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:46:35.802886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:35.806653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:35.807409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:35.811956 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2515bb24-e967-4f02-8f32-969238737dce tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.495709 Aug 29 10:46:35.824879 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1448/2852] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:35 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.825125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.874637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:35.875267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:35.885282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.885805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.892670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:35.893637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:35.894330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:35.894937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.319407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:36.329194 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7edf9ca7-133e-43c6-b37f-e92b8c35ca3a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.526582 Aug 29 10:46:36.332213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1405/2853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:35 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:36.342996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:36.346319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:36.360512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:36.361796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:36.362259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.364217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:36.365732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:36.366189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.586787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:36.602189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-615f97bf-c794-4145-a75b-08c28f79aab1 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1475 microversion: 2.1 time: 0.726870 Aug 29 10:46:36.602926 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1449/2854] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:35 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1475 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:36.612941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e84f4fb-ead3-47cf-82d1-48637080f1ff", "name": "network-vif-plugged", "status": "completed", "tag": "a359ca53-7be2-4e90-b120-a61430700f9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:36.638107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:36.652349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:36.653866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.673292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] Creating event network-vif-plugged:a359ca53-7be2-4e90-b120-a61430700f9b for instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff on n-h1-854121-10 Aug 29 10:46:36.679010 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7ef1d1f6-1ffa-4739-a9c9-0788f9aa3d00 req-de4095c6-28c9-4e40-9aa5-04a5c68d963c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074508 Aug 29 10:46:36.680072 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1450/2855] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:36.686076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:36.687169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:36.696875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:36.697606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:36.698257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.699624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:36.700270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:36.700961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:36.912887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:37.128495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:37.141506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce9bd375-598a-4f22-ae99-5a4e8c512ee2 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.806511 Aug 29 10:46:37.151810 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1406/2856] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:36 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:37.151810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:37.151810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:37.168922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.170659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.171233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.172079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.172651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.173197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.453615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:37.477059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:37.488967 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3066ebd-44ed-4372-a5fe-3d5bc65287b2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.807362 Aug 29 10:46:37.492439 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1451/2857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:36 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:37.505652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:37.506304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:37.507772 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14bae1d4-26dc-4526-bbc9-fb4e08c8281d tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1432 microversion: 2.1 time: 0.363894 Aug 29 10:46:37.510944 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1407/2858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:37 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1432 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:37.518609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.519315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.519916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.520571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089c491c-4d5b-46f0-841b-f04a161b9068", "name": "network-vif-deleted", "tag": "043cc140-449c-47a1-b030-fdd429a26e32"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:37.520973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.521581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.524825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.540435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.541285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.541996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.565474 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] Creating event network-vif-deleted:043cc140-449c-47a1-b030-fdd429a26e32 for instance 089c491c-4d5b-46f0-841b-f04a161b9068 on n-h2-854121-10 Aug 29 10:46:37.572942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-952cc202-2bb2-4eae-8e55-d45849982539 req-45f45e53-a6d2-4c4e-8f39-35f2531172ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060385 Aug 29 10:46:37.600135 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1408/2859] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:37.608591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:37.618312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:37.643193 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/7ac067e5-2d52-44f7-b1b3-8f35460b1ba4/action HTTP/1.1 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 14 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: {"resume": {}} Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7ac067e5-2d52-44f7-b1b3-8f35460b1ba4', 'body': {'resume': {}}} Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:37.650281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:37.656302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:37.656302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:37.656302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. Aug 29 10:46:37.656302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:37.657593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 7ac067e5-2d52-44f7-b1b3-8f35460b1ba4 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:37.658692 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1f63168-dbf9-4604-81f4-63b96f66de8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/7ac067e5-2d52-44f7-b1b3-8f35460b1ba4/action" status: 404 len: 111 microversion: 2.1 time: 0.057244 Aug 29 10:46:37.659820 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1409/2860] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:37 2022] POST /compute/v2.1/servers/7ac067e5-2d52-44f7-b1b3-8f35460b1ba4/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:37.669235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:37.671231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:37.694756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.698327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.698978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.699889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:37.700516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:37.701233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:37.999277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:38.010994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16ae79e1-9cb8-43d1-80e6-48004d420216 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1367 microversion: 2.1 time: 0.514755 Aug 29 10:46:38.012007 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1452/2861] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:37 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:38.017074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:38.017861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:38.041164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.041904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.042485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.043937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.044627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.046012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.136573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:38.150749 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a8662b10-34c2-4b55-91e9-71750f1a89b3 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1475 microversion: 2.1 time: 0.489372 Aug 29 10:46:38.151811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1410/2862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:37 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:38.194146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:38.197379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:38.219284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.219837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.220325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.221281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.222008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.222810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.469954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:38.490246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53b6855d-ce32-43df-8337-60efd5d08ad2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.474930 Aug 29 10:46:38.511285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1453/2863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:38 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:38.521937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b415ddf9-7fc5-48dd-af90-1de9fa32c200", "name": "network-vif-deleted", "tag": "240718b5-03c6-4744-a898-e106aec650d7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:38.553720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.555539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.555539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.584749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] Creating event network-vif-deleted:240718b5-03c6-4744-a898-e106aec650d7 for instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 on n-h1-854121-10 Aug 29 10:46:38.604696 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-143127ee-edbb-41bc-87f9-2de2aa27d5b9 req-1a3fe2fb-28af-4b9d-be53-06232e9d8993 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092083 Aug 29 10:46:38.605339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:38.606480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1454/2864] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:38.620680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:38.621745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:38.623642 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-313668cf-8857-4a7f-b8c1-718272269b60 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.450217 Aug 29 10:46:38.627369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1411/2865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:38 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:38.637242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.637505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:38.638281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:38.639245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.639905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.640627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.641087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.641689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.649135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.650194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.650967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.651902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.652638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.653395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.707592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:38.708427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:38.709294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:38.710032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lazy-loading 'fault' on Instance uuid 089c491c-4d5b-46f0-841b-f04a161b9068 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:38.807282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:38.817498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7387a06d-aae6-4847-978d-73fc8a1d8123 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 200 len: 1308 microversion: 2.1 time: 0.188435 Aug 29 10:46:38.827719 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1412/2866] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:38 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:38.992523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:39.001118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f8c8b15-e738-4aec-82c0-7e02184c5d60 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.391596 Aug 29 10:46:39.006092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1455/2867] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:38 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:39.021316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:39.022119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.033106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.035574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.036100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.036892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.039860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:39.040224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.040744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.042732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.054882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.055294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.058193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.058939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.059542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.061215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.073485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'resume' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 14 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: {"resume": {}} Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'resume' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'resume': {}}} Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state active. Cannot resume while the instance is in this state. Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:39.075189 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'resume' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:39.081541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b02526f-5781-44f2-bdd2-c04530b78b43 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 144 microversion: 2.1 time: 0.063040 Aug 29 10:46:39.082844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1413/2868] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:39 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:46:39.091382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:39.092612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.099702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.100337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.100901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.101762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.102358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.103689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.520669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:39.547835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0fd87ac-0a1a-4212-8156-74d48005ad2b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.460601 Aug 29 10:46:39.548420 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1414/2869] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:39 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:39.554929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:39.555590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.571272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:39.601625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7bd547b3-1757-4270-a344-cae00201c8e1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1557 microversion: 2.1 time: 0.573342 Aug 29 10:46:39.603502 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1456/2870] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:39 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1557 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:39.612116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.616214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:39.617174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.617628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.618396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.618852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.619570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.625960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.657779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.658974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.661155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.663328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.664027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.664924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.719189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.719868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.723383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.724197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lazy-loading 'fault' on Instance uuid 7f4059b0-58e5-40ba-babf-443bc0659909 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:39.866579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:39.875000 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c006cff6-8836-4708-ac22-2f33c1a0fd3d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 200 len: 1309 microversion: 2.1 time: 0.323726 Aug 29 10:46:39.876195 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1415/2871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:39 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 1309 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:39.893410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:39.893996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:39.915992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.916487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.916928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.917631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:39.919500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:39.922316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:39.995563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:40.010267 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb422f3d-138f-4e26-8d8d-87586ad5fe06 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.404861 Aug 29 10:46:40.022194 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1457/2872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:39 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:40.028108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:40.028967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:40.035806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.036589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.037075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.037924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.038862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.038862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.050632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-956cb197-a117-4ad1-adfb-6bfaf7b750e7 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171957 Aug 29 10:46:40.051306 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1416/2873] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:46:39 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:40.064917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4059b0-58e5-40ba-babf-443bc0659909", "name": "network-vif-deleted", "tag": "e9105456-8e3a-4917-884a-68fa1f352f2e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:40.078696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.079872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.080667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.093940 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] Creating event network-vif-deleted:e9105456-8e3a-4917-884a-68fa1f352f2e for instance 7f4059b0-58e5-40ba-babf-443bc0659909 on n-h1-854121-10 Aug 29 10:46:40.099440 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c4957620-e2bc-4321-a57e-aa063851615f req-95e129da-138c-4ce3-a457-434ed0c1117c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046568 Aug 29 10:46:40.100882 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1417/2874] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:40.108411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:40.109412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 089c491c-4d5b-46f0-841b-f04a161b9068] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:40.116466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.117271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.117943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.118817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.119436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.120282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.139585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] HTTP exception thrown: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Request method failure captured: Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 HTTP/1.1 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhvQADyoOdMmLNir2H0fSOwOOQcOZEOI_xl5t8hA-gIRPqanj6CeqoYr4R0gX3iJfwJCkx-pjSgpvS_W3R98v6qr_ukrVM31VUIaoPrp-RgDL95GE6STFljmuqmNiOTWHYDYT9MiI4AEMIONKc_aW0-X0Gx_hpVF56PkvtzrXVC9iI Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: afb1017f343248ea8ad41f19db4c7ff0 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: afb1017f343248ea8ad41f19db4c7ff0 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListImageFiltersTestJSON-1544591452-project Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 636c452bd5494aabba7727f21c317a53 Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListImageFiltersTestJSON-1544591452-project Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '089c491c-4d5b-46f0-841b-f04a161b9068'} Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:40.142190 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Returning 404 to user: Instance 089c491c-4d5b-46f0-841b-f04a161b9068 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4756308e-4b5f-4a42-b6f4-fdc23207b881 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068" status: 404 len: 111 microversion: 2.1 time: 0.041180 Aug 29 10:46:40.149335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1418/2875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:40 2022] GET /compute/v2.1/servers/089c491c-4d5b-46f0-841b-f04a161b9068 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:40.301462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7050af86-20b8-460d-a6ec-c7d4ab046015 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c64a5790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-556964578", "description": "tempest-description-173118029"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:40.678896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:40.690400 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-795d0a6e-e6df-4e96-887a-60903d2a7d04 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.666718 Aug 29 10:46:40.691202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1458/2876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:40 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:40.701958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6540904-f5e4-4049-b535-3ac61287a0e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6540904-f5e4-4049-b535-3ac61287a0e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 160 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "96920ae8-fae5-466a-acdc-c8ef40245e0b"}]}} Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': '', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'networks': [{'uuid': '96920ae8-fae5-466a-acdc-c8ef40245e0b'}]}}} Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '' Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:46:40.706640 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6540904-f5e4-4049-b535-3ac61287a0e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f6540904-f5e4-4049-b535-3ac61287a0e9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015861 Aug 29 10:46:40.711417 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1459/2877] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:40.716298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:40.718068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:40.725154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.725481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.725947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.726908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.727315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.727788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.763842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:40.846041 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d03dc0bd-2aa9-4651-93ce-5f43f5f5c0a1 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 204 len: 0 microversion: 2.1 time: 0.132950 Aug 29 10:46:40.846925 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1460/2878] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:40 2022] DELETE /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:40.853324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edfacb93-70d5-4012-bc30-d523d4f9ad17", "name": "network-vif-plugged", "status": "completed", "tag": "56809eaa-f72b-4b4c-a2ab-ed766b469f41"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:40.864100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.864584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.865018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.876728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] Creating event network-vif-plugged:56809eaa-f72b-4b4c-a2ab-ed766b469f41 for instance edfacb93-70d5-4012-bc30-d523d4f9ad17 on n-h2-854121-10 Aug 29 10:46:40.881637 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fa750f67-1a42-4e2c-b7cf-67d4c987b41e req-2dbd3db9-cdae-4894-bafa-3acbe6a4fbd6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Aug 29 10:46:40.882473 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1461/2879] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:40.888135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:40.889328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:40.898320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.899174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.899808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.900744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.902342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.902833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.929023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7050af86-20b8-460d-a6ec-c7d4ab046015 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.783480 Aug 29 10:46:40.939257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1419/2880] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:46:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:40.944289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:40.945106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:40.952806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.953499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.953966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:40.955131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:40.955748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:40.956337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.198519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:41.207258 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6129e910-b241-48d8-8c7d-68a717c931ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.323649 Aug 29 10:46:41.207835 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1462/2881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:40 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:41.212502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.213115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: 7f4059b0-58e5-40ba-babf-443bc0659909] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.222245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.224052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.224504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.225221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.225681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.226136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.242555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 HTTP/1.1 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7f4059b0-58e5-40ba-babf-443bc0659909'} Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.244269 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance 7f4059b0-58e5-40ba-babf-443bc0659909 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96e10bdf-f5fa-4b40-8ff7-677081c20279 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909" status: 404 len: 111 microversion: 2.1 time: 0.036771 Aug 29 10:46:41.248801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1463/2882] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:41 2022] GET /compute/v2.1/servers/7f4059b0-58e5-40ba-babf-443bc0659909 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:41.255494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f5d9d7c-a5c0-4cbe-a9c9-b1480e36e1ad tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c6284040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-397114367", "description": "tempest-description-316779038"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:41.285375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:41.293176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d9991622-1e20-4ebe-9d10-484e8f16f226 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 1473 microversion: 2.1 time: 0.352620 Aug 29 10:46:41.293774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1420/2883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:40 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:41.298940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.299840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.305989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.306479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.307174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.307947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.308481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.309009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.616023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:41.628898 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b347a7a0-abbb-4806-b3c9-b74aa7ac5565 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.333641 Aug 29 10:46:41.630435 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1421/2884] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:41 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:41.636857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.639249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: b415ddf9-7fc5-48dd-af90-1de9fa32c200] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.649224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.650862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.652375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.653524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.655567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.656303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.665878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f5d9d7c-a5c0-4cbe-a9c9-b1480e36e1ad tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.414182 Aug 29 10:46:41.666478 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1464/2885] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:46:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:41.671897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:41.672642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 72e865a2-e175-4d11-b27b-c9f1eb5e1933] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.683147 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 HTTP/1.1 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b415ddf9-7fc5-48dd-af90-1de9fa32c200'} Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.687935 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. Aug 29 10:46:41.691890 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.692319 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. Aug 29 10:46:41.696576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance b415ddf9-7fc5-48dd-af90-1de9fa32c200 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:41.696576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65ac7e7b-1bce-41fa-8aa0-a8a351d3110d tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200" status: 404 len: 111 microversion: 2.1 time: 0.059165 Aug 29 10:46:41.696576 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1422/2886] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:41 2022] GET /compute/v2.1/servers/b415ddf9-7fc5-48dd-af90-1de9fa32c200 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/72e865a2-e175-4d11-b27b-c9f1eb5e1933/action HTTP/1.1 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 14 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: {"shelve": {}} Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '72e865a2-e175-4d11-b27b-c9f1eb5e1933', 'body': {'shelve': {}}} Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:41.697656 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 72e865a2-e175-4d11-b27b-c9f1eb5e1933 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c28f1a06-9e48-483d-8df9-1d57870acfa4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/72e865a2-e175-4d11-b27b-c9f1eb5e1933/action" status: 404 len: 111 microversion: 2.1 time: 0.027894 Aug 29 10:46:41.703630 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1465/2887] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:41 2022] POST /compute/v2.1/servers/72e865a2-e175-4d11-b27b-c9f1eb5e1933/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:41.710886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7647dd52-eada-443c-ad66-e7075da8d8d7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.720099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.723512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.734535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.735302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.735933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.736835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.737483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.738388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.743313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:41.768871 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7647dd52-eada-443c-ad66-e7075da8d8d7 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/1f419406-5edc-4369-a31c-ce1bac533a3c" status: 204 len: 0 microversion: 2.1 time: 0.059985 Aug 29 10:46:41.770082 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1423/2888] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:46:41 2022] DELETE /compute/v2.1/os-server-groups/1f419406-5edc-4369-a31c-ce1bac533a3c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:41.781616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:41.784960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:41.796391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.797136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.798120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:41.799270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:41.799998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:41.800780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.018418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:42.027694 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8cdbb517-d6f8-42b4-8de8-7f4fca1302ee tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.315371 Aug 29 10:46:42.028457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1466/2889] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:41 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:42.048224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1452320341", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "70ed7617-900e-4d5b-b726-85c5318898ee"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:42.095992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:42.132223 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8646e22-9b93-40ff-904d-446af06bd8ea tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1315 microversion: 2.1 time: 0.360030 Aug 29 10:46:42.134478 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1424/2890] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:41 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:42.148781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:42.156266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:42.168260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.168761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.169383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.170077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.170543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.170975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.172138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] validate_networks() for [('70ed7617-900e-4d5b-b726-85c5318898ee', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:46:42.204510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:42.221397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:42.307724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-259606f6-e107-4416-b808-c9ac32cc903b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 204 len: 0 microversion: 2.1 time: 0.169929 Aug 29 10:46:42.308285 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1425/2891] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:42 2022] DELETE /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:42.317818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:42.318668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:42.336320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.336819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.337259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.338011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.346487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.348758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.559804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:42.571897 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-411b8c2a-d651-4f98-817a-a7f388827ab4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.259230 Aug 29 10:46:42.586942 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1426/2892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:42 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:42.593759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e84f4fb-ead3-47cf-82d1-48637080f1ff", "tag": "a359ca53-7be2-4e90-b120-a61430700f9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:42.604205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.604740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.605178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.619277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] Creating event network-changed:a359ca53-7be2-4e90-b120-a61430700f9b for instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff on n-h1-854121-10 Aug 29 10:46:42.624837 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3385404c-057c-46d3-bac7-ba1c914abb55 req-87e0796b-c790-4f78-be4c-5c956c24be9d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036463 Aug 29 10:46:42.626177 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1427/2893] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:42.632027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:42.632847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:42.641104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.641916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.642058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:42.643021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:42.643479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:42.644008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.110911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636c452bd5494aabba7727f21c317a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1017f343248ea8ad41f19db4c7ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:43.122386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd80091f-a946-4271-ace0-5a7afc97cadf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 200 len: 1473 microversion: 2.1 time: 0.494448 Aug 29 10:46:43.137909 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1428/2894] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:42 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 1473 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:43.210035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:43.210714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:43.220030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:46:43.220560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:46:43.220932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:46:43.222129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:46:43.222595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:46:43.232959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.233488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.233959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.234705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.235161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.235588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.248821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.249564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.250207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.251155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.251804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.252552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.255261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Getting quotas for project 5b3af429e3ea43649e18c5124c6c7ca9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:46:43.261295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Getting quotas for user 6d2fe9f9e5bb4de980a20b42acf06483 and project 5b3af429e3ea43649e18c5124c6c7ca9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:46:43.285476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:46:43.290236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:46:43.368011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b49b5a4-22fd-4f74-9ff9-ff713f818e36 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324142 Aug 29 10:46:43.375307 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1467/2895] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:46:43.378990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:43.379564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:43.387529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:43.391819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.392527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.393593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.394533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.395170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.395909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.429934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lazy-loading 'flavor' on Instance uuid ba58c202-2540-4594-b2ae-878e488cfeee {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:43.618881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:43.644257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-122c4bcb-3d6f-426d-a2c6-136329d0def2 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1472 microversion: 2.1 time: 0.504605 Aug 29 10:46:43.644849 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1429/2896] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:43 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:43.692818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:43.693461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:43.724125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.735165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.735867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.736887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.737562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.738947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.744419 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-540da3cf-7ace-41a3-9b66-404b66444e35 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.373533 Aug 29 10:46:43.745869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1468/2897] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:43 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:46:43.772952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32772407-795e-4019-a744-e129e43c0bf3", "name": "network-vif-deleted", "tag": "84cc019e-3b67-4893-b5e6-9d31dc6c96e6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:43.791665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:43.792214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:43.792690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:43.830864 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] Creating event network-vif-deleted:84cc019e-3b67-4893-b5e6-9d31dc6c96e6 for instance 32772407-795e-4019-a744-e129e43c0bf3 on n-h1-854121-10 Aug 29 10:46:43.839823 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f9955ea8-efb7-4fbb-9770-4f6d2e0d2e87 req-6260a9ee-366b-4e7f-be89-d1968ed04146 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091019 Aug 29 10:46:43.840448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1469/2898] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:43.852248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24436d65-dded-458e-8596-d5e19573b606 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:43.853361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-24436d65-dded-458e-8596-d5e19573b606 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:44.123994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-24436d65-dded-458e-8596-d5e19573b606 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:44.147305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24436d65-dded-458e-8596-d5e19573b606 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1216 microversion: 2.1 time: 0.300141 Aug 29 10:46:44.149559 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1470/2899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:43 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1216 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:44.168151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:44.168834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:44.206100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.207042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.207755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.213873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.217349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.218283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.635761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:44.654821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c015809-ab7f-4c05-826e-0f283cdc218d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1502 microversion: 2.1 time: 0.971638 Aug 29 10:46:44.658066 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1430/2900] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:43 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1502 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:44.672231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:44.673465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] [instance: 32772407-795e-4019-a744-e129e43c0bf3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:44.693319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.696756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.697435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.698774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.700044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.705137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.742575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] HTTP exception thrown: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Request method failure captured: Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 HTTP/1.1 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhvQADyoOdMmLNir2H0fSOwOOQcOZEOI_xl5t8hA-gIRPqanj6CeqoYr4R0gX3iJfwJCkx-pjSgpvS_W3R98v6qr_ukrVM31VUIaoPrp-RgDL95GE6STFljmuqmNiOTWHYDYT9MiI4AEMIONKc_aW0-X0Gx_hpVF56PkvtzrXVC9iI Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: afb1017f343248ea8ad41f19db4c7ff0 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/afb1017f343248ea8ad41f19db4c7ff0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: afb1017f343248ea8ad41f19db4c7ff0 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1544591452 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListImageFiltersTestJSON-1544591452-project Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 636c452bd5494aabba7727f21c317a53 Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListImageFiltersTestJSON-1544591452-project Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '32772407-795e-4019-a744-e129e43c0bf3'} Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:44.760124 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. Aug 29 10:46:44.765892 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:44.768995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Returning 404 to user: Instance 32772407-795e-4019-a744-e129e43c0bf3 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:44.771206 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3290fb3e-5940-41d6-8882-bcf875d75eaf tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3" status: 404 len: 111 microversion: 2.1 time: 0.111879 Aug 29 10:46:44.778713 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1431/2901] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:44 2022] GET /compute/v2.1/servers/32772407-795e-4019-a744-e129e43c0bf3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:44.780614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:44.790104 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43ffdbd8-6c10-45e1-8dc8-47dc195bd7d9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.639082 Aug 29 10:46:44.791042 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1471/2902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:44 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:44.793960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:44.796167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:44.797358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:44.798201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:44.804397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.804933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.805564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.806130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.806665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.806790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.807398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.808564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:44.809297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.810071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.823173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:44.823624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:44.855745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:45.010438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:45.023230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e92c09a4-8c95-44db-9977-a8b82c51388b tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1430 microversion: 2.1 time: 0.240395 Aug 29 10:46:45.023892 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1432/2903] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:44 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1430 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:45.029951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1db1d8d0-50fd-425e-a3cc-be48625791e4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c63e2ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:45.099611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e355095e-2989-4b85-9980-7b16ffb92f07 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "DELETE /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 204 len: 0 microversion: 2.1 time: 0.306768 Aug 29 10:46:45.100600 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1472/2904] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:44 2022] DELETE /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:45.110050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:45.112591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:45.131414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.133575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.137259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.138086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.140629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.143082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.458753 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1db1d8d0-50fd-425e-a3cc-be48625791e4 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e" status: 204 len: 0 microversion: 2.1 time: 0.433548 Aug 29 10:46:45.459328 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1433/2905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:45 2022] DELETE /compute/v2.1/images/269fea64-76fa-403f-8d79-78b581290d2e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:45.464697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:45.465772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:45.482937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.483792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.484436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.485351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.485988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.486774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.685067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:45.707807 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-666b4650-6f1d-4418-aa13-ed3888c070ed tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1268 microversion: 2.1 time: 0.247154 Aug 29 10:46:45.709488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1434/2906] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:45 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:45.716259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:45.721136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:45.733573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.734084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.734523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.735238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:45.735691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:45.736111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:45.794454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:45.890556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd6cb406-44a6-40c8-abb7-70caed31d9a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 204 len: 0 microversion: 2.1 time: 0.179389 Aug 29 10:46:45.891160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1435/2907] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:45 2022] DELETE /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:45.896560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03709a7d-860a-4b52-ad1c-af7ef96beb91 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c6427a60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:45.969022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:45.987195 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b06ea9f-ef37-4a57-bfcb-5b81114c49c1 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1508 microversion: 2.1 time: 0.882133 Aug 29 10:46:45.987790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1473/2908] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:45 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1508 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:46.012863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:46.014360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:46.021682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.022541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.023166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.024081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.024711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.025328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.207745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03709a7d-860a-4b52-ad1c-af7ef96beb91 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989" status: 204 len: 0 microversion: 2.1 time: 0.315108 Aug 29 10:46:46.208273 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1436/2909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:45 2022] DELETE /compute/v2.1/images/314e465c-2042-42e2-af01-bc9f00029989 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:46.215648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec53f44c-01e4-4b61-8350-cea8fd318518", "name": "network-vif-deleted", "tag": "c8ba2503-ea95-4d77-8cbf-1f5f6030d428"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:46.229671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.230565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.231075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.244067 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] Creating event network-vif-deleted:c8ba2503-ea95-4d77-8cbf-1f5f6030d428 for instance ec53f44c-01e4-4b61-8350-cea8fd318518 on n-h2-854121-10 Aug 29 10:46:46.249433 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6e0f6d1e-5d31-44c7-bf11-87aaa3962a70 req-6fbcecfb-d138-4393-b4c4-9ba39a7229cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039715 Aug 29 10:46:46.250292 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1437/2910] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:46.256065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:46.256765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:46.263075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.263761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.264206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.265080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.265538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.266005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.288406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:46.296919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-119f3454-0d8e-4990-9545-92cf1171cd46 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.306194 Aug 29 10:46:46.308172 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1474/2911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:45 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:46.314666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:46.315356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:46.322764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.323264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.323861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.324554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.325012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.325449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.414446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:46.423333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0aef2a02-ec8c-42f1-bb92-9c611d5197cf tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1430 microversion: 2.1 time: 0.113635 Aug 29 10:46:46.424119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1475/2912] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:46 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1430 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:46.428399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b37a5f4-a550-43d0-8f71-43868839e4d9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] Calling method '.version_select at 0x7f66c62a81f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:46.512363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:46.521694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d775132d-89c0-49f4-8be1-902c868c0d3d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1552 microversion: 2.1 time: 0.270256 Aug 29 10:46:46.522499 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1438/2913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:46 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:46.660679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b37a5f4-a550-43d0-8f71-43868839e4d9 tempest-ListImageFiltersTestJSON-1544591452 tempest-ListImageFiltersTestJSON-1544591452-project] 10.222.0.47 "DELETE /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe" status: 204 len: 0 microversion: 2.1 time: 0.235743 Aug 29 10:46:46.661253 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1476/2914] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:46 2022] DELETE /compute/v2.1/images/8569f35a-6572-4ba5-8216-61224cd4cbbe => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:46:46.730869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:46.731501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:46.743850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.744346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.747558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.749102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:46.754382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:46.754837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:46.980113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:46.992033 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a06b8153-2c4e-433e-a1a5-017ebeb34eda tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.266042 Aug 29 10:46:46.993230 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1439/2915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:46 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:47.011562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:47.013088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:47.020828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.021495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.022130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.023012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.023619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.024195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.264093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:47.272215 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40aea05c-a8ba-4a17-8247-53e00595f4bf tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1508 microversion: 2.1 time: 0.267825 Aug 29 10:46:47.272799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1477/2916] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:47 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:47.320479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:47.321090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:47.328472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.329442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.330057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.330904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.331516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.332302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.447016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:47.448085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:47.457550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.458412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.458859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.459574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.460184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.460617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.570750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36d8457b2f84ac296a26d06922ddc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c15797a6a384952a37fe2ca744e22a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:47.587829 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09fd2646-9ce2-4788-bfba-b0df81fe1c40 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 200 len: 1301 microversion: 2.1 time: 0.147099 Aug 29 10:46:47.588696 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1478/2917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:47 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 1301 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:47.597478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:47.598280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:47.605157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.606344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.607516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.608590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.609061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.609500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.617718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:47.626690 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f64b84a-11a6-4c04-99ba-847be121a5f0 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.309902 Aug 29 10:46:47.638315 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1440/2918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:47 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:47.839012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dfdc16-7136-4ba3-83ed-7cd89f4a9dae", "tag": "66dcd2ce-f732-4d60-ac7e-39676181965f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:47.839607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:47.846840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:DELETE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:47.870122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:47.874448 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b31ff7b-5740-46b2-93e5-372ec4935d62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1552 microversion: 2.1 time: 0.277280 Aug 29 10:46:47.876710 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1479/2919] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:47 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1552 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:47.883178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:47.883768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:47.918395 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] Creating event network-changed:66dcd2ce-f732-4d60-ac7e-39676181965f for instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae on n-h1-854121-10 Aug 29 10:46:47.925477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-29bb3a5b-912d-4aad-b1b0-06645a08b0f7 req-94c2f40a-7717-45f9-a308-0808284dc7e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090569 Aug 29 10:46:47.927512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1441/2920] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:46:48.016297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:48.016909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:48.024115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.025307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.025997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.027393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.028413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.029664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.295536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:48.296247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:48.309300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.310000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.310722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.311605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.312229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.312987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.499995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fea7b97c5346198762a703f1c3d7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50391e881280432787980aa5c4907d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:48.509970 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-510b9d42-c1da-4b24-b58e-232f146399e5 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 200 len: 1466 microversion: 2.1 time: 0.218460 Aug 29 10:46:48.510582 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1442/2921] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:48 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 1466 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:48.516130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edfacb93-70d5-4012-bc30-d523d4f9ad17", "name": "network-vif-deleted", "tag": "56809eaa-f72b-4b4c-a2ab-ed766b469f41"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:48.528818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.529970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.530609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.534833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:48.542937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] Creating event network-vif-deleted:56809eaa-f72b-4b4c-a2ab-ed766b469f41 for instance edfacb93-70d5-4012-bc30-d523d4f9ad17 on n-h2-854121-10 Aug 29 10:46:48.548842 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-23974bb0-5377-4c6d-92ca-ebf2df16df5f req-bfcd4cdb-bee0-4163-9d7d-a9a700ad991e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Aug 29 10:46:48.549871 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1443/2922] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:48.557136 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84c08361-e9bc-4c10-ba42-5bc0836942cf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.545192 Aug 29 10:46:48.558517 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1480/2923] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:48 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:48.613397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:48.614870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] [instance: ec53f44c-01e4-4b61-8350-cea8fd318518] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:48.623185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.624226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.624863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.626198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.627043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.628100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.648202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] HTTP exception thrown: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Request method failure captured: Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 HTTP/1.1 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJhMnUMD_7A8R0b8gAUn6nhLVhccg5XnLQaIuUyipYSYd4VSSsbAdB-HWXullmbUlerTtfgOStts5LzoBis3NEMtr5qQ3gpmmGc52oJ62wSoeKQA_D02104aC35QWLS_YU2i_EcWIcEEMQsOWRg4HEuZWT5R5U5J9-rUSrYItSEzipI Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c15797a6a384952a37fe2ca744e22a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0c15797a6a384952a37fe2ca744e22a3 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-767612190 Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b36d8457b2f84ac296a26d06922ddc7a Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersOnMultiNodesTest-767612190-project Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ec53f44c-01e4-4b61-8350-cea8fd318518'} Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:48.650268 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. Aug 29 10:46:48.655348 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:48.656648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] Returning 404 to user: Instance ec53f44c-01e4-4b61-8350-cea8fd318518 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:48.657658 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b8e718c-89f2-44f7-a24d-1ce3bb7db530 tempest-ServersOnMultiNodesTest-767612190 tempest-ServersOnMultiNodesTest-767612190-project] 10.222.0.47 "GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518" status: 404 len: 111 microversion: 2.1 time: 0.051473 Aug 29 10:46:48.658253 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1444/2924] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:48 2022] GET /compute/v2.1/servers/ec53f44c-01e4-4b61-8350-cea8fd318518 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:48.662188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:48.665046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:48.677446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.677801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.678243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.679202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.679661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.680088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.900361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:48.901060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:48.917605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.921167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.922158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.922999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:48.923926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:48.924444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:48.944979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:49.036649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:49.045288 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-14c395b4-0e77-47c9-a46f-a99b1134d22b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.395084 Aug 29 10:46:49.058615 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1481/2925] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:48 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:49.307964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:49.317388 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1d7c5da-728d-407b-a8ef-05fd5ada0ddc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1552 microversion: 2.1 time: 0.420797 Aug 29 10:46:49.317994 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1445/2926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:48 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1552 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:49.533621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:49.534341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:49.541902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.542659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.543215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.544291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.545829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.546626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.566507 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 HTTP/1.1 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'edfacb93-70d5-4012-bc30-d523d4f9ad17'} Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.569111 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.573016 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.575894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.577946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b56bc4a-eb59-4e2c-8a28-7db111f488be tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 404 len: 111 microversion: 2.1 time: 0.049071 Aug 29 10:46:49.582752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1482/2927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:49 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.584544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:49.587833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:49.588770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-249252615", "metadata": {"image_type": "test"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:49.591702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:49.599042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.599905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.600622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.601883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.602644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.603292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.621333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.622620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.623572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:49.625309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17/action HTTP/1.1 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 111 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-249252615", "metadata": {"image_type": "test"}}} Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'edfacb93-70d5-4012-bc30-d523d4f9ad17', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-249252615', 'metadata': {'image_type': 'test'}}}} Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 10:46:49.627847 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.633401 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.635326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.635326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.635326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.635326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.640268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.647370 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7ee5110-cd9c-4078-8519-d6c6386d298c tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "POST /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17/action" status: 404 len: 111 microversion: 2.1 time: 0.063165 Aug 29 10:46:49.648670 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1483/2928] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Aug 29 10:46:49 2022] POST /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.660001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-748374073", "metadata": {"image_type": "test"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:49.663324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Failed to fetch instance by id tempest-invalid-1638029186 {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:46:49.663989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance tempest-invalid-1638029186 could not be found. Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/tempest-invalid-1638029186/action HTTP/1.1 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 111 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-748374073", "metadata": {"image_type": "test"}}} Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance tempest-invalid-1638029186 could not be found. Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'tempest-invalid-1638029186', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-748374073', 'metadata': {'image_type': 'test'}}}} Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1638029186 could not be found. Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.666244 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1638029186 could not be found. Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1638029186 could not be found. Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.671617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance tempest-invalid-1638029186 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.674552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d66d267-8ddf-457e-9cad-846bed954e44 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "POST /compute/v2.1/servers/tempest-invalid-1638029186/action" status: 404 len: 101 microversion: 2.1 time: 0.017343 Aug 29 10:46:49.678603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1484/2929] 10.222.0.47 () {60 vars in 1249 bytes} [Mon Aug 29 10:46:49 2022] POST /compute/v2.1/servers/tempest-invalid-1638029186/action => generated 101 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.687283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1971454070"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:49.691279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:46:49.692115 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 57 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "tempest-test-snap-1971454070"}} Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1971454070'}}} Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.695306 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.700015 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.703250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.704108 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92dc89c1-26c2-4df5-961e-fd9a8ab7774d tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024348 Aug 29 10:46:49.709062 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1485/2930] 10.222.0.47 () {60 vars in 1275 bytes} [Mon Aug 29 10:46:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.723995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-636366658"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:49.727903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:46:49.728620 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 56 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: {"createImage": {"name": "tempest-test-snap-636366658"}} Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-636366658'}}} Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.730521 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 10:46:49.736764 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.739118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.740148 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be85b914-0bc4-496c-a1fc-699e31184999 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027784 Aug 29 10:46:49.746663 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1486/2931] 10.222.0.47 () {60 vars in 1281 bytes} [Mon Aug 29 10:46:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.763632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:49.765429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:49.783369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.783369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.783843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.784977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.785581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.786125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.808189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 HTTP/1.1 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'edfacb93-70d5-4012-bc30-d523d4f9ad17'} Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.809930 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b15558e0-3b72-4176-85dc-d1b3fdf8d867 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "DELETE /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 404 len: 111 microversion: 2.1 time: 0.063654 Aug 29 10:46:49.819944 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1487/2932] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:46:49 2022] DELETE /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.825450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:49.826373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] [instance: edfacb93-70d5-4012-bc30-d523d4f9ad17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:49.841310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.842116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.842633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.843476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.844078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.844689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.863273 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] HTTP exception thrown: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Request method failure captured: Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 HTTP/1.1 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJj__bbRsWTU7ZmuANfyMvGtCBLLeiXgGsLjiLs-xECWZlGsUlm1DP1I1X0EzzAFpaR7REpBz7X2gA86RfHG_hSYn0NObOmF-fpMFoHwQCm6uPtFbhJiG9Nq3mssywdhcaOd5A84SaXJQOsQ1NOp6qVPPiHIV2YZ3DqJWOzaTMR5fJo Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50391e881280432787980aa5c4907d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50391e881280432787980aa5c4907d00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50391e881280432787980aa5c4907d00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 50391e881280432787980aa5c4907d00 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1209546050 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 56fea7b97c5346198762a703f1c3d7e1 Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ImagesNegativeTestJSON-1209546050-project Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'edfacb93-70d5-4012-bc30-d523d4f9ad17'} Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:49.865553 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. Aug 29 10:46:49.870079 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:49.870720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] Returning 404 to user: Instance edfacb93-70d5-4012-bc30-d523d4f9ad17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:49.871698 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-afb07224-5083-488c-9e59-57547b435940 tempest-ImagesNegativeTestJSON-1209546050 tempest-ImagesNegativeTestJSON-1209546050-project] 10.222.0.47 "GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17" status: 404 len: 111 microversion: 2.1 time: 0.052193 Aug 29 10:46:49.872589 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1488/2933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:49 2022] GET /compute/v2.1/servers/edfacb93-70d5-4012-bc30-d523d4f9ad17 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:49.957107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f67395-9c30-472c-86be-3c5eb7b82574", "name": "network-vif-deleted", "tag": "2dc638cb-5d19-4737-b686-61c0bc12aff1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:49.971595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:49.972280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:49.972871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:49.996030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] Creating event network-vif-deleted:2dc638cb-5d19-4737-b686-61c0bc12aff1 for instance 98f67395-9c30-472c-86be-3c5eb7b82574 on n-h2-854121-10 Aug 29 10:46:50.002723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-aab4a395-c1ce-4dc1-b2fc-03fbef51fe49 req-18df3c04-f4cf-4cef-ab0a-3b9d9ff2615f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051801 Aug 29 10:46:50.003652 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1489/2934] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:50.068542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:50.070102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:50.070864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:50.077598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:50.078495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:50.079154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:50.080594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:50.081266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:50.081958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:50.082930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ef9edf4-aa2e-466d-9406-c837d942817b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.504757 Aug 29 10:46:50.088058 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1446/2935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:49 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:50.360461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:50.360594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:50.363371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:50.375378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:50.375594 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16fb0edb-37b2-404d-bada-0367c4e65439 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.308195 Aug 29 10:46:50.376396 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1490/2936] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:50 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:50.377300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:50.379030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:50.379838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:50.381509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:50.384504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:50.508288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:50.524586 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2cdd962-3593-413f-b0e3-b7990e4f09d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1345 microversion: 2.1 time: 0.187798 Aug 29 10:46:50.525198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1447/2937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:50 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:51.104961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:51.106206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:51.115966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.116727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.117407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.118308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.118932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.119980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.325766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:51.338661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-201b3c70-1c7e-44e4-bd71-f359d629d3a6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.238514 Aug 29 10:46:51.340902 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1491/2938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:51 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:51.398842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:51.400022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:51.416543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.418162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.421255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.425004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.426986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.427720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.549340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:51.550308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:51.566269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.567130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.567814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.568715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:51.569332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:51.569942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:51.997650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:52.012278 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2c8bcc35-bf14-4078-87da-c7a70ee93784 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1345 microversion: 2.1 time: 0.467748 Aug 29 10:46:52.030497 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1492/2939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:51 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1345 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:52.066588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:52.075376 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8f87a989-f82d-42e2-b13a-d05b424cab88 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.681448 Aug 29 10:46:52.077336 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1448/2940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:51 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:52.360797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:52.361988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:52.384780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:52.385520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:52.386008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:52.386771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:52.387241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:52.387678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:52.673138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:52.686708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3658179d-1f1c-42cf-8e1e-68ced1e355f5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.330108 Aug 29 10:46:52.687860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1493/2941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:52 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:53.037195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.038107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:53.049408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.054307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.055124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.056761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.059008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.059604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.216248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Action: 'update', calling method: .version_select at 0x7f66c63b2c10>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:53.221031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.221529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.222002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.257183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.258024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.258467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.282040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] HTTP exception thrown: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Request method failure captured: Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d HTTP/1.1 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 56 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkckEyFZsu3Xhx9-f_j7wkwDj9HNzHQ0217bW66_uu0G144ZPs7tUR-0Z2uMgHlV-rvG0mn08fD9XZpygd-TBc4RzfHx607gHsIHlOzD_r5ax208LVJl-dX7LIV34JCy7aqu0hb05mlNe6lSHnCewgHJtFP8BQGdRYkQvVWB9_K-9s Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3a45c75d976743caaf915e59a0406ef0 Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: exception: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'cf4f191b-2776-4f12-a35d-df3fd333382d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:53.284329 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.289058 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.290801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Returning 404 to user: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:53.291856 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5727f530-5c62-4817-bfb2-4748493730cb tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d" status: 404 len: 110 microversion: 2.53 time: 0.332086 Aug 29 10:46:53.295423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1449/2942] 10.222.0.47 () {62 vars in 1309 bytes} [Mon Aug 29 10:46:52 2022] PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d => generated 110 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:53.302260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.302874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:53.321983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.322479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.322926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.323650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.324104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.324530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.426982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:53.540648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:53.550844 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-727ad5de-c857-4a94-8695-01953efd2fc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1345 microversion: 2.1 time: 0.517948 Aug 29 10:46:53.552305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1494/2943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1345 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:53.560300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Action: 'update', calling method: .version_select at 0x7f66c6228e50>, body: {"status": "disabled"} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:53.593484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:53.606971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-545ea439-8e28-41f8-bad9-4183d59840b4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.309845 Aug 29 10:46:53.610114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.611391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.612105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.615464 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1450/2944] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:53.637604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.641503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.642924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.657741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] HTTP exception thrown: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Request method failure captured: Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d HTTP/1.1 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 22 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkckEyFZsu3Xhx9-f_j7wkwDj9HNzHQ0217bW66_uu0G144ZPs7tUR-0Z2uMgHlV-rvG0mn08fD9XZpygd-TBc4RzfHx607gHsIHlOzD_r5ax208LVJl-dX7LIV34JCy7aqu0hb05mlNe6lSHnCewgHJtFP8BQGdRYkQvVWB9_K-9s Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 3a45c75d976743caaf915e59a0406ef0 Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: {"status": "disabled"} Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: exception: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'cf4f191b-2776-4f12-a35d-df3fd333382d', 'body': {'status': 'disabled'}} Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:53.660008 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.664550 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.667798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Returning 404 to user: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:53.668895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-569afa4c-d85f-4364-a176-82e475e1fdf5 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d" status: 404 len: 110 microversion: 2.53 time: 0.115300 Aug 29 10:46:53.670557 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1495/2945] 10.222.0.47 () {62 vars in 1309 bytes} [Mon Aug 29 10:46:53 2022] PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d => generated 110 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:53.680853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Action: 'update', calling method: .version_select at 0x7f66c63b2d30>, body: {"status": "enabled"} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:53.685085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.686218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.687022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.706673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.714038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.715977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.716332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:53.716470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.735695 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] HTTP exception thrown: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.737262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.737815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.738279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.742209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Request method failure captured: Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d HTTP/1.1 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 21 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkckEyFZsu3Xhx9-f_j7wkwDj9HNzHQ0217bW66_uu0G144ZPs7tUR-0Z2uMgHlV-rvG0mn08fD9XZpygd-TBc4RzfHx607gHsIHlOzD_r5ax208LVJl-dX7LIV34JCy7aqu0hb05mlNe6lSHnCewgHJtFP8BQGdRYkQvVWB9_K-9s Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f93db2ac3de42309dd74a8aba83568d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 7f93db2ac3de42309dd74a8aba83568d Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3a45c75d976743caaf915e59a0406ef0 Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: {"status": "enabled"} Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: exception: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'cf4f191b-2776-4f12-a35d-df3fd333382d', 'body': {'status': 'enabled'}} Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:46:53.742644 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. Aug 29 10:46:53.747536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:53.748880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.748880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.750073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Returning 404 to user: Service cf4f191b-2776-4f12-a35d-df3fd333382d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:53.754785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-851ff545-cf08-4742-849a-26702399070d tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d" status: 404 len: 110 microversion: 2.53 time: 0.076598 Aug 29 10:46:53.759737 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1451/2946] 10.222.0.47 () {62 vars in 1309 bytes} [Mon Aug 29 10:46:53 2022] PUT /compute/v2.1/os-services/cf4f191b-2776-4f12-a35d-df3fd333382d => generated 110 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:53.765359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.777139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.780931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.781810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.785375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.786085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.786686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.851451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a7aa6bc-8fcc-4f06-8b55-2555f3e76996 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.090261 Aug 29 10:46:53.862904 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1452/2947] 10.222.0.47 () {60 vars in 1178 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:46:53.868763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.873775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.874514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.875141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.876116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.876747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.877423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.908253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ae25d58-7ad3-483f-94b1-827106850695 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.043282 Aug 29 10:46:53.915111 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1453/2948] 10.222.0.47 () {60 vars in 1211 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:46:53.923234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.926873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.927846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.928242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.928986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:53.929518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:53.929976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:53.960352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f888ffb4-1d51-44e4-b1e0-fc0f6d3f5912 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.041760 Aug 29 10:46:53.961380 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1454/2949] 10.222.0.47 () {60 vars in 1178 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:46:53.993538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:53.997458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.003655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.005969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.007647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.009501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.012006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.047938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:54.056140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87478bd5-bf2d-4aa5-bfc0-bb8009ce0239 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.346168 Aug 29 10:46:54.065057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1496/2950] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:54.070866 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2cb2ef1b-b059-4447-a133-09155ee1a33c tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-854121-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.099261 Aug 29 10:46:54.072392 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1455/2951] 10.222.0.47 () {60 vars in 1237 bytes} [Mon Aug 29 10:46:53 2022] GET /compute/v2.1/os-services?host=n-d-854121-10&binary=xxx => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:54.085453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:54.091185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.092037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.092951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.093913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.094543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.095167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.126963 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb215c8c-68a4-4ebe-9a62-d43a229a0043 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045470 Aug 29 10:46:54.128079 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1497/2952] 10.222.0.47 () {60 vars in 1178 bytes} [Mon Aug 29 10:46:54 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:46:54.141655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:54.146279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.146952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.147820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.148858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.149573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.150180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.176197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e607aad-9dfe-4380-9872-1d26efdfc006 tempest-ServicesAdminNegativeV253TestJSON-1056876707 tempest-ServicesAdminNegativeV253TestJSON-1056876707-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.039581 Aug 29 10:46:54.177091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1456/2953] 10.222.0.47 () {60 vars in 1239 bytes} [Mon Aug 29 10:46:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:54.191571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:46:54.375556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed439e91-971b-48bb-9d04-af91bec256df tempest-ServicesAdminNegativeV253TestJSON-1108291947 tempest-ServicesAdminNegativeV253TestJSON-1108291947-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:54.381471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed439e91-971b-48bb-9d04-af91bec256df tempest-ServicesAdminNegativeV253TestJSON-1108291947 tempest-ServicesAdminNegativeV253TestJSON-1108291947-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4c8d0101003045da99ecdf961d0b8d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a62f391d8f470bbf6a8afb6fe36b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed439e91-971b-48bb-9d04-af91bec256df tempest-ServicesAdminNegativeV253TestJSON-1108291947 tempest-ServicesAdminNegativeV253TestJSON-1108291947-project] Request method failure captured: Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkbGHfRhVxxAiXUUYMyY_BEpsUtTmZ0PbHg7w4GQ7ZopUmfayx1a4h6EdoMAhKQhft_nQa2g3nSS-PQtgPmD2ht4BYUK34hp-C3tp8y2Y4nRSkVJ3e6rPz37AcKuTOIl5cBqUB37gF6YSyxFs3PI83RIwVaM_Du_RYojHIxB9HYemw Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a0a62f391d8f470bbf6a8afb6fe36b03 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1108291947 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0a62f391d8f470bbf6a8afb6fe36b03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a0a62f391d8f470bbf6a8afb6fe36b03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a0a62f391d8f470bbf6a8afb6fe36b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a0a62f391d8f470bbf6a8afb6fe36b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1108291947 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a0a62f391d8f470bbf6a8afb6fe36b03 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1108291947 Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1108291947-project Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4c8d0101003045da99ecdf961d0b8d5d Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1108291947-project Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 10:46:54.384329 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed439e91-971b-48bb-9d04-af91bec256df tempest-ServicesAdminNegativeV253TestJSON-1108291947 tempest-ServicesAdminNegativeV253TestJSON-1108291947-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed439e91-971b-48bb-9d04-af91bec256df tempest-ServicesAdminNegativeV253TestJSON-1108291947 tempest-ServicesAdminNegativeV253TestJSON-1108291947-project] 10.222.0.47 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.200526 Aug 29 10:46:54.393715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1498/2954] 10.222.0.47 () {60 vars in 1178 bytes} [Mon Aug 29 10:46:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:54.578210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:54.580063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:54.592347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.593567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.595559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.596491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.597127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.597755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.652414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:54.655220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:54.678756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.680046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.680662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.682223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:54.683394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:54.684014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:54.877933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:54.888158 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b062e64-60e2-4a3e-b8b7-0009924d14c1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1345 microversion: 2.1 time: 0.319715 Aug 29 10:46:54.889227 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1457/2955] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:54 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1345 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:55.077551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:55.078201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:55.093526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:55.094076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:55.095718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:55.096453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:55.096918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:55.099758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:55.141775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:55.155304 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e4228957-d48c-4f6b-a71f-01cf922fdfe1 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.516879 Aug 29 10:46:55.163896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1499/2956] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:54 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:55.909198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:55.909852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:55.937848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:55.938590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:55.939321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:55.940334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:55.941029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:55.941604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:56.199719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:56.220970 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2de187d2-fd81-4645-b701-d2797e831788 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 1.147693 Aug 29 10:46:56.234834 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1458/2957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:55 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:56.235191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:56.242323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7fe5295e-05b9-4d27-a7a0-24aed2421f5a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1345 microversion: 2.1 time: 0.337217 Aug 29 10:46:56.247148 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1500/2958] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:55 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:56.249721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:56.250616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:56.258424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:56.274434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:56.278550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:56.280045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:56.280675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:56.281129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:56.705727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dfdc16-7136-4ba3-83ed-7cd89f4a9dae", "name": "network-vif-plugged", "status": "completed", "tag": "66dcd2ce-f732-4d60-ac7e-39676181965f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:56.730575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:56.732243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:56.733778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:56.739943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:56.753376 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b2db024c-66d6-41d3-9d14-fd7790eec2e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.529202 Aug 29 10:46:56.759701 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1459/2959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:56 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:56.762515 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] Creating event network-vif-plugged:66dcd2ce-f732-4d60-ac7e-39676181965f for instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae on n-h1-854121-10 Aug 29 10:46:56.770498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d5800e12-bbaf-4488-8c99-efa2ee3a2e58 req-e1469703-7ff4-4daa-b386-0f738cc53530 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072089 Aug 29 10:46:56.772088 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1501/2960] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:57.244065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:57.245464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:57.270913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:57.272469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:57.275324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.275839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.276286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.282688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.283188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.283643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.287176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.299719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.300406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.301528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.302727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.303263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.355951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.356738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.358263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.358956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'fault' on Instance uuid 98f67395-9c30-472c-86be-3c5eb7b82574 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:46:57.484241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:57.507796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69d9c18e-9224-4e43-b795-3815eb25dfc5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 200 len: 1304 microversion: 2.1 time: 0.244085 Aug 29 10:46:57.511433 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1502/2961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:57 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:46:57.849561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:57.863640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01b64f6f-703a-455e-83ee-1a4622904127 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1316 microversion: 2.1 time: 0.624388 Aug 29 10:46:57.869335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1460/2962] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:57 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:57.880708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:57.882985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:57.897215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.900445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.903052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:57.904144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:57.907257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:57.910459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.024611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.025287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:58.038016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.042531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.043554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.047377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.052008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.053071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.105532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:46:58.188168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:58.200660 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1956e2f7-7238-4183-84c6-1723f01cef8e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.329835 Aug 29 10:46:58.202104 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1461/2963] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:57 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:58.300300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce4ddf7b-904e-4fe2-9e56-b1a21b6c72da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 204 len: 0 microversion: 2.42 time: 0.787017 Aug 29 10:46:58.304481 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1503/2964] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:46:57 2022] DELETE /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:46:58.305207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Calling method '.version_select at 0x7f66c63a7f70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.317373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.319038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:58.343159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.344008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.344690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.345598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.349072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.350260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.352004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:46:58.352605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Neutron security group 9eb05f23-626b-4549-8cec-9484841549fe not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:46:58.353124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] HTTP exception thrown: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.353124 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Request method failure captured: Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-security-groups/9eb05f23-626b-4549-8cec-9484841549fe HTTP/1.1 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkhPCBCntOnEfdzv68EJsO6ufzpzzmHE4sYrWHFagT4NTPDdlYZnw97LdgRJY6tpiC8TQbkqXoPX8Jz-Lhr5mF5Fp9aQ_lmKQaP3KwRmCUKhxwXWeMHVWFBuSSqSCvckU8C7Bk46Xohg4nJ_jVhP0sbxF_K_h9QqjGAJiH4Qv7sEOI Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51243649952c4e26aab5f0441b8630f7 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9eb05f23-626b-4549-8cec-9484841549fe'} Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:46:58.354986 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Returning 404 to user: Security group 9eb05f23-626b-4549-8cec-9484841549fe does not exist Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-01266025-dba7-4d0e-b303-e939ae1616f7'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a182a92d-4ee3-47df-a0eb-e55c0a431574 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/9eb05f23-626b-4549-8cec-9484841549fe" status: 404 len: 194 microversion: 2.1 time: 0.153126 Aug 29 10:46:58.360374 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1462/2965] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:58 2022] DELETE /compute/v2.1/os-security-groups/9eb05f23-626b-4549-8cec-9484841549fe => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:58.366900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9045f3f8-f798-4bd5-9312-d16980be81c6 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003893 Aug 29 10:46:58.367940 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1463/2966] 10.222.0.47 () {58 vars in 1164 bytes} [Mon Aug 29 10:46:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 10:46:58.378423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b524377-1232-4a2f-96ee-62baefc18bcd tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Calling method '.version_select at 0x7f66c63a23a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.840158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:58.855735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b524377-1232-4a2f-96ee-62baefc18bcd tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.482651 Aug 29 10:46:58.856532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1464/2967] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:46:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:46:58.858406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:58.860304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:58.861653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9829412e-4cb4-4a8f-ae0e-bdea63438fcd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2954 microversion: 2.42 time: 0.554430 Aug 29 10:46:58.862238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.862503 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1504/2968] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:46:58 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2954 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:46:58.871328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Calling method '.version_select at 0x7f66c6268940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.874850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:58.889482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.890887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.891492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.892358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.892972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.893848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.910257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 HTTP/1.1 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '98f67395-9c30-472c-86be-3c5eb7b82574'} Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:58.912105 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:58.919219 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02d1f6e4-4769-4c65-ab7d-24e6ccb8a9d3 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 404 len: 111 microversion: 2.1 time: 0.056798 Aug 29 10:46:58.922005 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1465/2969] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:58 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:58.933908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:58.934877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:58.942320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.943054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.943659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:58.944722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:58.945358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:58.945985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.115433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:46:59.116857 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 29 10:46:59.116857 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Request method failure captured: Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/63b88cc3-1999-4717-aaab-ba6cc5c1b3ad HTTP/1.1 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkhPCBCntOnEfdzv68EJsO6ufzpzzmHE4sYrWHFagT4NTPDdlYZnw97LdgRJY6tpiC8TQbkqXoPX8Jz-Lhr5mF5Fp9aQ_lmKQaP3KwRmCUKhxwXWeMHVWFBuSSqSCvckU8C7Bk46Xohg4nJ_jVhP0sbxF_K_h9QqjGAJiH4Qv7sEOI Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 51243649952c4e26aab5f0441b8630f7 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: exception: Insufficient rights for removing default security group. Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '63b88cc3-1999-4717-aaab-ba6cc5c1b3ad'} Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:46:59.120923 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] Aug 29 10:46:59.126331 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.131558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 29 10:46:59.131558 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1e31ef7d-f9db-4a2d-b1c7-083dc90533bb'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:59.132944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-258f94e1-e80b-405a-ac2c-635cce8e9487 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/63b88cc3-1999-4717-aaab-ba6cc5c1b3ad" status: 400 len: 182 microversion: 2.1 time: 0.266949 Aug 29 10:46:59.134316 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1505/2970] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:46:58 2022] DELETE /compute/v2.1/os-security-groups/63b88cc3-1999-4717-aaab-ba6cc5c1b3ad => generated 182 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:46:59.145063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:59.148394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:59.158127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.158760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.159213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.161618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.162420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.163048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.166946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:59.177159 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-017e628c-80af-4ecc-a5bb-49e5d940ef73 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1505 microversion: 2.1 time: 0.252285 Aug 29 10:46:59.184266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:59.186561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1466/2971] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:58 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574/os-volume_attachments HTTP/1.1 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '98f67395-9c30-472c-86be-3c5eb7b82574'} Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:46:59.187044 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03ff9c8b-7052-4631-a9b3-169cfb57e2d0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052452 Aug 29 10:46:59.190873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1506/2972] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:46:59 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:59.199204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-556964578"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:59.199715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Calling method '.version_select at 0x7f66c63fb1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:59.199947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:59.210392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.211269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.211679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.212472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.213204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.213674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.252781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:46:59.253592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Neutron security group 70c110fb-a056-4e43-946d-3c7701c0c2ee not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:46:59.254215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] HTTP exception thrown: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.254215 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Request method failure captured: Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-security-groups/70c110fb-a056-4e43-946d-3c7701c0c2ee HTTP/1.1 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkhPCBCntOnEfdzv68EJsO6ufzpzzmHE4sYrWHFagT4NTPDdlYZnw97LdgRJY6tpiC8TQbkqXoPX8Jz-Lhr5mF5Fp9aQ_lmKQaP3KwRmCUKhxwXWeMHVWFBuSSqSCvckU8C7Bk46Xohg4nJ_jVhP0sbxF_K_h9QqjGAJiH4Qv7sEOI Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51243649952c4e26aab5f0441b8630f7 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '70c110fb-a056-4e43-946d-3c7701c0c2ee'} Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:46:59.256846 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] Aug 29 10:46:59.261371 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.271148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Returning 404 to user: Security group 70c110fb-a056-4e43-946d-3c7701c0c2ee does not exist Aug 29 10:46:59.271148 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-e028b99d-382e-4fbe-a7db-8bd290cbd3a5'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:59.272683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-746ffff6-cb9a-49ec-a398-237524ac3393 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/70c110fb-a056-4e43-946d-3c7701c0c2ee" status: 404 len: 194 microversion: 2.1 time: 0.078097 Aug 29 10:46:59.273617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1467/2973] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:46:59 2022] GET /compute/v2.1/os-security-groups/70c110fb-a056-4e43-946d-3c7701c0c2ee => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:59.291367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:46:59.292305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:46:59.300769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.301265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.301731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.302488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:46:59.302940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:46:59.303573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:46:59.511920 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Adding security group 1f52a60c-4eba-4b1e-bbd9-3706780dca3f to port 66dcd2ce-f732-4d60-ac7e-39676181965f Aug 29 10:46:59.619499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:46:59.628073 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-abfe0721-8379-4c1e-a21f-5b51e19914af tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.353169 Aug 29 10:46:59.628970 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1468/2974] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:46:59 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:46:59.638092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Action: 'update', calling method: .version_select at 0x7f66c63a7310>, body: {"security_group": {"name": "tempest-sg-2097921433", "description": "tempest-description-1439515083"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:59.698291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:46:59.699355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Neutron security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:46:59.699919 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] HTTP exception thrown: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.699919 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Request method failure captured: Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/os-security-groups/25141c1a-2c88-4649-abc7-1c9e6a7e34af HTTP/1.1 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 102 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkhPCBCntOnEfdzv68EJsO6ufzpzzmHE4sYrWHFagT4NTPDdlYZnw97LdgRJY6tpiC8TQbkqXoPX8Jz-Lhr5mF5Fp9aQ_lmKQaP3KwRmCUKhxwXWeMHVWFBuSSqSCvckU8C7Bk46Xohg4nJ_jVhP0sbxF_K_h9QqjGAJiH4Qv7sEOI Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/807f0dc4b8d847d2a9e726f3c162855d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 807f0dc4b8d847d2a9e726f3c162855d Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 51243649952c4e26aab5f0441b8630f7 Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1890820444-project Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: {"security_group": {"name": "tempest-sg-2097921433", "description": "tempest-description-1439515083"}} Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '25141c1a-2c88-4649-abc7-1c9e6a7e34af', 'body': {'security_group': {'name': 'tempest-sg-2097921433', 'description': 'tempest-description-1439515083'}}} Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:46:59.704642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] Returning 404 to user: Security group 25141c1a-2c88-4649-abc7-1c9e6a7e34af does not exist Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-0e2c4667-66ae-4ab0-8197-eb561fea9a1f'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0fd801e8-9624-4754-b7c7-0a369c251bd7 tempest-SecurityGroupsNegativeTestJSON-1890820444 tempest-SecurityGroupsNegativeTestJSON-1890820444-project] 10.222.0.47 "PUT /compute/v2.1/os-security-groups/25141c1a-2c88-4649-abc7-1c9e6a7e34af" status: 404 len: 194 microversion: 2.1 time: 0.077054 Aug 29 10:46:59.708362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1469/2975] 10.222.0.47 () {60 vars in 1290 bytes} [Mon Aug 29 10:46:59 2022] PUT /compute/v2.1/os-security-groups/25141c1a-2c88-4649-abc7-1c9e6a7e34af => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:46:59.712837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1623412097", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:46:59.811342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:00.145946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9f88636-b958-4177-9466-a87bc905e385 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/action" status: 202 len: 0 microversion: 2.1 time: 0.950981 Aug 29 10:47:00.146542 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1507/2976] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:46:59 2022] POST /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:47:00.547635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b59615c6-4d3d-4d22-b62b-a61fd68f6291 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:00.565202 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b59615c6-4d3d-4d22-b62b-a61fd68f6291 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.415978 Aug 29 10:47:00.568512 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1508/2977] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:47:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:00.596185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:00.598405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:00.630565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.631513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.633747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:00.635975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.636976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.637448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:00.698634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:47:00.699224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:47:00.699818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:47:00.700331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:47:00.700963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:47:00.704838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:00.720505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.721003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.721445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:00.722223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.722685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.723119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:00.768930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:00.787002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:00.817490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:47:00.820899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:47:00.926223 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ce2393c-8671-47f8-92f5-12a4c749a460 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214325 Aug 29 10:47:00.933102 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1470/2978] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:47:00.944430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-397114367"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:00.947799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:00.959007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.959689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.960292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:00.961337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:00.962013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:00.962672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:01.573921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:01.594146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:01.598080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:01.602321 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54b2d29d-f5b7-4e54-b953-6e4850212712 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2954 microversion: 2.42 time: 1.030827 Aug 29 10:47:01.614218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1509/2979] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:00 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2954 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:01.638647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dfdc16-7136-4ba3-83ed-7cd89f4a9dae", "tag": "66dcd2ce-f732-4d60-ac7e-39676181965f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:01.650390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:01.651134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:01.651749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:01.666162 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] Creating event network-changed:66dcd2ce-f732-4d60-ac7e-39676181965f for instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae on n-h1-854121-10 Aug 29 10:47:01.683387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6c182e9c-6ec3-4cd0-b575-d5230c54ff82 req-5ce11be1-f927-497f-b807-0b6774539548 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047272 Aug 29 10:47:01.684346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1510/2980] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:01.697261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:01.699856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:01.718738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:01.722758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:01.722758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:01.730253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:01.732847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:01.733381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:01.745623 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.security_group_api [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Adding security group 139924b7-603c-4d50-b4b8-7a06085bcff9 to port 66dcd2ce-f732-4d60-ac7e-39676181965f Aug 29 10:47:02.593485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:02.609385 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0e2eb427-719a-4bbd-be5b-5b93e811cadc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1533 microversion: 2.1 time: 0.920272 Aug 29 10:47:02.612832 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1511/2981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:01 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1533 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:02.622340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:02.623850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:02.643942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:02.646383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:02.647265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:02.648217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:02.648885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:02.649475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:02.819726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:02.858106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a151656-8bba-497d-a637-3a2d66536a36 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1275 microversion: 2.1 time: 0.242929 Aug 29 10:47:02.862990 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1512/2982] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:02 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:02.882268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1718647328", "imageRef": "77ee3a25-3568-48f4-b5bd-5d15b2523ecf", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:02.973690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:04.105160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:04.177230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-000378af-d384-4175-a81a-e3c78055dc12 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/action" status: 202 len: 0 microversion: 2.1 time: 3.242532 Aug 29 10:47:04.178248 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1471/2983] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:47:00 2022] POST /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/action => generated 0 bytes in 3244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:04.211025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:04.213315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:04.231270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.232105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.234366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:04.236997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.239810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.240369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:04.442470 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] Request method failure captured: Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 143 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkjcChLkD70kQb30Ih4VmFxfQ2L_KxpPGcNI5BKybDB-UXoSHrVqvzO2WirMbIH7ppQbMmOZvjQipwOXJaNLIfF0TtkxNe5WzFs5ulNKvUeDqtt_5QAeZ9akYudoRP27UEsCLliAE68iUnuKtM3GlaKLrerf8CiWqPwQJn7l8NSe8s Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 00d64494d26042a6a30d1d00263a6454 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-FlavorsV2NegativeTest-224432126 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/00d64494d26042a6a30d1d00263a6454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_00d64494d26042a6a30d1d00263a6454"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/00d64494d26042a6a30d1d00263a6454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/00d64494d26042a6a30d1d00263a6454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-FlavorsV2NegativeTest-224432126 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 00d64494d26042a6a30d1d00263a6454 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-224432126 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-FlavorsV2NegativeTest-224432126-project Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f56d050a46f649be92192dd4e5784e83 Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-FlavorsV2NegativeTest-224432126-project Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1718647328", "imageRef": "77ee3a25-3568-48f4-b5bd-5d15b2523ecf", "flavorRef": "452"}} Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: exception: Flavor's memory is too small for requested image. Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1718647328', 'imageRef': '77ee3a25-3568-48f4-b5bd-5d15b2523ecf', 'flavorRef': '452'}}} Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:47:04.444634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 29 10:47:04.449228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:04.453677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:04.456214 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51798e39-1505-4e51-af87-aebabe179bf0 tempest-FlavorsV2NegativeTest-224432126 tempest-FlavorsV2NegativeTest-224432126-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.587441 Aug 29 10:47:04.456961 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1513/2984] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:47:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 1593 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:47:04.476002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:04.478524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:04.501441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.508285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.508973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:04.510843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.514375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.514908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:04.603007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:47:04.851442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:04.864831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f980179-d8c1-40fd-8431-fdaa0b9c83f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 204 len: 0 microversion: 2.1 time: 0.406433 Aug 29 10:47:04.866462 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1514/2985] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:47:04 2022] DELETE /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:47:04.874708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:04.881733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:04.904787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.905769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.906459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:04.909244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:04.910056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:04.910779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:05.960721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:05.978694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:05.988158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:05.999683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d9e78ce-da83-4fb4-806f-66944e56f13a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2954 microversion: 2.42 time: 1.817630 Aug 29 10:47:06.043767 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1472/2986] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:04 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2954 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:06.064498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:06.065927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:06.085785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:06.086384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:06.086724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:06.091205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:06.092486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:06.092937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:06.158274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:07.493163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:07.508274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20c1af84-0394-4a6f-b24e-55bf6514b278 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 2.638049 Aug 29 10:47:07.509274 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1515/2987] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:04 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:07.522407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dfdc16-7136-4ba3-83ed-7cd89f4a9dae", "tag": "66dcd2ce-f732-4d60-ac7e-39676181965f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:07.544220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.546256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.547511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:07.595454 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] Creating event network-changed:66dcd2ce-f732-4d60-ac7e-39676181965f for instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae on n-h1-854121-10 Aug 29 10:47:07.612737 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-313c4e6e-ba51-43e1-9cff-672ea614fed0 req-5a107ce9-ec82-4187-a84b-cb3bee8f0112 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100260 Aug 29 10:47:07.614300 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1516/2988] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:07.629427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:07.630555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:07.648714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.649653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.650473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:07.652003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.652784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.653456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:07.677190 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d616001-c7df-4d89-8dc0-dd9ac2795740 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 1.630850 Aug 29 10:47:07.679710 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1473/2989] 10.222.0.47 () {58 vars in 1293 bytes} [Mon Aug 29 10:47:06 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae/os-security-groups => generated 1155 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:07.695263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "name": "network-vif-plugged", "status": "completed", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:07.723121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.723622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.724063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:07.748591 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] Creating event network-vif-plugged:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:47:07.755530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-39bdde2c-ca35-4290-bec4-5469734f4544 req-53fce808-b1ab-4ef2-b073-11ba8ffae93e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074206 Aug 29 10:47:07.758232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1474/2990] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:07.777511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:07.778512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:07.788203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.789027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.789651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:07.790589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:07.791567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:07.793052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:08.700053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:08.720784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0b8b-0b79-4dc8-b567-047bd565db2f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 1.104854 Aug 29 10:47:08.721776 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1517/2991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:07 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:08.743820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bade13f3-6518-470f-918a-28b5c5ad4fab tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c6bfd3a0>, body: {"security_group": {"name": " tempest-securitygroup -1382101065 ", "description": "tempest-description-1724083549"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:09.333196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:09.350502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:09.353939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:09.370196 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-787bb871-16f0-44a6-9aeb-068462cef591 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2933 microversion: 2.42 time: 1.604197 Aug 29 10:47:09.372601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1475/2992] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:07 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2933 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:09.379017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:09.379641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:09.386941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:09.387902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:09.388362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:09.389315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:09.389841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:09.390286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.199876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:10.210283 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a49d28d8-2173-4673-a50f-1b1da61ae15c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.834998 Aug 29 10:47:10.215499 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1476/2993] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:09 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:10.221169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:10.239070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:10.262578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:10.263344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:10.269094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.270126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:10.270794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:10.271397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.484644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bade13f3-6518-470f-918a-28b5c5ad4fab tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.761104 Aug 29 10:47:10.485907 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1518/2994] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:08 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:10.497159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "fbc86598-a800-4c5e-94bc-23e2c82e3e23"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8184d7-704a-44a6-b5c7-d657900817c6"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "79dfe7f0-b18b-4f2f-8bef-721aec20fe1e"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "844cad02-b496-4a09-975b-2dc20d4c7f00"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "3753f968-91c5-486f-a765-2dc4bc69f280"}, {"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-unplugged", "status": "completed", "tag": "caace4f8-4013-4946-9b42-fa03ce69a6f1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:10.539640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:10.542082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:10.543187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.573377 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:fbc86598-a800-4c5e-94bc-23e2c82e3e23 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.576933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:4b8184d7-704a-44a6-b5c7-d657900817c6 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.578063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:79dfe7f0-b18b-4f2f-8bef-721aec20fe1e for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.592458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:844cad02-b496-4a09-975b-2dc20d4c7f00 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.600628 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:3753f968-91c5-486f-a765-2dc4bc69f280 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.604893 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] Creating event network-vif-unplugged:caace4f8-4013-4946-9b42-fa03ce69a6f1 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:10.624246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ca527375-4482-49d4-8e2d-e45ab159a1a2 req-eaf4598d-73d0-4c33-8821-69e3995b6feb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.135962 Aug 29 10:47:10.629693 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1519/2995] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:10.636675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:10.637730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:10.646513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:10.647406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:10.648013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.649048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:10.649756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:10.650346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:10.746113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:10.804792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:11.048833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:11.066874 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-455701ab-573d-4622-aa6c-dd31172b745c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.846215 Aug 29 10:47:11.072520 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1477/2996] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:10 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:11.102214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df70fa05-3a24-484f-9342-7a9816cd86b4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c63c64c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:11.415612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:11.425469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:11.438695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:11.440027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-409f609b-9831-4e77-bc5e-b08b7b4fc397 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2912 microversion: 2.42 time: 0.808805 Aug 29 10:47:11.447432 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1520/2997] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:10 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2912 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:11.453221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:11.467880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:11.476736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:11.478490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:11.480276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:11.488650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:11.490304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:11.490755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:11.563963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df70fa05-3a24-484f-9342-7a9816cd86b4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee" status: 200 len: 224 microversion: 2.1 time: 0.482452 Aug 29 10:47:11.566732 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1478/2998] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:47:11 2022] GET /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee => generated 224 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:11.578172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a8c0e3ed-28b4-4a67-aec2-41da287ae24b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6353040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:12.723738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:12.733230 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f55cedec-5e04-4348-a69e-fcba6cb901e5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 1.283981 Aug 29 10:47:12.751430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1521/2999] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:11 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:12.771145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:12.778243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:12.785524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:12.788459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:12.789128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:12.793261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:12.793964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:12.794581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:13.351290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a8c0e3ed-28b4-4a67-aec2-41da287ae24b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee" status: 202 len: 0 microversion: 2.1 time: 1.777692 Aug 29 10:47:13.355492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1479/3000] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:11 2022] DELETE /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee => generated 0 bytes in 1782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:13.363195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e452a5-5a22-4912-8315-ff67917f3d4e", "tag": "9377ad19-2382-41f8-8a07-d89949969bf6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:13.382863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:13.383357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:13.383783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:13.411478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] Creating event network-changed:9377ad19-2382-41f8-8a07-d89949969bf6 for instance 16e452a5-5a22-4912-8315-ff67917f3d4e on n-h2-854121-10 Aug 29 10:47:13.422225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0c935ec2-1915-4d7a-92ed-30447ed33a06 req-91a7fcd9-94fe-413e-8543-1e19b40437ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065349 Aug 29 10:47:13.423633 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1480/3001] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:13.434611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:13.437770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:13.452171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:13.452968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:13.453567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:13.454468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:13.455999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:13.465639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:13.698184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:13.719335 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a81657a-351e-4792-89f5-17c7e60021af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.960266 Aug 29 10:47:13.726766 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1522/3002] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:12 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:13.741565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6f79dc0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:13.966860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:13.967664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group a66ea10e-084d-40ee-b8b9-6e9311e53fee not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:47:13.968217 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.968217 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee HTTP/1.1 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a66ea10e-084d-40ee-b8b9-6e9311e53fee'} Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:13.970289 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-1f6a6701-bf51-416c-bf44-dbcdd4615657'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97d806c6-d617-47fe-9366-0e9a75518189 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee" status: 404 len: 194 microversion: 2.1 time: 0.243248 Aug 29 10:47:13.975144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1523/3003] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:47:13 2022] GET /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee => generated 194 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:13.993829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:13.993829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:14.009216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:14.014177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:14.014803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:14.018338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:14.018838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:14.019298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:14.182762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:14.192837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:14.202652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:14.204236 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce88084a-618a-455c-89e5-fc8b0770cbf3 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2866 microversion: 2.42 time: 0.779347 Aug 29 10:47:14.205561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1481/3004] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:13 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2866 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:14.211610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bac1282f-c1bf-412f-9d90-b18d982113fd tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c6353af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-232398027", "description": "tempest-description-1389521144"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:14.688731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:14.717780 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e8d82b0-9e05-47c8-9bc5-d7f0dc683688 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.742247 Aug 29 10:47:14.740919 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1524/3005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:13 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:14.774296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:14.775211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:14.787066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:14.789865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:14.790507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:14.791514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:14.792151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:14.792750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:15.332735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:15.362234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49a18c9d-87be-4c68-ab5c-34b496035bff tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.615155 Aug 29 10:47:15.366575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1525/3006] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:14 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:15.384562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:15.385236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:15.393073 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bac1282f-c1bf-412f-9d90-b18d982113fd tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.186257 Aug 29 10:47:15.394482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1482/3007] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:15.404088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:15.405507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:15.406166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:15.407120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:15.408212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44b1717f-6d97-456d-95e1-b967988da2a1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c66fd790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2093892314", "description": "tempest-description-409842380"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:15.408596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:15.409663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:16.502447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:16.539156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:16.554359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:16.562152 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc2adc3f-c007-4d0e-a0fc-ffd4901ea9b8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2866 microversion: 2.42 time: 1.188514 Aug 29 10:47:16.570835 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1526/3008] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:15 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2866 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:16.601779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:16.615212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:16.650483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:16.651044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:16.655248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:16.659459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:16.660078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:16.660533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:16.753283 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44b1717f-6d97-456d-95e1-b967988da2a1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.350041 Aug 29 10:47:16.755864 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1483/3009] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:47:16.767582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-deleted", "tag": "4b8184d7-704a-44a6-b5c7-d657900817c6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:16.802971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:16.804183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:16.805079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:16.833773 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] Creating event network-vif-deleted:4b8184d7-704a-44a6-b5c7-d657900817c6 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:16.841653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-05ec2ac9-1578-43b3-ba6b-cd98ef516eaf req-b2ba3e8a-f6d9-4fc9-895d-0fe516f6b875 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083974 Aug 29 10:47:16.843144 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1484/3010] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:16.852132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:16.853225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:16.861817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:16.862617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:16.863256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:16.864109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:16.870089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:16.871039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:17.394134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:17.413429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fad00bc0-11aa-4156-bd4c-311ad101ccab tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.830170 Aug 29 10:47:17.414329 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1527/3011] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:16 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:17.421466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f07ba5d0-d8e9-44e5-9e9f-6a247321fba7 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c62db3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-307448786", "description": "tempest-description-562277303"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:17.862849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:17.877062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e91dd25-a1bb-418f-8051-457e75961539 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 1.032424 Aug 29 10:47:17.879386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1485/3012] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:16 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:17.885402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:17.892208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:17.911868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:17.913733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:17.914498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:17.916421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:17.921775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:17.922528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.669801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f07ba5d0-d8e9-44e5-9e9f-6a247321fba7 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.250599 Aug 29 10:47:19.678751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1528/3013] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:17 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:19.686818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:19.689632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:19.695298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:19.707880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.712535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:19.713464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.714141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.715554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.716207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.717568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.720105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:19.734558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c5af27a-5d29-40a5-8db3-215ab50063da tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2706 microversion: 2.42 time: 1.853789 Aug 29 10:47:19.735572 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1486/3014] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:17 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2706 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:19.740390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:19.751232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:19.776731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:19.782286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.786033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.789400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.791786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.795017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.796949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.894475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c986a84-1db0-4311-bed5-df74e13e5fcf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.157620 Aug 29 10:47:19.897611 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1487/3015] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:47:19 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/ips => generated 149 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:19.929840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:19.938024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:19.970268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.987422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.991171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:19.992199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:19.995784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:19.999532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:20.199671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:20.223350 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-843540ff-f741-4123-a86a-03f360b96dc3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.542621 Aug 29 10:47:20.224133 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1529/3016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:19 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:20.241891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-deleted", "tag": "3753f968-91c5-486f-a765-2dc4bc69f280"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:20.265946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:20.270116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:20.271313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:20.300416 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] Creating event network-vif-deleted:3753f968-91c5-486f-a765-2dc4bc69f280 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:20.318985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b59ba0dc-98c8-42c7-a0cd-429e2aeb1827 req-06f1cbab-7429-4016-8235-3ac158d9d82d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093327 Aug 29 10:47:20.323162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1530/3017] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:20.333669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-412d8864-f048-432c-b7d2-0490e6777a74 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6249820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:20.407335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:20.421177 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35776ab4-91a3-4a2e-b448-aba03ac6d782 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.522121 Aug 29 10:47:20.422403 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1488/3018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:19 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:20.769854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:20.771523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:20.788455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:20.794154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:20.795088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:20.797502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:20.798764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:20.802613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:22.049481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:22.059961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:22.070385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:22.083342 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f9c49e21-00dd-4a89-adc1-f0fb11ad5d6a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2370 microversion: 2.42 time: 1.315604 Aug 29 10:47:22.084426 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1489/3019] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:20 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2370 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:22.105081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:22.106259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:22.119711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:22.128004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:22.129646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:22.130648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:22.132516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:22.135741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:22.426548 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-412d8864-f048-432c-b7d2-0490e6777a74 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 2.101403 Aug 29 10:47:22.428142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1531/3020] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:47:20 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:22.434041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:22.438767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:22.490587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:22.499132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:22.500863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:22.512685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:22.518244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:22.519005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:22.535792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:22.900377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:22.917904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90207118-152d-447c-9bf5-f567a035089e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.830018 Aug 29 10:47:22.918512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1490/3021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:22 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:22.946620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43b3a915-0aa4-4f64-ba6f-9a8b31affd21 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c63cc670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:23.237745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:23.245936 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cc897d9f-c9f7-44a0-aff7-6d3aba900ab1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.816170 Aug 29 10:47:23.258246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1532/3022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:22 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:23.275255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-deleted", "tag": "79dfe7f0-b18b-4f2f-8bef-721aec20fe1e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:23.316869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:23.320634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:23.321981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:23.359280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] Creating event network-vif-deleted:79dfe7f0-b18b-4f2f-8bef-721aec20fe1e for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:23.379492 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-67f3ab28-14c5-44da-a276-8fff54f7c4d6 req-b847edfe-962e-4a6b-9e76-9ce1f50c1d31 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119751 Aug 29 10:47:23.381222 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1533/3023] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:23.402601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:23.403718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:23.428168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:23.434634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:23.437547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:23.438485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:23.439802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:23.440355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:23.969322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:23.986574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:23.988323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:23.991082 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07066177-db9b-4a61-929d-f77a923550c2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2256 microversion: 2.42 time: 0.600216 Aug 29 10:47:23.993931 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1534/3024] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:23 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2256 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:24.005194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:24.009506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:24.028464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:24.031159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:24.033755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:24.034942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:24.038619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:24.039429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:24.855968 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43b3a915-0aa4-4f64-ba6f-9a8b31affd21 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec" status: 202 len: 0 microversion: 2.1 time: 1.920552 Aug 29 10:47:24.857056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1491/3025] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:22 2022] DELETE /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec => generated 0 bytes in 1922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:24.866969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b40bf168-aa72-46e6-b822-145145976282"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:24.869826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:24.901738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:24.902617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:24.905479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:24.906761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:24.907396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:24.907980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:25.095234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:25.116859 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4faf7bb2-46a4-4cb1-bd3e-32a487ef5b85 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 1.117234 Aug 29 10:47:25.117457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1535/3026] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:23 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:25.144676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:25.145213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:25.165040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:25.165532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:25.166001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:25.166717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:25.169666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:25.170450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:25.442811 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d00f7ee8-82a7-44e3-8a3d-63bf2d7b0792 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.579465 Aug 29 10:47:25.444373 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1492/3027] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:47:24 2022] POST /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:25.464916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c63c2310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:25.649177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:25.650165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:47:25.650873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.650873 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec HTTP/1.1 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '12a71cc6-e7fb-402b-bdb9-df1472a090ec'} Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:25.653478 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] Aug 29 10:47:25.657877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:25.664845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:47:25.664845 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-a744b892-5d10-4bd6-ad1b-c26dab4288bc'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:25.666303 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f014137-10c5-433e-bd76-cd93bcf7b8c5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec" status: 404 len: 194 microversion: 2.1 time: 0.220474 Aug 29 10:47:25.667225 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1493/3028] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:47:25 2022] GET /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec => generated 194 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:25.692885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:25.694353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:25.715133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:25.715768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:25.717467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:25.718365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:25.720225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:25.720780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:26.344781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:26.369449 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adce6a30-1b0f-4c85-9ea2-a19bbf352605 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 1.228244 Aug 29 10:47:26.390069 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1536/3029] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:25 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:26.398303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:26.401632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c804cc2d-d3c1-476a-b9bf-c683ce6395e7 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c65d5160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:26.419662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:26.433219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:26.434654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6bd8b94e-6388-4cf3-af60-72bf396bbb73 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 2210 microversion: 2.42 time: 0.766179 Aug 29 10:47:26.436160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1494/3030] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:25 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 2210 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:26.451981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-deleted", "tag": "fbc86598-a800-4c5e-94bc-23e2c82e3e23"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:26.471041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:26.472232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:26.473743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:26.516849 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] Creating event network-vif-deleted:fbc86598-a800-4c5e-94bc-23e2c82e3e23 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:26.532372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-cf41a26a-8ec0-4465-8431-74db250e6f35 req-9408bced-c1a9-44ab-acbc-410d19959d4f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094446 Aug 29 10:47:26.533728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1495/3031] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:26.950281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-439d5b2d-3df8-48d4-a918-2f009e322144 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c63c6550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-829098834", "description": "tempest-description-214846687"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:28.301034 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-439d5b2d-3df8-48d4-a918-2f009e322144 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.765983 Aug 29 10:47:28.302002 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1496/3032] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:26 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:28.414777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] Calling method '.version_select at 0x7f66c635c1f0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:28.554745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6266ff8-c207-4c60-a36e-c65b27f789f1 could not be found", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:28.555504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] HTTP exception thrown: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] Request method failure captured: Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-floating-ips/a6266ff8-c207-4c60-a36e-c65b27f789f1 HTTP/1.1 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk-1yCrbf-ub1n-Lpz8KTOAzXyEUxVjUdHa12XzQULieHLaxbZJI4J5one9gSe017sdRb4f8WVzpBG6_5uHWg5xTnCVQMZ4OkZZsONm_glUyz7qobTTZEWdSQADNSROqY6M04fi6Pq6o94TODqYKbKz11zSbNWK98RNMBQ3NgqUFlg Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 48524236db90490eb361fc37153a98e0 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1057375159 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48524236db90490eb361fc37153a98e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48524236db90490eb361fc37153a98e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48524236db90490eb361fc37153a98e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48524236db90490eb361fc37153a98e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1057375159 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 48524236db90490eb361fc37153a98e0 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1057375159 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7dd5838c863346cfa184ebdc44cfbca8 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: exception: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a6266ff8-c207-4c60-a36e-c65b27f789f1'} Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:28.557663 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6266ff8-c207-4c60-a36e-c65b27f789f1 could not be found Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a7e7efd-5c01-4414-a4c1-d48f46c36f93'] Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1. Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1 Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1 Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] Returning 404 to user: Floating IP not found for ID a6266ff8-c207-4c60-a36e-c65b27f789f1 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:28.563332 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dbc5a445-e028-420f-a429-8683ef879c0c tempest-FloatingIPDetailsNegativeTestJSON-1057375159 tempest-FloatingIPDetailsNegativeTestJSON-1057375159-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/a6266ff8-c207-4c60-a36e-c65b27f789f1" status: 404 len: 111 microversion: 2.1 time: 0.255125 Aug 29 10:47:28.568138 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1497/3033] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 29 10:47:28 2022] GET /compute/v2.1/os-floating-ips/a6266ff8-c207-4c60-a36e-c65b27f789f1 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:28.582171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:28.585349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:28.617305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:28.620270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:28.620761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:28.624832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:28.628669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:28.631258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:28.761640 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c804cc2d-d3c1-476a-b9bf-c683ce6395e7 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620" status: 202 len: 0 microversion: 2.1 time: 2.370167 Aug 29 10:47:28.762763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1537/3034] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:26 2022] DELETE /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620 => generated 0 bytes in 2372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:28.786289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:28.789750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:28.808432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:28.811503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:28.812723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:28.815084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:28.815745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:28.816795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:29.267760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:29.306686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8adb97e-ce05-4162-87a2-fc3d0688ca4e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.737765 Aug 29 10:47:29.309577 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1498/3035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:28 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:29.315145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:29.315760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:29.367354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:29.367852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:29.368290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:29.369012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:29.369462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:29.386009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:29.447897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:29.466292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fdfaa4ef-9ddc-4e45-be0a-81db2c21a7d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 0.701089 Aug 29 10:47:29.475025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1538/3036] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:28 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:29.577778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:29.587654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:29.599521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:29.600779 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c351357-40a5-41f0-8017-db88ba40cfdc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.289420 Aug 29 10:47:29.601326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1499/3037] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:29 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:29.606811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-07d12a19-6b62-4035-bee3-90ad379c17c6 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c63c6e50>, body: {"security_group_rule": {"parent_group_id": "f70d4173-dabb-4b75-b328-874ea53e732a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:29.664298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7812719f-049a-4f4d-aea5-6d0f8a9eab29 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Action: 'create', calling method: .version_select at 0x7f66c6bebee0>, body: {"keypair": {"name": "tempest-keypair-470080170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTzA4FCZgnawGB+7BCT73SC5mQLSpM2bwTLBMwsJFzn0W5kqJi0sn3wj5ly8VlOtfq9KCfdpm3mkpWxK+y+tLiugmcb80wDIA89xxDSOXPh6k7VNGxCd1sQvSKHY3FGWw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:29.799629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7812719f-049a-4f4d-aea5-6d0f8a9eab29 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Getting quotas for project 914255253974433e81e245445f69dc44. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:29.847096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7812719f-049a-4f4d-aea5-6d0f8a9eab29 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Getting quotas for user c20069173f154e48966504d891c5e9fc and project 914255253974433e81e245445f69dc44. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:29.984586 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7812719f-049a-4f4d-aea5-6d0f8a9eab29 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.503333 Aug 29 10:47:29.986953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1539/3038] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:47:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:29.998450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e452a5-5a22-4912-8315-ff67917f3d4e", "name": "network-vif-plugged", "status": "completed", "tag": "9377ad19-2382-41f8-8a07-d89949969bf6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:30.059912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:30.063163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:30.065608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:30.108513 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] Creating event network-vif-plugged:9377ad19-2382-41f8-8a07-d89949969bf6 for instance 16e452a5-5a22-4912-8315-ff67917f3d4e on n-h2-854121-10 Aug 29 10:47:30.121676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-07d12a19-6b62-4035-bee3-90ad379c17c6 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.516901 Aug 29 10:47:30.123596 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1500/3039] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:30.127491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6e98dbb9-08b2-4727-a639-21fdd93df4dd req-8bc9c832-30dd-4791-a9fd-07f7e3993770 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136294 Aug 29 10:47:30.128903 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1540/3040] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:30.150201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c635cb80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:30.152395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23efe6f-782b-497e-b0f9-cd7bc2248ef6", "name": "network-vif-deleted", "tag": "caace4f8-4013-4946-9b42-fa03ce69a6f1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:30.170844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:30.188513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:30.189238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:30.229877 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] Creating event network-vif-deleted:caace4f8-4013-4946-9b42-fa03ce69a6f1 for instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 on n-h1-854121-10 Aug 29 10:47:30.256202 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f4d767e1-a2f0-442e-ba0b-7eaab58c34a9 req-bf5cc21e-bd2b-4169-a9d3-47e43804b2ef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112385 Aug 29 10:47:30.256662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:30.257337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group b3f2692d-88ee-4817-957c-d9ad5692c620 not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:47:30.257897 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.257897 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.258166 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1541/3041] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620 HTTP/1.1 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b3f2692d-88ee-4817-957c-d9ad5692c620'} Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:30.261290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] Aug 29 10:47:30.266582 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.270087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7b1623c-aea4-4b7f-b546-d9f830bb6933 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c6e075e0>, body: {"security_group_rule": {"parent_group_id": "f70d4173-dabb-4b75-b328-874ea53e732a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:30.271045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:47:30.271045 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-2b9fe261-6596-4b64-9ba0-255ccca7a5a4'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:30.272182 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b81cb0c9-7587-473b-a02b-a421b639a7d4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620" status: 404 len: 194 microversion: 2.1 time: 0.146641 Aug 29 10:47:30.273546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1501/3042] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:47:30 2022] GET /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:30.283805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ec95f39-beea-4f94-b666-2fc2983bdd04 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c635c670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:30.624216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c7b1623c-aea4-4b7f-b546-d9f830bb6933 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7b1623c-aea4-4b7f-b546-d9f830bb6933 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 138 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: {"security_group_rule": {"parent_group_id": "f70d4173-dabb-4b75-b328-874ea53e732a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: exception: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f70d4173-dabb-4b75-b328-874ea53e732a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:30.626229 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:30.631195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:30.631195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:30.631195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a Aug 29 10:47:30.631195 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:30.632250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7b1623c-aea4-4b7f-b546-d9f830bb6933 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: This rule already exists in group f70d4173-dabb-4b75-b328-874ea53e732a {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:30.633272 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7b1623c-aea4-4b7f-b546-d9f830bb6933 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.374155 Aug 29 10:47:30.634381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1542/3043] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:47:30.639433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:30.646247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:30.666637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:30.667423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:30.671117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:30.672296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:30.674324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:30.675084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:31.313742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:31.327176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-826dc029-1d15-4683-9613-6cffa5469ea3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.691482 Aug 29 10:47:31.327756 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1543/3044] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:30 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:31.347092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:31.347981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:31.370482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:31.383494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:31.389894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:31.391306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:31.397824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:31.402377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:31.791889 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ec95f39-beea-4f94-b666-2fc2983bdd04 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f" status: 202 len: 0 microversion: 2.1 time: 1.513742 Aug 29 10:47:31.793840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1502/3045] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:30 2022] DELETE /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f => generated 0 bytes in 1516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:31.806144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:31.806832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:31.820512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:31.823264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:31.824319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:31.827261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:31.829657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:31.832288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:31.952719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:32.120305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:32.140177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:32.147268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:32.148550 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95b83956-45cb-4cab-83b7-c4e1e2223bf7 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.353435 Aug 29 10:47:32.163145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1503/3046] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:31 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:32.172118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-993e81f5-3266-421c-a37b-a54360fc1066 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c63fb040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:32.554613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:32.571497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f0d3662-6493-429a-9e93-55d16faf6b44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1315 microversion: 2.1 time: 1.235808 Aug 29 10:47:32.578325 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1544/3047] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:31 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1315 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:32.597812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66cb12bca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:32.761745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:32.762601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 90a35f0a-22fe-4759-8429-b3f2c556330f not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:47:32.763301 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.763301 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f HTTP/1.1 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '90a35f0a-22fe-4759-8429-b3f2c556330f'} Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:32.765545 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] Aug 29 10:47:32.770024 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:32.773960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:47:32.773960 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-8dbf9077-fd69-4098-822d-0fa28d00a811'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:32.775073 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2870b3e2-86ef-43a2-8f37-bf2891e63660 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f" status: 404 len: 194 microversion: 2.1 time: 0.195500 Aug 29 10:47:32.776113 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1545/3048] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:47:32 2022] GET /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f => generated 194 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:32.810957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:32.818353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:32.847257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:32.852228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:32.855564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:32.856539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:32.857322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:32.858140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:33.321470 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-993e81f5-3266-421c-a37b-a54360fc1066 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/b870de9d-c27a-4983-abb2-c3aa9f904b4a" status: 202 len: 0 microversion: 2.1 time: 1.154259 Aug 29 10:47:33.323006 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1504/3049] 10.222.0.47 () {58 vars in 1287 bytes} [Mon Aug 29 10:47:32 2022] DELETE /compute/v2.1/os-security-group-rules/b870de9d-c27a-4983-abb2-c3aa9f904b4a => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:33.332252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a55ee7dd-ab63-442b-8bbe-66de346ffcb8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c63a2700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:33.597784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:33.618586 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-309f0356-789a-4117-8c44-8344b3dd805d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1528 microversion: 2.1 time: 0.839013 Aug 29 10:47:33.622276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1546/3050] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1528 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:33.636706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:33.637637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:33.659250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:33.661369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:33.663017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:33.664430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:33.668109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:33.668858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:33.850200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:33.869545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:33.875022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:33.879557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3dd46322-1faf-4e2e-b783-a8e7b887b698 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.253831 Aug 29 10:47:33.880444 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1547/3051] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:33 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:33.896220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cc53bdcb-f7ca-4c6e-a5c1-1bea4515388e tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66cafd04c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1673027991", "description": "tempest-description-336915951"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:34.201604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a55ee7dd-ab63-442b-8bbe-66de346ffcb8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.876781 Aug 29 10:47:34.214181 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1505/3052] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 10:47:33 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:34.220637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:34.221511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:34.277867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:34.278260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:34.278708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:34.279985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:34.280450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:34.281083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:34.652041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:34.669382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9e8483f-a2f4-4e2a-b4df-6503faaecb2a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1273 microversion: 2.1 time: 0.453991 Aug 29 10:47:34.671139 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1506/3053] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:34 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1273 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:34.678582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f906032b-e765-4846-924e-b672544270a5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c63a2160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-474219234", "description": "tempest-description-1161658992"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:35.095294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cc53bdcb-f7ca-4c6e-a5c1-1bea4515388e tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.211629 Aug 29 10:47:35.111884 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1548/3054] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:35.119336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e452a5-5a22-4912-8315-ff67917f3d4e", "name": "network-vif-deleted", "tag": "9377ad19-2382-41f8-8a07-d89949969bf6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:35.144994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:35.153870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:35.155713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:35.157101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:35.204007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] Creating event network-vif-deleted:9377ad19-2382-41f8-8a07-d89949969bf6 for instance 16e452a5-5a22-4912-8315-ff67917f3d4e on n-h2-854121-10 Aug 29 10:47:35.218688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4a6e82ac-9449-44d3-b7c2-c2c21ba96c82 req-6740a565-1eca-491c-bb0d-8f6e7469f00f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105064 Aug 29 10:47:35.221124 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1549/3055] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:35.238588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:35.242252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:35.253321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:35.254407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:35.255094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:35.256057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:35.256758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:35.257814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:36.306718 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f906032b-e765-4846-924e-b672544270a5 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.632378 Aug 29 10:47:36.308318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1507/3056] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:36.321307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:36.323604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:36.339570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:36.340095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:36.340724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:36.342878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:36.343504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:36.344139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:36.612665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:36.634587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:36.637962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:36.641557 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d50fff8-7026-43b9-a7f2-27ab8018b0dc tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.331745 Aug 29 10:47:36.643261 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1508/3057] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:36 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:36.650624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43b95595-8749-4acc-ba69-ff52027c1f52 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c63a2160>, body: {"security_group_rule": {"parent_group_id": "3b92c06c-54aa-4352-86fc-a46c20fc391a", "ip_protocol": "tcp", "from_port": 29965348, "to_port": 22}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:36.884577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:36.895081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78920395-8154-4183-9068-4f22aa71bdb6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1510 microversion: 2.1 time: 1.665340 Aug 29 10:47:36.897369 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1550/3058] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:35 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1510 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:36.903045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:36.903887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:36.918109 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-43b95595-8749-4acc-ba69-ff52027c1f52 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Invalid port range 29965348:22. Former value cannot be greater than the later Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43b95595-8749-4acc-ba69-ff52027c1f52 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 144 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: {"security_group_rule": {"parent_group_id": "3b92c06c-54aa-4352-86fc-a46c20fc391a", "ip_protocol": "tcp", "from_port": 29965348, "to_port": 22}} Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid port range 29965348:22. Former value cannot be greater than the later Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3b92c06c-54aa-4352-86fc-a46c20fc391a', 'ip_protocol': 'tcp', 'from_port': 29965348, 'to_port': 22}}} Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 29965348:22. Former value cannot be greater than the later Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 29965348:22. Former value cannot be greater than the later Aug 29 10:47:36.923277 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 29965348:22. Former value cannot be greater than the later Aug 29 10:47:36.927748 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:36.929541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43b95595-8749-4acc-ba69-ff52027c1f52 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: Invalid port range 29965348:22. Former value cannot be greater than the later {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:36.930847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:36.931224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43b95595-8749-4acc-ba69-ff52027c1f52 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.285461 Aug 29 10:47:36.936674 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1509/3059] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:36 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:47:36.939865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:36.941473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:36.942623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:36.945186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:36.955550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:36.964983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8f22fbb4-dc90-4f3e-86c5-c80a9f51351c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c63c6a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2044896172", "description": "tempest-description-1559097207"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.125244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:37.135966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31ed29ff-5f07-48c1-abe1-74f63219af6b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 200 len: 1294 microversion: 2.1 time: 0.236886 Aug 29 10:47:37.137482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1551/3060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:36 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:37.150090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bed36c97-c133-4fe2-814d-6f59d4b47682 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c65d5b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2119162442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.154205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-bed36c97-c133-4fe2-814d-6f59d4b47682 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Security group id should be uuid Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bed36c97-c133-4fe2-814d-6f59d4b47682 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 131 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2119162442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group id should be uuid Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2119162442', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:37.156086 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:37.161046 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 29 10:47:37.161046 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.171527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bed36c97-c133-4fe2-814d-6f59d4b47682 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: Security group id should be uuid {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:37.172792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bed36c97-c133-4fe2-814d-6f59d4b47682 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.034170 Aug 29 10:47:37.178326 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1552/3061] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:37 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:47:37.183162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5da7188d-875b-4d95-a77b-7731097e8b85 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c6bfdb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-728007800", "description": "tempest-description-1144506348"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.437602 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8f22fbb4-dc90-4f3e-86c5-c80a9f51351c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.485321 Aug 29 10:47:37.438414 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1510/3062] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:37.458361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5337d540-91e3-4d07-9f39-1a1a08bf6e10"}], "security_groups": [{"name": "tempest-securitygroup--1278884170"}], "key_name": "tempest-keypair-470080170", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.542306 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5da7188d-875b-4d95-a77b-7731097e8b85 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.362832 Aug 29 10:47:37.551769 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1553/3063] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:37.558569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-542862f5-39db-4156-83e3-f76509947c36 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c62dbca0>, body: {"security_group_rule": {"parent_group_id": "1f9130fd-7cc9-4942-ba1d-640155a50001", "ip_protocol": "tempest-999-401730937", "from_port": 22, "to_port": 22}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.666124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] validate_networks() for [('5337d540-91e3-4d07-9f39-1a1a08bf6e10', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:37.752517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-542862f5-39db-4156-83e3-f76509947c36 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Invalid IP protocol tempest-999-401730937. Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-542862f5-39db-4156-83e3-f76509947c36 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 156 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: {"security_group_rule": {"parent_group_id": "1f9130fd-7cc9-4942-ba1d-640155a50001", "ip_protocol": "tempest-999-401730937", "from_port": 22, "to_port": 22}} Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid IP protocol tempest-999-401730937. Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1f9130fd-7cc9-4942-ba1d-640155a50001', 'ip_protocol': 'tempest-999-401730937', 'from_port': 22, 'to_port': 22}}} Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-401730937. Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-401730937. Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.755488 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-401730937. Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-542862f5-39db-4156-83e3-f76509947c36 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: Invalid IP protocol tempest-999-401730937. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-542862f5-39db-4156-83e3-f76509947c36 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.204557 Aug 29 10:47:37.759537 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1554/3064] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:37 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 10:47:37.767364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1859365875", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "70ed7617-900e-4d5b-b726-85c5318898ee"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:37.847437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] validate_networks() for [('70ed7617-900e-4d5b-b726-85c5318898ee', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:38.495304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:47:38.495762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:47:38.496208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:47:38.496626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:47:38.497041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:47:38.524378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.524883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.525331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.526094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.526565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.527068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.571212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Getting quotas for project 914255253974433e81e245445f69dc44. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:38.578159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Getting quotas for user c20069173f154e48966504d891c5e9fc and project 914255253974433e81e245445f69dc44. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:38.605889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:47:38.613025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:47:38.709384 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-31c95840-b209-4648-aa1e-acddff51c1c8 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.269008 Aug 29 10:47:38.713507 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1511/3065] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:47:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:47:38.723580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:38.729772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:38.737854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:47:38.738290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:47:38.738756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:47:38.739186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:47:38.746326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:47:38.762750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.763635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.764326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.765954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.766674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.767340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.784425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.784936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.785385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.786127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:38.790280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:38.792137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:38.815452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Getting quotas for project 5b3af429e3ea43649e18c5124c6c7ca9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:38.826680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Getting quotas for user 6d2fe9f9e5bb4de980a20b42acf06483 and project 5b3af429e3ea43649e18c5124c6c7ca9. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:38.844218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:47:38.847041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:47:38.931111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6d65f919-38a7-4845-90dd-eaa2578a3a8f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170703 Aug 29 10:47:38.934849 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1555/3066] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:47:38.946915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24ac7204-a7d1-4bfa-a372-82ca4141af74 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c65d5af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1386431881", "description": "tempest-description-72953195"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:38.984891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:39.030175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:39.038716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:39.050166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87e51ea1-9bdd-48da-bcaa-e212a469f02d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.333267 Aug 29 10:47:39.052558 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1512/3067] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:38 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:39.069754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:39.071638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:39.110655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.112434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.114326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.117116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.123707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.128191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.639641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:39.653387 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f0097b1-760c-4431-9048-cecc986428e8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1510 microversion: 2.1 time: 0.596352 Aug 29 10:47:39.655327 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1513/3068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:39 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:39.666752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:39.667837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:39.684100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.686426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.687160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.689281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.690329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.692093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.727504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e HTTP/1.1 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '16e452a5-5a22-4912-8315-ff67917f3d4e'} Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:39.731600 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:39.736950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:39.737541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c3e06e2-7a43-43cb-8da2-51a61f1dcf86 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 404 len: 111 microversion: 2.1 time: 0.079561 Aug 29 10:47:39.744877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1514/3069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:39 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:39.753538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "name": "network-vif-unplugged", "status": "completed", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:39.775915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.778288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.778750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.815426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] Creating event network-vif-unplugged:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:47:39.836193 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1dc8215f-8173-4471-9997-08078dae8c4a req-93efa659-1e7e-40f7-b4e8-3bc8cbd99619 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093376 Aug 29 10:47:39.837883 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1515/3070] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:39.850647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24ac7204-a7d1-4bfa-a372-82ca4141af74 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.914300 Aug 29 10:47:39.851942 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1556/3071] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:38 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:39.864670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e9c7906d-130f-46fe-ad62-68096222e8b8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:39.866331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e9c7906d-130f-46fe-ad62-68096222e8b8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:39.868755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:39.869469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:39.899612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.902614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.905456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:39.907322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:39.908863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:39.910997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:40.082229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e9c7906d-130f-46fe-ad62-68096222e8b8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:40.107171 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e9c7906d-130f-46fe-ad62-68096222e8b8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1216 microversion: 2.1 time: 0.253569 Aug 29 10:47:40.122401 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1557/3072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:39 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:40.129819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8eaaec0-a0ad-4c27-bcd2-33ae2e903296 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c6bfd9d0>, body: {"security_group_rule": {"parent_group_id": "8727a494-5d31-4398-941b-8b8e24be7bea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:40.178833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:40.189282 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da04a8b0-7534-4b39-8958-77dceeb10797 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1229 microversion: 2.1 time: 0.350169 Aug 29 10:47:40.192408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1516/3073] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:39 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1229 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:40.211748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:40.214185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:40.236888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c8eaaec0-a0ad-4c27-bcd2-33ae2e903296 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 10:47:40.237759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:40.238418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8eaaec0-a0ad-4c27-bcd2-33ae2e903296 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 138 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: {"security_group_rule": {"parent_group_id": "8727a494-5d31-4398-941b-8b8e24be7bea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8727a494-5d31-4398-941b-8b8e24be7bea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 10:47:40.239023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 10:47:40.242858 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:47:40.243413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:40.243497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8eaaec0-a0ad-4c27-bcd2-33ae2e903296 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:40.243497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c8eaaec0-a0ad-4c27-bcd2-33ae2e903296 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.121263 Aug 29 10:47:40.243497 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1558/3074] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:40 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:47:40.245381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:40.246143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:40.246876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:40.258268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1291022441", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:40.365254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:40.425151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:40.456158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:40.463869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:40.471576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ed6d1a1-07e6-43b7-846d-aac3c0485324 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.271534 Aug 29 10:47:40.472237 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1517/3075] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:40 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:40.495937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88bc3e34-6c02-442f-a3a2-9fab599be052 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c6353af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-539929156", "description": "tempest-description-790638552"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:41.207908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:47:41.209428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:47:41.210153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:47:41.210747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:47:41.211336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:47:41.228574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.229285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.230225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.237252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.237963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.238596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.288203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:41.302331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:41.338300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:47:41.340451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:47:41.377463 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88bc3e34-6c02-442f-a3a2-9fab599be052 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.902053 Aug 29 10:47:41.388164 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1518/3076] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:47:40 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:41.395600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:41.397292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:41.430829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.431596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.434004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.437898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.438582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.439220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.474629 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a543d047-e5fe-472b-8dd1-2ed4b65b2581 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232152 Aug 29 10:47:41.475309 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1559/3077] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:47:41.488746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:41.491018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:41.508654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.510033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.510663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.511563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.512187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.512777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.772105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:41.786544 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99641b27-3be4-405e-9659-c10b44008035 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1276 microversion: 2.1 time: 0.310122 Aug 29 10:47:41.798162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1560/3078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:41 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:41.822210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:41.822939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:41.832528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.833032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.833474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:41.834203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:41.834982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:41.857448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:42.048760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.059497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78ba4593-04c9-4a05-a117-0bf1644215ef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1453 microversion: 2.1 time: 0.669700 Aug 29 10:47:42.082388 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1519/3079] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:41 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1453 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:42.100703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1388c9b-814f-4685-9d21-8956e052af10 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c63c6e50>, body: {"security_group_rule": {"parent_group_id": "d8fff1b7-94e7-482b-ab2b-cabb2deeea59", "ip_protocol": "tcp", "from_port": 22, "to_port": 1088786889}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:42.282798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.324192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25dcfadc-db46-4f0f-896e-bdc9d1013310 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1295 microversion: 2.1 time: 0.522713 Aug 29 10:47:42.326068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1561/3080] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:41 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1295 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:42.338809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa886bbe-b77a-44e0-a93a-18e2301ba181 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:42.339857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa886bbe-b77a-44e0-a93a-18e2301ba181 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:42.549113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aa886bbe-b77a-44e0-a93a-18e2301ba181 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.568044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e1388c9b-814f-4685-9d21-8956e052af10 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1388c9b-814f-4685-9d21-8956e052af10 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 146 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: {"security_group_rule": {"parent_group_id": "d8fff1b7-94e7-482b-ab2b-cabb2deeea59", "ip_protocol": "tcp", "from_port": 22, "to_port": 1088786889}} Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd8fff1b7-94e7-482b-ab2b-cabb2deeea59', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1088786889}}} Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 Aug 29 10:47:42.569767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1388c9b-814f-4685-9d21-8956e052af10 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 400 to user: Invalid port range 22:1088786889. Valid TCP ports should be between 1-65535 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:42.574900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1388c9b-814f-4685-9d21-8956e052af10 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.487453 Aug 29 10:47:42.578116 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1520/3081] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:42 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:47:42.583383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:42.584005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:42.589653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa886bbe-b77a-44e0-a93a-18e2301ba181 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1215 microversion: 2.1 time: 0.260017 Aug 29 10:47:42.598231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1562/3082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:42 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:42.610067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:42.614295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:42.640740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:42.645641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:42.649000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:42.650171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:42.650989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:42.652227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:42.666331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:42.670411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:42.671896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:42.674336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:42.676782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:42.680143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:42.872468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.885420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.891287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:42.892544 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a3e6690-353d-48a7-9ab1-323b44e79556 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.313337 Aug 29 10:47:42.893109 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1521/3083] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:42 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:42.912820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Action: 'create', calling method: .version_select at 0x7f66c63e2f70>, body: {"security_group_rule": {"parent_group_id": "921c57c1-ff5e-4894-b0b7-e74cb33f2c10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:43.323085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:43.336732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:43.337660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Neutron security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 not found {{(pid=128682) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:47:43.338342 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.338342 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.339747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cc3c2f5b-4824-41ed-9a7f-449abb7d0eff tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1453 microversion: 2.1 time: 0.739929 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 138 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: {"security_group_rule": {"parent_group_id": "921c57c1-ff5e-4894-b0b7-e74cb33f2c10", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'security_group_rule': {'parent_group_id': '921c57c1-ff5e-4894-b0b7-e74cb33f2c10', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:43.340494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 404 to user: Security group 921c57c1-ff5e-4894-b0b7-e74cb33f2c10 does not exist Aug 29 10:47:43.346281 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-b986d748-a96c-41e1-a267-2a18a88f80d1'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:43.351273 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e8e18a6-df04-40fc-8221-0350097b37fc tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.438101 Aug 29 10:47:43.351273 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1522/3084] 10.222.0.47 () {60 vars in 1195 bytes} [Mon Aug 29 10:47:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:43.354418 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1563/3085] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:42 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1453 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:43.384551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:43.391415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:43.392056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:43.397529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:43.417828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:43.419144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:43.420402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:43.422463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:43.423112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:43.423791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:43.424403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:43.424860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:43.425249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:43.425585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:43.426104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:43.426639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:43.811648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:43.839418 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c92ca659-e392-444e-b9cd-500e0dd33fa3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1274 microversion: 2.1 time: 0.487069 Aug 29 10:47:43.840014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1523/3086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:43 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1274 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:43.882023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c64278b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:43.960794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG neutronclient.v2_0.client [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist", "detail": ""}} {{(pid=128682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:47:43.961395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.security_group_api [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Neutron security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a not found {{(pid=128682) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 29 10:47:43.961951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] HTTP exception thrown: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.961951 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Request method failure captured: Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-security-group-rules/3aeecc89-2d5b-490c-9fed-4db03b127a4a HTTP/1.1 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk9eq8pVJxOf808fUQkHjqVr8T9NSDNhYqmnWb_5RqVS1k-DoOcHRlss7_mvDuqiPTFjXOAdBvn_ryGe4XAJ_lGAabkb0fWJo4pw0Ft93DTBVuQq8VcteN_j_is152DcQAJQodj6Jqdxsl7hpfY9VdhkPGC52hIuqkSiGkNcDBfQFc Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f7eda33f5e764bc9bc626a1dfc6fcf8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f7eda33f5e764bc9bc626a1dfc6fcf8c Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6b539442d4ee48e1a3abcb7168a83524 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-427596369-project Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: exception: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3aeecc89-2d5b-490c-9fed-4db03b127a4a'} Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:47:43.963780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Returning 404 to user: Security group rule 3aeecc89-2d5b-490c-9fed-4db03b127a4a does not exist Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: Neutron server returns request_ids: ['req-bf47cc3c-bbb0-47a8-8133-df5d00158de7'] {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-343e0f0e-706c-4967-abd2-f1a2e809c723 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/3aeecc89-2d5b-490c-9fed-4db03b127a4a" status: 404 len: 199 microversion: 2.1 time: 0.088557 Aug 29 10:47:43.970098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1524/3087] 10.222.0.47 () {58 vars in 1287 bytes} [Mon Aug 29 10:47:43 2022] DELETE /compute/v2.1/os-security-group-rules/3aeecc89-2d5b-490c-9fed-4db03b127a4a => generated 199 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:47:43.973990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:43.973990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:43.999681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:44.007531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.008024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.008864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:44.012996 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4373959f-8002-4d54-b71e-dfe60609a258 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.657159 Aug 29 10:47:44.015701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.016488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.016972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.017401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.030289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1564/3088] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:43 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:44.037453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:44.037453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:44.059721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.061096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.063814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.064674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.066093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.067026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.158046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lazy-loading 'flavor' on Instance uuid ba58c202-2540-4594-b2ae-878e488cfeee {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:47:44.209356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'shelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state shelved_offloaded Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 14 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: {"shelve": {}} Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'shelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state shelved_offloaded Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'shelve': {}}} Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:47:44.218288 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state shelved_offloaded Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state shelved_offloaded Aug 29 10:47:44.223302 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:47:44.225866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'shelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state shelved_offloaded {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:47:44.231044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30380be6-247a-4ae9-bacb-4501f7b74f01 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 155 microversion: 2.1 time: 0.261941 Aug 29 10:47:44.232027 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1525/3089] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:47:43 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 155 bytes in 266 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:47:44.251939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:44.252960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:44.273822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.274597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.275441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.280485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.280987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.281433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.311452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:44.329012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-75e06779-fe0d-462b-81b9-714adb7d3df2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1285 microversion: 2.1 time: 0.304041 Aug 29 10:47:44.344668 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1565/3090] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:44 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:44.349847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-589c1743-9bae-48c7-825a-169a1d5d52ab tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c76aeaf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:44.539899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:44.564550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:44.577723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:44.579197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fbf67666-a467-4b00-b8a5-942d20d8f541 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.341705 Aug 29 10:47:44.586004 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1526/3091] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:44 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:44.601570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:44.602212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:44.641145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.641766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.647981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.650602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:44.655293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:44.655764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:44.844317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128682) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 10:47:45.015741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2fede2a-c2e8-4653-97bf-ff86f2de4cd9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.428530 Aug 29 10:47:45.022222 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1527/3092] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:47:44 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:45.038523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:45.039157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:45.058335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:45.060662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:45.061352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:45.066290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:45.066806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:45.067260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:46.153250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:46.170159 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-172b28fb-9a21-4413-8b05-bfd22223e88a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 1.144606 Aug 29 10:47:46.201414 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1528/3093] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:45 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:46.217542 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-589c1743-9bae-48c7-825a-169a1d5d52ab tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/d8fff1b7-94e7-482b-ab2b-cabb2deeea59" status: 202 len: 0 microversion: 2.1 time: 1.871004 Aug 29 10:47:46.222697 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1566/3094] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:44 2022] DELETE /compute/v2.1/os-security-groups/d8fff1b7-94e7-482b-ab2b-cabb2deeea59 => generated 0 bytes in 1877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:46.224631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:46.225321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:46.228190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:46.229326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:46.252648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:46.253142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:46.253584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:46.255611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:46.258055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:46.258971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:46.261256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:46.263133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:46.264648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:46.266073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:46.266667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:46.267127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:46.924451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:46.939383 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cefcdd35-bd36-4ce2-bcd6-8db0f0bc9823 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.713645 Aug 29 10:47:46.942571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:46.943932 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1567/3095] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:46 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:46.959146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:46.962555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:46.967184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:46.967516 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd0401cd-81a8-4c98-8d1f-98fadfdb54c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1461 microversion: 2.1 time: 0.763362 Aug 29 10:47:46.968114 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1529/3096] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:46 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1461 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:46.995813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:46.996537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:47.009498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.016858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.017962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:47.020313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.025460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.026771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:47.038290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.039585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.042684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:47.046453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.048074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.049377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:47.372151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:47.394783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:47.396347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:47.397575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e97309b-2916-45da-b3a8-18e03e4de2d8 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.427933 Aug 29 10:47:47.398981 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1530/3097] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:46 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:47.403743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f0e3097-c726-4e01-9405-289dd60ed1a7 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c63c25e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:47.667903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:47.687402 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f279c7b3-b364-48f0-a8f1-c37822db3ff0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.741795 Aug 29 10:47:47.688211 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1568/3098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:46 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:47.692865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:47.693486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:47.707010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.707517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.707962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:47.708674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:47.709138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:47.709569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.061956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:48.070092 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a5587e3-35ca-4f36-801f-ca59bd3d6e19 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.380775 Aug 29 10:47:48.080973 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1569/3099] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:47 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:48.092102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ebb153-3529-4259-bb6e-a34116068b61", "tag": "ef3cb91c-8716-4a47-83e6-800275922dc4"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:48.126792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.127556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.128279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.184361 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] Creating event network-changed:ef3cb91c-8716-4a47-83e6-800275922dc4 for instance 89ebb153-3529-4259-bb6e-a34116068b61 on n-h1-854121-10 Aug 29 10:47:48.197942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-634ecb9a-1295-4453-b4cf-275db036d6d0 req-89211f26-e4b6-4c42-9fba-deb812068e91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114581 Aug 29 10:47:48.199463 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1570/3100] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:48.213620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:48.217320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:48.235201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f0e3097-c726-4e01-9405-289dd60ed1a7 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/8727a494-5d31-4398-941b-8b8e24be7bea" status: 202 len: 0 microversion: 2.1 time: 0.834963 Aug 29 10:47:48.236295 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1531/3101] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:47 2022] DELETE /compute/v2.1/os-security-groups/8727a494-5d31-4398-941b-8b8e24be7bea => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:48.241444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:48.242364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:48.249557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.256358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.257110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.258695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.262096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.262885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.264045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.264964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.266063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.266377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.266833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.267024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.535854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:48.590602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:48.682420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:48.706599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2bce7365-d038-4e0a-85a4-11a4f908e66c tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.502115 Aug 29 10:47:48.707310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1571/3102] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:48 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:48.722076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4cdf592-8324-431e-bda5-46eb42728132 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c6decaf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:48.774278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:48.783432 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-034556b1-57b4-406a-9b9e-5ac551128dfc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1461 microversion: 2.1 time: 0.545682 Aug 29 10:47:48.793488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1532/3103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:48 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1461 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:48.811183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:48.833979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.836724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.837471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.865728 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] Creating event network-changed:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:47:48.875390 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2e7a356f-f527-48f5-926e-d00df925f4ca req-d088de4a-c221-440b-a762-01fb4be5911c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079046 Aug 29 10:47:48.876662 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1533/3104] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:48.885906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:48.887138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:48.896025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.897341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.898208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:48.899010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:48.899674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:48.900311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.053396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:49.065579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:49.067346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:49.069024 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a5f882f7-ad6f-4e6b-bac8-5b3d4a1f2c71 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.191031 Aug 29 10:47:49.069843 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1534/3105] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:48 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:49.077134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.078116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:49.093359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.095831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.098250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.099232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.100065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.100669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.163550 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4cdf592-8324-431e-bda5-46eb42728132 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/1f9130fd-7cc9-4942-ba1d-640155a50001" status: 202 len: 0 microversion: 2.1 time: 0.455111 Aug 29 10:47:49.164148 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1572/3106] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:48 2022] DELETE /compute/v2.1/os-security-groups/1f9130fd-7cc9-4942-ba1d-640155a50001 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:49.169353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.170642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:49.183077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.184123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.184840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.186648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.187632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.188346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.343977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:49.351699 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b91bc099-53c5-41f1-bb75-ff9aeaf2bb57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.280674 Aug 29 10:47:49.352281 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1535/3107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:49 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:49.360865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73824346-e87e-4a06-968b-60d29d65198e tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c6353940>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.433691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:49.445092 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf3576a3-fa0a-4f34-89d7-f9a2fcf9e689 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.279670 Aug 29 10:47:49.446325 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1573/3108] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:49 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:49.580632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73824346-e87e-4a06-968b-60d29d65198e tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/3b92c06c-54aa-4352-86fc-a46c20fc391a" status: 202 len: 0 microversion: 2.1 time: 0.225387 Aug 29 10:47:49.582386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1536/3109] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:49 2022] DELETE /compute/v2.1/os-security-groups/3b92c06c-54aa-4352-86fc-a46c20fc391a => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:49.590990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5842c433-af1c-4fb8-8512-a66f2476d1c3 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] Calling method '.version_select at 0x7f66c6bfdee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.728105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.728723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:49.738173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.741732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.742400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.746155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.746638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.747071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.902908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5842c433-af1c-4fb8-8512-a66f2476d1c3 tempest-SecurityGroupRulesNegativeTestJSON-427596369 tempest-SecurityGroupRulesNegativeTestJSON-427596369-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/f70d4173-dabb-4b75-b328-874ea53e732a" status: 202 len: 0 microversion: 2.1 time: 0.316120 Aug 29 10:47:49.903496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1574/3110] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:47:49 2022] DELETE /compute/v2.1/os-security-groups/f70d4173-dabb-4b75-b328-874ea53e732a => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:47:49.908599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:49.909226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:49.928560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.929074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.929540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:49.930355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:49.930819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:49.931598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.215919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.225129 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0236eed4-3f4c-46c2-bbb4-efdfc84e6fb9 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.500904 Aug 29 10:47:50.226621 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1537/3111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:49 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:47:50.232605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:50.233426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:50.235698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:50.242682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.243398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.243991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.244874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.245482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.246090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.340592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.360745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.366413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.368137 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb9cdc75-7c93-4f0b-a042-3bf5b2b398f5 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.140419 Aug 29 10:47:50.383697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1538/3112] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:50 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:50.398114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:50.399021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:50.403538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.406982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.407721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.408356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.409282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.409984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.411151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.417225 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c680d9de-d33a-469f-8d1c-b61726350d45 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.512270 Aug 29 10:47:50.417865 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1575/3113] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:49 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:50.468780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:50.470077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:50.476961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.477879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.478517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.480275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:50.480936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:50.481561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:50.747316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.760953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:50.775648 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7067971f-05fe-4128-8c98-5cc5b3ae7438 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.390188 Aug 29 10:47:50.781321 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1539/3114] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:50 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:50.792652 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cca18495-345b-479a-8d46-7e1f41645b7d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.329901 Aug 29 10:47:50.794579 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1576/3115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:50 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:47:51.238543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b32712b0-6e4d-48b2-89a1-7552bbdd087d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Action: 'create', calling method: .version_select at 0x7f66c6388940>, body: {"keypair": {"name": "tempest-keypair-758768027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQuELCtPnnfq5TG1ovk0Ge2vfeix40j8fMs4Qt4qOGgJWOmXk0BDeWPVtrdS7knFRPDWvQ5+25IB4k0b7mBz0P/TVEIZ2ANl8t3HCZkbJ8xOScsO1grgKpiXPoySPAx0g=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:51.246198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:51.246821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:51.262511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.266645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.267108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.267853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.268316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.268743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.269335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:51.309308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b32712b0-6e4d-48b2-89a1-7552bbdd087d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:51.325211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b32712b0-6e4d-48b2-89a1-7552bbdd087d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for user 1fbfc61871ca4d42916442e0f674fd26 and project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:51.383419 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b32712b0-6e4d-48b2-89a1-7552bbdd087d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253136 Aug 29 10:47:51.384424 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1540/3116] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:47:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:51.390165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051c2ddf-6c5a-49ef-a763-3e1476dfc01a", "tag": "57b4443a-f387-4860-8f11-55677a478125"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:51.403198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.404077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.405387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.417875 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] Creating event network-changed:57b4443a-f387-4860-8f11-55677a478125 for instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a on n-h1-854121-10 Aug 29 10:47:51.424626 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dac6a3b3-7819-4981-bbab-e768427eb57c req-529c4096-6633-4179-bc48-e3e0261945f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038682 Aug 29 10:47:51.426267 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1541/3117] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:51.434510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:51.437032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:51.447560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.448404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.449152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.450103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.451691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.452913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.571198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:51.599866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:51.604927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:51.608929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73ee4730-8bfa-42fc-9e2e-c4ce5e215152 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.179739 Aug 29 10:47:51.611699 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1542/3118] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:51 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:51.623429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:51.626103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:51.627707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:51.637081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9791ae7-acc3-4c21-bcee-c5d895ad9226 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.394827 Aug 29 10:47:51.643857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.648477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.649284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.651603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.652919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.655717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.655863 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1577/3119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:51 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:47:51.796918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:51.797535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:51.806922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.807681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.820094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:51.821205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:51.821887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:51.822486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.096832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.114444 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77104088-150e-4a72-aac6-99881616356b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.501426 Aug 29 10:47:52.136310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1543/3120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:51 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:52.148157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:52.149199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:52.159918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.160844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.161493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.162513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.164077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.164691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.182582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.192728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44b43c3b-4a27-4c88-b022-5b6818cf08b5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.400014 Aug 29 10:47:52.194155 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1578/3121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:51 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:52.415082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.425270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae0892ca-1dcb-48b0-b2c6-ee210a2c861b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.287476 Aug 29 10:47:52.444727 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1544/3122] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:52 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:52.650241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:52.662881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:52.663033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:52.663606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:52.672331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=20 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:52.678264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.679035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.680377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.681276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.683666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.686195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.686998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.689290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:52.690003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.690602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.691196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:52.691986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:52.875073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.890667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.892912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:52.894542 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a6ba9ef-ea87-4e29-860a-ea48491b109d tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.258152 Aug 29 10:47:52.911332 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1579/3123] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:52 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:53.021739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:53.033982 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2397860f-6c42-4b6b-a78b-05fb735257d1 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.374257 Aug 29 10:47:53.036927 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1545/3124] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:52 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:47:53.142986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:53.143884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:53.156062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.156822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.157462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.158797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.161841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.163447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.217858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:53.219488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:53.238382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.239584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.240937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.242012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.242736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.243529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.782636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:53.792326 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-875f7e37-d4be-41d5-b824-14388c22a283 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.654240 Aug 29 10:47:53.809681 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1580/3125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:53 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:53.809681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:53.810419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:53.849360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.852332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.852983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.853993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.854224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.858673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.866611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:53.874932 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-91349df2-403e-4481-acb4-7fdd72bce8ac tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.662501 Aug 29 10:47:53.875851 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1546/3126] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:53 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:47:53.927755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:53.928490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:53.934945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.942615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.947408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:53.948387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:53.949930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:53.951525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.133452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:54.148545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:54.150374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:54.151952 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5332d712-16bd-4b09-810a-882ca7743bb0 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.237634 Aug 29 10:47:54.153317 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1547/3127] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:53 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:54.159994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:54.160933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:54.168468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.169004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.169894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.170701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.171252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.172036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.189325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:54.210754 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1f5e3d9-605d-4cd8-9435-63a7db5d322a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.411492 Aug 29 10:47:54.211816 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1581/3128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:53 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:54.487401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:54.498216 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b521ec7-06a7-4f22-be65-c4353eab0046 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.342924 Aug 29 10:47:54.521675 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1548/3129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:54 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:54.822279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:54.823081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:54.849589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.850332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.854539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.855456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.858544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.859343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.898202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:54.899282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:54.917338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.918343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.921915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:54.923460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:54.927244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:54.929870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.478078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:56.498042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c79e6855-1ab8-4882-8390-47b37954ecda tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 1.681112 Aug 29 10:47:56.499999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1582/3130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:54 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:56.535469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:56.536198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:56.555029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.555470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.559184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.560251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.563576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.567397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.633108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:56.645514 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2fd26c82-46ad-4505-a44b-fe499c29e4f0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 1.752631 Aug 29 10:47:56.648838 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1549/3131] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:54 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:56.660897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:56.661794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:56.675321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.679141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.680430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.681339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.682242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.684261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.866681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:56.878675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:56.892936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:56.894209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2eebf9d7-fd3f-432c-b591-f0e1f323873f tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.391391 Aug 29 10:47:56.894773 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1583/3132] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:56 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:56.907742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:56.912059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:56.932658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.933457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.934127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:56.937889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:56.938657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:56.939265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:57.327932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:57.356514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:57.367808 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02e443e4-db0a-42db-ba34-4b01eaf50d90 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.713238 Aug 29 10:47:57.381737 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1550/3133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:56 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:57.393263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ebb153-3529-4259-bb6e-a34116068b61", "name": "network-vif-plugged", "status": "completed", "tag": "ef3cb91c-8716-4a47-83e6-800275922dc4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:57.447399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:57.448362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:57.448818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:57.496209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] Creating event network-vif-plugged:ef3cb91c-8716-4a47-83e6-800275922dc4 for instance 89ebb153-3529-4259-bb6e-a34116068b61 on n-h1-854121-10 Aug 29 10:47:57.521990 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4de6fcf5-dda0-4cf8-8864-75b8de3d036a req-45e813ad-c3a6-4e63-b0ec-f0b4430a80b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148250 Aug 29 10:47:57.524085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1551/3134] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:57.551023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47edbce3-17f5-44f4-95fe-86beed225a27 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: .version_select at 0x7f66c6349a60>, body: {"keypair": {"name": "tempest-keypair-552193147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQe9y5wJ3+ShZjSOPYEAFSqY9Ej48aD1ee8rCwVSCnu2yeJ18dzZ6UhMjwIjO0PPY8Xpat0fUcg2g0tdaVsFjtrMF/1T16t0bysZ3XY5Ap9ESj0p6TJrmDQJTT7rX7dVA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:57.602022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-47edbce3-17f5-44f4-95fe-86beed225a27 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:47:57.615309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:57.627864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-47edbce3-17f5-44f4-95fe-86beed225a27 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:47:57.642630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52cbcd7a-31f5-48e9-a36d-935f82f1f691 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.743891 Aug 29 10:47:57.671611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1584/3135] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:56 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:57.681994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:57.692633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:57.709459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:57.711604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:57.711863 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-47edbce3-17f5-44f4-95fe-86beed225a27 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186376 Aug 29 10:47:57.713409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:57.714339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:57.714631 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1552/3136] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:47:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:47:57.715210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:57.715795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:57.719969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:47:57.728916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:57.729736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:57.747975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:57.748762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:57.749489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:57.750505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:57.751138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:57.751732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:58.268295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:58.291368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d62abb3-2180-4df9-bda7-0ea775a11d42 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.612522 Aug 29 10:47:58.293903 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1585/3137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:57 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:58.313388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:58.315339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:58.346264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:58.346785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:58.347240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:58.347990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:58.348457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:58.348891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:58.569580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:58.590680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:58.596793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:58.600997 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45135f20-6102-4c7b-a196-643770cd287c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.303405 Aug 29 10:47:58.604741 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1586/3138] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:47:58 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:47:58.618250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1049483072", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8c78f43c-47f9-4b51-8862-173bb427b1d7"}], "security_groups": [{"name": "tempest-securitygroup--1566771391"}], "key_name": "tempest-keypair-758768027", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:47:59.083116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:59.093573 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1029da4-b1a7-489b-b4e8-f51c787dd467 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 1.377811 Aug 29 10:47:59.113836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1553/3139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:57 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:59.124532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:59.136309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:59.153862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:59.154535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] validate_networks() for [('8c78f43c-47f9-4b51-8862-173bb427b1d7', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:47:59.154944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:59.155409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:59.156116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:59.156580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:59.157014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:59.730456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:47:59.743809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab26b100-1b91-4abe-bd93-7e49f5049b89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.626890 Aug 29 10:47:59.744408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1554/3140] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:59 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:47:59.752482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:47:59.758103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:47:59.775254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:59.775756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:59.776400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:47:59.777130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:47:59.777590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:47:59.778047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.401731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:00.414904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c22b3ad0-6498-4901-b892-3de0cda07335 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1351 microversion: 2.1 time: 0.665596 Aug 29 10:48:00.436792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1555/3141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:47:59 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1351 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:00.447969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:00.454773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:00.484512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:00.485158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:00.487062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.488762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:00.492146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:00.495867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.507361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:48:00.527992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for user 1fbfc61871ca4d42916442e0f674fd26 and project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: dict_keys(['metadata_items']) {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:48:00.573511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:00.633661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:48:00.636929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:48:00.640151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:48:00.642057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:48:00.644431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:48:00.676386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:00.678708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:00.679806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.685763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:00.688398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:00.689168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.758302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:48:00.775574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Getting quotas for user 1fbfc61871ca4d42916442e0f674fd26 and project 8c6bfe0f01c849c5a54583df4c61dfb3. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:48:00.811696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:48:00.822343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:48:00.918486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82e26578-4d3c-468c-969e-b2fccb73d175 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.310992 Aug 29 10:48:00.920987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1587/3142] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:47:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:48:00.926378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "name": "network-vif-plugged", "status": "completed", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:00.950745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:00.953853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:00.954851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:00.997048 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] Creating event network-vif-plugged:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:48:01.017849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5bbd65a4-3ca1-49c4-9e8c-7a8d60234fd4 req-394cb156-5dd3-4893-b75a-fc3b7a6ad509 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089665 Aug 29 10:48:01.020857 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1588/3143] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:01.022391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:01.034954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab9fb766-16d2-4d47-b3e3-d53e4753a996 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.595552 Aug 29 10:48:01.037509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:01.042031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:01.050237 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1556/3144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:00 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:01.057674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:01.059655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:01.094692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.100927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.101993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.102183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.102590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:01.103156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:01.103345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.103810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.104239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:01.105104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.112388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.115126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:01.660265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:01.690595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:01.696712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:01.715557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f40475f-7c28-48da-bf6f-447b7016ea4a tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.692222 Aug 29 10:48:01.729728 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1589/3145] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:01 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:48:01.729728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:01.729728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:01.748854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.749365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.765252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:01.767458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:01.781945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:01.785125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.144552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:02.162792 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d5c6f6d3-23b3-434d-a0c8-bb7e3d842d89 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 1.110689 Aug 29 10:48:02.164966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1557/3146] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:01 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:02.186274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:02.187922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:02.223136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.223564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.224079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.224716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.225132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.225554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.433013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:02.444136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b676891-3551-4f9f-9a58-e13383b82aeb tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1273 microversion: 2.1 time: 0.277572 Aug 29 10:48:02.445733 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1558/3147] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:02 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:02.452895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:02.457130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:02.472845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.473824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.474492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.475433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.476247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.477753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.512359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:02.521264 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-70bdb3f5-53d2-4149-ba37-1baecbb37666 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1316 microversion: 2.1 time: 0.802928 Aug 29 10:48:02.533745 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1590/3148] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:01 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:02.549308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:02.550084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:02.583727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.595054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.595673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.596477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.607034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.608191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.809147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:02.820289 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9da78b3b-2fdb-468a-9f12-a7dcb5de7111 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1541 microversion: 2.1 time: 0.372679 Aug 29 10:48:02.826630 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1559/3149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:02 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1541 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:02.832299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:02.836536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:02.849886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.852953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.853657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:02.855575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:02.858383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:02.859546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.006903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.022203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.024725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.025453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.027307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2d7deba-7715-47aa-846e-a9f4080dec0c tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.199399 Aug 29 10:48:03.028558 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1560/3150] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:02 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:48:03.035793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:03.036479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:03.058076 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d77ea9fa-9c24-4609-91ce-02f220e8e458 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.534330 Aug 29 10:48:03.061185 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1591/3151] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:02 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:03.076844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051c2ddf-6c5a-49ef-a763-3e1476dfc01a", "name": "network-vif-plugged", "status": "completed", "tag": "57b4443a-f387-4860-8f11-55677a478125"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:03.081427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.083836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.084929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.087327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.090233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.092106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.111589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.112090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.112534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.148407 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] Creating event network-vif-plugged:57b4443a-f387-4860-8f11-55677a478125 for instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a on n-h1-854121-10 Aug 29 10:48:03.159307 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fd5b6993-0845-4044-96f0-5e203a9b4379 req-1ef2c258-828e-4a6f-aca9-2a8d21b5b328 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088253 Aug 29 10:48:03.162771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1592/3152] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:03.190129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:03.190837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:03.198930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.199430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.203545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.206251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.207180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.209263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.307870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e82f8a9-9cf6-43e6-830f-1dff2cb395cd tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276614 Aug 29 10:48:03.309211 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1561/3153] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:48:03 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:03.469459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:03.470101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:03.484333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.494149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.494845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.495760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.496377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.496973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.782907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.802956 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f8a89dc7-54fa-469b-9487-41bbf6274240 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1273 microversion: 2.1 time: 0.338310 Aug 29 10:48:03.807194 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1562/3154] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:03 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:03.825770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:03.828346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:03.849262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.850588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.852978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.856711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:03.858652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:03.861459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:03.862246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:03.872337 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4e4955af-dd9c-4fb6-ba57-1f1699452269 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.688982 Aug 29 10:48:03.896601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1593/3155] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:03 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:04.058725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:04.060340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:04.071582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.074309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.077647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:04.081510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.082321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.083021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:04.184425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:04.197001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80ca5875-2dd4-491e-8598-eae636e25c7a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1505 microversion: 2.1 time: 0.388372 Aug 29 10:48:04.210379 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1563/3156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:03 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:04.221823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:04.222450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:04.242904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.243400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.243857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:04.244588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.247226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.248432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:04.293180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:04.317569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:04.319309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:04.330851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82ce99b3-be6a-4c87-9c86-27cc8a29554b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1604 microversion: 2.42 time: 0.272109 Aug 29 10:48:04.331948 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1594/3157] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:04 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:48:04.342007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-474219234"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:04.346927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:04.363903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.364751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.366032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:04.367222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:04.369303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:04.370062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:05.606531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:05.625528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c47be82-6adb-4167-85cd-5a3c82c3e926 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 1.413918 Aug 29 10:48:05.626135 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1564/3158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:04 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:05.630971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:05.632592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:05.647688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:05.648437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:05.649051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:05.649961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:05.651258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:05.652002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:05.708868 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Adding security group 71761f48-ba6b-4154-b824-8c487ef390a8 to port 06afd132-f81d-4842-8cfd-230d495299ad Aug 29 10:48:05.782696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:05.796052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3006a0f7-2ba7-4564-9056-0eacc045a015 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1321 microversion: 2.1 time: 0.168676 Aug 29 10:48:05.798809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1565/3159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:05 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:05.808704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:05.812098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:05.835484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:05.836087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:05.836731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:05.838764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:05.839622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:05.840241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:06.308593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:06.327880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-619116c6-2012-4f42-9fb7-1de98867fa0d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1315 microversion: 2.1 time: 0.527940 Aug 29 10:48:06.344535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1566/3160] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:05 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:06.351581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:06.352625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:06.360295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:06.360868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:06.361524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:06.362371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:06.363159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:06.363793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:06.406902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:06.407458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:06.407950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:06.408411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lazy-loading 'fault' on Instance uuid c23efe6f-782b-497e-b0f9-cd7bc2248ef6 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:06.472512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:06.483495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:06.485012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:06.486259 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce89b01d-e2d4-4f8b-bba2-e96d55970eb2 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1609 microversion: 2.42 time: 0.140549 Aug 29 10:48:06.486857 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1567/3161] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:06 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1609 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:48:06.492268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1805000463", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db70ecf5-8fd1-4a4e-acd4-79d8294a110e"}], "security_groups": [{"name": "tempest-securitygroup--1956546513"}], "key_name": "tempest-keypair-552193147", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:06.694756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] validate_networks() for [('db70ecf5-8fd1-4a4e-acd4-79d8294a110e', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:48:06.709776 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b7757c5-d5e5-468c-b291-0a3cd9f0669a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action" status: 202 len: 0 microversion: 2.1 time: 2.376510 Aug 29 10:48:06.714952 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1595/3162] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:04 2022] POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action => generated 0 bytes in 2382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:06.721455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:06.722412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:06.729210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:06.729824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:06.730346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:06.731136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:06.731674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:06.732305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.215838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:07.231696 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1454b65-4279-4f5f-a72a-4bff86b7ff27 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.515319 Aug 29 10:48:07.232343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1596/3163] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:06 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:07.245943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6e7e700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:07.503364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use.", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:07.504311 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.504311 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8 HTTP/1.1 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: exception: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '71761f48-ba6b-4154-b824-8c487ef390a8'} Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:07.506674 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] Aug 29 10:48:07.511379 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:07.516102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 400 to user: Security Group 71761f48-ba6b-4154-b824-8c487ef390a8 in use. Aug 29 10:48:07.516102 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-72ec2e2f-2f14-4998-8017-cc1789826d9f'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:07.517492 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f9228dc-3e6a-4e8c-95f7-45670e5a2161 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8" status: 400 len: 185 microversion: 2.1 time: 0.278769 Aug 29 10:48:07.518626 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1597/3164] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:07 2022] DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8 => generated 185 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:07.523419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:07.537456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.547984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.549012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.563436 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] Creating event network-changed:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:48:07.585825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fbb5dc1c-bd8d-440a-8ed0-1b8c94f5b33a req-a0fd80ef-84e8-4340-a5c0-c8de0133c4bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065244 Aug 29 10:48:07.587572 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1598/3165] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:07.597872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:07.598943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:07.608766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.609668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.610361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.611318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.612014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.612565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.665007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:07.765291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:07.777314 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bc95d9ef-5d20-4971-a3db-a4eba06d458d tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1321 microversion: 2.1 time: 0.188097 Aug 29 10:48:07.796510 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1599/3166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:07 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:07.809424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:48:07.810090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:48:07.812524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:48:07.815254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:48:07.820257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:48:07.826923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:07.828021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:07.845586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.846199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.848090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.848859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.849560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.850280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.851255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.852263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:07.853378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.854285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:07.854836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.855393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:07.897264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:48:07.913112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:48:07.964022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:48:07.971521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:48:08.103748 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c7e780b-53ab-4882-a239-b81b7b34fdda tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.615541 Aug 29 10:48:08.104432 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1568/3167] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:48:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:48:08.126229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:08.126912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.150679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:08.156917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.158433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.161234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.164991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.171760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:08.177220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.189322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.205137 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ba5a3b1-71dc-4190-86c0-fb0c57ff3657 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1501 microversion: 2.1 time: 0.406657 Aug 29 10:48:08.208147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1600/3168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:07 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1501 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:08.218593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:08.221412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.239586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.242415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.243104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.246914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.247647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.249877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.298965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.302191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.303120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.306343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lazy-loading 'fault' on Instance uuid c23efe6f-782b-497e-b0f9-cd7bc2248ef6 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:08.316945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:08.455930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:08.473431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:08.474932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e6b9a6bbfcd45b19d5fd0eb07d1dccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf878bae1464083abe2ebea0b534c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:08.488269 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-37a137d4-dbd7-48e8-8bc1-5553c29928dd tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 200 len: 1609 microversion: 2.42 time: 0.378526 Aug 29 10:48:08.488876 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1569/3169] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:08 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 1609 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:48:08.511244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c93f363-19d6-45d5-a0f6-25929f5e0794 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:08.514342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c93f363-19d6-45d5-a0f6-25929f5e0794 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.559420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-384e488b-6cc2-407a-aef3-8282bdce9a89 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action" status: 202 len: 0 microversion: 2.1 time: 0.347888 Aug 29 10:48:08.561320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1601/3170] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:08 2022] POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:08.577605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:08.582639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.619539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.622363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.626273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.627150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.627581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.635427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.698878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c93f363-19d6-45d5-a0f6-25929f5e0794 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:08.707394 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c93f363-19d6-45d5-a0f6-25929f5e0794 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1241 microversion: 2.1 time: 0.217407 Aug 29 10:48:08.724156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1570/3171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:08 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1241 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:08.737241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:08.740106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.759114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.760636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.761024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.761840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.762295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.768932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.901071 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d38c9488-0195-4c6b-a195-320b235da7b6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a/action" status: 202 len: 0 microversion: 2.1 time: 0.337609 Aug 29 10:48:08.906508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1602/3172] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:08 2022] POST /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:08.913793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:08.914654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:08.921564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.926036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.929237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:08.930348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:08.932678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:08.933467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.273734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:09.285374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0278d8c-da00-4bf0-b741-71492eef307b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.558396 Aug 29 10:48:09.286383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1571/3173] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:08 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:09.292139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.293038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:09.311629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.314091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.314706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.315791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.316546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.317111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.352067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:09.355087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:09.370919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0cc96e38-e85b-4dfa-b740-18b2fa86cb45 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1575 microversion: 2.1 time: 0.462020 Aug 29 10:48:09.391492 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1603/3174] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:08 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1575 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:09.400203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.406735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:09.415419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.416054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.416799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.417722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.418484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.419160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.489661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:09.499102 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ab1d19c-2276-4bfa-b613-5cc4f40d345f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1327 microversion: 2.1 time: 0.211098 Aug 29 10:48:09.500400 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1572/3175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:09 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1327 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:09.516877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.517920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:09.532186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.533217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.535057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.541515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.542430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.543295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.574752 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] HTTP exception thrown: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Request method failure captured: Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 HTTP/1.1 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJe1SDUbjs-6UHTrZPpGLMdN1QDGiD71SpufLYBjWrSjADeikYaYxtPh89V4SLCIT7mrjO2lA9AWAbTScktW9ZOWhVEgHuwP2lb4i0Odik7z9fxoQU_3OeyL9P2B5csB0kBsiKUkliJk1mJCiWSRw-MkVQ8piMIB2BWWS-Tbg1dd-eo Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2e6b9a6bbfcd45b19d5fd0eb07d1dccb Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c23efe6f-782b-497e-b0f9-cd7bc2248ef6'} Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:09.577036 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:09.582643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Returning 404 to user: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:09.583564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c106d16-9209-4f86-ae06-6855904b6ad4 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 404 len: 111 microversion: 2.42 time: 0.070385 Aug 29 10:48:09.600869 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1573/3176] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:09 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:48:09.609034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0bbdc5cc-fc6e-4421-8347-722ff419415b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '.version_select at 0x7f66c6427e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.648547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0bbdc5cc-fc6e-4421-8347-722ff419415b tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914786520" status: 204 len: 0 microversion: 2.42 time: 0.037626 Aug 29 10:48:09.653385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1574/3177] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 10:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914786520 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:48:09.674253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ebb153-3529-4259-bb6e-a34116068b61", "tag": "ef3cb91c-8716-4a47-83e6-800275922dc4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:09.694306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.695264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.695930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.710475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] Creating event network-changed:ef3cb91c-8716-4a47-83e6-800275922dc4 for instance 89ebb153-3529-4259-bb6e-a34116068b61 on n-h1-854121-10 Aug 29 10:48:09.718368 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-de525332-4ec2-4000-8478-4171e568e077 req-5ae9d7de-ac27-40fa-9506-8450d145992e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061308 Aug 29 10:48:09.719854 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1575/3178] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:09.735771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.736759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:09.746278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.748231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.749780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.750945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.751753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.752232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:09.753157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.767291 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-608757db-b75d-4088-b893-7ba2ff5d2fd4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1486 microversion: 2.1 time: 0.374045 Aug 29 10:48:09.767885 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1604/3179] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:09 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:09.798244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:09.799009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:09.811938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.813773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.815854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.817653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:09.818849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:09.820616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:09.867141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:48:09.898440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:09.918449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51919134-47b5-4fc5-91f4-d17b8758b805 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1293 microversion: 2.1 time: 0.182759 Aug 29 10:48:09.919272 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1576/3180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:09 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:10.037099 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61a836f4-5d59-4f34-8624-24a0fa7cc9be tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 204 len: 0 microversion: 2.1 time: 0.244834 Aug 29 10:48:10.050346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1605/3181] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:09 2022] DELETE /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:48:10.050718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:10.051616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:10.061088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.062273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.063392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.066277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.067427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.067923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.307970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:10.308680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:10.323031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.334553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.335274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.336233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.336882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.337486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.422891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:10.436115 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41c18597-2f0f-4d34-9d19-d43fda1e86f8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1492 microversion: 2.1 time: 0.389371 Aug 29 10:48:10.437088 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1577/3182] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:10 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1492 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:10.447964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:10.449235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:10.475934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.483386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.483843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.484590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.485264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.486009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.700425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:10.730883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82116122-140e-4d14-811e-9cc995b42752 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.426675 Aug 29 10:48:10.733603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1606/3183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:10 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:10.742846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:10.743343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:10.751499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:10.759239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.759937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.760491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.761821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.762448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.763304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.794241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:10.882798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:10.885579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:10.892364 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2da6644f-5b78-40ba-a4df-773561ac28ac tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1575 microversion: 2.1 time: 0.449844 Aug 29 10:48:10.906424 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1578/3184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:10 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1575 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:10.918326 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-796924da-9244-43dd-b68f-641d7f313ea7 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1327 microversion: 2.1 time: 0.180989 Aug 29 10:48:10.921366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1607/3185] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:10 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:10.943696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:10.944320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:10.952569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.953318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.953994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:10.955245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:10.957165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:10.958284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:11.095936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:11.116358 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-387ed1fb-5866-4adc-ad90-c13b3d5706d4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1293 microversion: 2.1 time: 0.176375 Aug 29 10:48:11.132148 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1579/3186] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:10 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:11.473261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:11.474227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:11.482833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:11.483696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:11.484163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:11.484875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:11.485336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:11.489928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:11.759115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:11.759728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:11.774164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:11.774882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:11.775496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:11.783917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:11.784415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:11.784859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.333733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:12.345439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b5b4690-7d0a-411e-add1-f4742c9f285a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1492 microversion: 2.1 time: 0.884096 Aug 29 10:48:12.346402 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1608/3187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:11 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1492 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:12.355932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:12.362545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:12.378429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.379038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.379423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.380585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.380962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.382755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.633083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:12.646008 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d18a25a8-0014-4545-8a21-b770690f718a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.890553 Aug 29 10:48:12.662056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1580/3188] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:11 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:12.667787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:12.668837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:12.676013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.678739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.679443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.680365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.681063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.681663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.768058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:12.784446 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25eb0fec-5e91-4700-bec2-d1566732d11e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1575 microversion: 2.1 time: 0.436231 Aug 29 10:48:12.806610 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1609/3189] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:12 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1575 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:12.818316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:12.819927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:12.833318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.834132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.834589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.835485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:12.836109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:12.836849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:12.989339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:12.998569 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bfa49da2-0498-467c-86c1-3c7c8c190341 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1299 microversion: 2.1 time: 0.190510 Aug 29 10:48:13.000465 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1610/3190] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:12 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:13.009819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "name": "network-vif-plugged", "status": "completed", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:13.039422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.053113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.054225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.083309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] Creating event network-vif-plugged:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:48:13.090106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-74c4b001-854d-436c-9303-f8f4e8adcfbe req-3b1ce490-65eb-4449-9c2e-0bf9c3cb5219 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087030 Aug 29 10:48:13.091458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1611/3191] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:13.371676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:13.372388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:13.379982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.380710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.381152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.381884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.382341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.382768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.402994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:13.419092 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d18bf465-1045-45aa-adde-e9f6bd9a7809 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.752676 Aug 29 10:48:13.421395 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1581/3192] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:12 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:13.674968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:13.676177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:13.690188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.692723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.693438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.698924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.700543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.702777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.738786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:13.751584 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f392b65-5c25-4e6c-9bcc-277a9ffa6a0b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1492 microversion: 2.1 time: 0.384953 Aug 29 10:48:13.754742 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1612/3193] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:13 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1492 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:13.818524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:13.819823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:13.828369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.829271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.833016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:13.834750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:13.836407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:13.838629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.177377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:14.192726 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-249b8740-4604-487e-92f2-970479290230 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.528275 Aug 29 10:48:14.206172 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1582/3194] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:13 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:14.206172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:14.206172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:14.215343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.216081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.217347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.218656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.219434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.220405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.324007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:14.329894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:14.351932 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d067cc6-a81c-4ade-8e4f-95c66723a052 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1575 microversion: 2.1 time: 0.538009 Aug 29 10:48:14.385398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1be211f3-3807-4b5e-a097-391c7569f46f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1299 microversion: 2.1 time: 0.190577 Aug 29 10:48:14.386234 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1583/3195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:14 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:14.394346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1613/3196] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:13 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1575 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:14.409189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051c2ddf-6c5a-49ef-a763-3e1476dfc01a", "name": "network-vif-deleted", "tag": "57b4443a-f387-4860-8f11-55677a478125"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:14.425411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.425940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.426386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.439421 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] Creating event network-vif-deleted:57b4443a-f387-4860-8f11-55677a478125 for instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a on n-h1-854121-10 Aug 29 10:48:14.441975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:14.442758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:14.445943 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-efb990e4-32fa-4aae-a638-7dd87da35113 req-e0c46427-ec8f-45f6-ad47-df626a972c43 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046185 Aug 29 10:48:14.446959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1584/3197] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:14.451588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.451795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.452900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.453554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.454040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.454477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.783793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:14.784509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:14.805655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.806410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.807023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.807909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.808623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.809215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.902445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:14.919279 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a10dd91a-c4c4-4c1f-82ea-ddf5c05d88db tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.482382 Aug 29 10:48:14.921454 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1614/3198] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:14 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:14.925688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.927910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.928504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:14.929131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'fault' on Instance uuid 051c2ddf-6c5a-49ef-a763-3e1476dfc01a {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:14.930452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a99905-761f-4dd1-9455-365346817589", "tag": "cb8b11e9-b1c7-4450-ab19-a96af3fe15b8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:14.954064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:14.954723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:14.955237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.000704 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] Creating event network-changed:cb8b11e9-b1c7-4450-ab19-a96af3fe15b8 for instance f0a99905-761f-4dd1-9455-365346817589 on n-h1-854121-10 Aug 29 10:48:15.010030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8c0aa27a-64df-4c93-accf-0af6964924b3 req-0d96d7fe-384a-407d-85f7-47184de236b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086989 Aug 29 10:48:15.019642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1615/3199] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:15.083613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:15.100264 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59ce7c9e-a52a-4bc9-bfcd-f9eb99d3cb23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 200 len: 1305 microversion: 2.1 time: 0.320549 Aug 29 10:48:15.108261 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1585/3200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:14 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 1305 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:15.162450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051c2ddf-6c5a-49ef-a763-3e1476dfc01a", "name": "network-vif-unplugged", "status": "completed", "tag": "57b4443a-f387-4860-8f11-55677a478125"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:15.184041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.184625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.185225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.217741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] Creating event network-vif-unplugged:57b4443a-f387-4860-8f11-55677a478125 for instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a on n-h1-854121-10 Aug 29 10:48:15.224063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:15.225146 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-035a725c-35a8-4f49-aa75-f3fe0099aa48 req-f8ab991b-b94e-4f30-8ae3-f32ef6481814 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065682 Aug 29 10:48:15.225391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:15.226549 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1616/3201] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:15.247756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.253197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.254886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.255824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.257397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.259659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.389262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:15.391347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:15.418392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.418897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.419333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.421009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.424593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.427044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.602330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:15.611779 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74131494-7e37-4df5-84f6-6d59044125f6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1519 microversion: 2.1 time: 0.401389 Aug 29 10:48:15.614528 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1586/3202] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:15 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:15.631622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:15.632375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:15.642046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.643649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.644296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.645192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.645913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.646505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.757975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:15.774323 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9c4f7400-9779-42bd-9166-4249bb3b235a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1299 microversion: 2.1 time: 0.146801 Aug 29 10:48:15.776337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1587/3203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:15 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:15.844985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:15.859983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08d8342e-46b4-4869-be44-294b53b0881a tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1575 microversion: 2.1 time: 0.485427 Aug 29 10:48:15.861659 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1617/3204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:15 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1575 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:15.940870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:15.941804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:15.948598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.958536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.959252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:15.959757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:15.964091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:15.964552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:16.134895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:16.135522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:16.144835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:16.148626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:16.149300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:16.150251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:16.153321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:16.154007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:16.195113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a HTTP/1.1 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '051c2ddf-6c5a-49ef-a763-3e1476dfc01a'} Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:16.197068 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:48:16.202305 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:16.208076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:16.209166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50dd99e9-2882-4605-9145-82b00e0829fc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 404 len: 111 microversion: 2.1 time: 0.078424 Aug 29 10:48:16.211185 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1618/3205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:16 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:16.277417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:16.295402 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e08d2f3-2770-4b82-aafc-acb02c75dc15 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.357576 Aug 29 10:48:16.296807 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1588/3206] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:15 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:16.525286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2069628766", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:16.634756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:16.635624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:16.649506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:16.654960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:16.655569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:16.656233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:16.656654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:16.657089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:16.668548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:48:17.868580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:17.900424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:17.913433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:17.916494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-924648a1-5b0a-4255-9824-dad95e6e64d4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 1.286404 Aug 29 10:48:17.918335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1589/3207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:16 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:17.928218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:17.931284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:17.946539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:17.947773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:17.949183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:17.950426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:17.952100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:17.953366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:18.420278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:18.432845 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ead75ad-010d-4739-8ef9-a4a8e0831621 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.513055 Aug 29 10:48:18.434309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1590/3208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:17 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:18.461608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:18.462240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:18.476503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:18.477507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:18.478193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:18.479634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:18.480323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:18.481026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:18.681864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:48:18.682415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:48:18.682771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:48:18.683196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:48:18.683610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:48:18.701279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:18.703246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:18.705426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:18.707307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:18.710293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:18.710786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:18.711232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:18.762131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:48:18.772575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:48:18.805426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:48:18.808828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:48:18.968059 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-613a2ec0-edf6-4551-9789-436d37766b2c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440671 Aug 29 10:48:18.971132 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1619/3209] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:48:18.983166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:18.984411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:18.987623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:19.010884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.015935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.019980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.022622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.023438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.024624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.066273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:19.080790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ea940c9d-3a28-4a20-9872-193330da670f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1573 microversion: 2.1 time: 0.644149 Aug 29 10:48:19.082595 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1591/3210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:18 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1573 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:19.093617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:19.096223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:19.109747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.110913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.111941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.112818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.115087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.115740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.651943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:19.664866 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbee0946-ce07-4b4a-8461-d4a7fc4a1e8c tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.580242 Aug 29 10:48:19.668924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1592/3211] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:19 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:19.681668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-050bccce-df34-45d7-990b-0214555c4ff1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:19.682396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-050bccce-df34-45d7-990b-0214555c4ff1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:19.714059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:19.728433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-854cb93f-db78-4062-b047-77bb51ff0fe3 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.754837 Aug 29 10:48:19.740418 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1620/3212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:18 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:19.743333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc", "tag": "86e90235-88bd-455f-8c6d-9f3c715d5b06"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:19.775609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.777558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.779820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.796065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] Creating event network-changed:86e90235-88bd-455f-8c6d-9f3c715d5b06 for instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc on n-h1-854121-10 Aug 29 10:48:19.807665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d4ae6c46-81e9-474a-8536-ed571c22e801 req-b450b0bc-3db4-476d-9008-1b569d1e75cb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072614 Aug 29 10:48:19.809571 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1621/3213] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:19.833050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2044896172"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:19.834449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:19.834833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-050bccce-df34-45d7-990b-0214555c4ff1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:19.843868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-050bccce-df34-45d7-990b-0214555c4ff1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1215 microversion: 2.1 time: 0.171997 Aug 29 10:48:19.847524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.850289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.851404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.853614 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1593/3214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:19 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:19.853908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.854401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.859514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.859978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:19.860676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:19.871681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.872450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.873860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:19.875143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:19.875778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:19.876391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.150885 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Adding security group 0912eb29-ded7-434e-9cae-84c961d35d65 to port 06afd132-f81d-4842-8cfd-230d495299ad Aug 29 10:48:20.155615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:20.164701 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9385065a-b6bd-4e43-a400-1fa75ef98b1a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.309184 Aug 29 10:48:20.166437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1594/3215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:19 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:20.173412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:20.174136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:20.182728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.183771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.184384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.185101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.189521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.190000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.215964 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] HTTP exception thrown: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Request method failure captured: Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 HTTP/1.1 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJe1SDUbjs-6UHTrZPpGLMdN1QDGiD71SpufLYBjWrSjADeikYaYxtPh89V4SLCIT7mrjO2lA9AWAbTScktW9ZOWhVEgHuwP2lb4i0Odik7z9fxoQU_3OeyL9P2B5csB0kBsiKUkliJk1mJCiWSRw-MkVQ8piMIB2BWWS-Tbg1dd-eo Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2e6b9a6bbfcd45b19d5fd0eb07d1dccb Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c23efe6f-782b-497e-b0f9-cd7bc2248ef6'} Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:20.217744 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Returning 404 to user: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ceadc9d3-7516-4e28-9040-c68b977c9007 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 404 len: 111 microversion: 2.42 time: 0.050940 Aug 29 10:48:20.224982 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1595/3216] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:48:20 2022] DELETE /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:20.226689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:20.227501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:20.239191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.239878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.242263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.243803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.244443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.245041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.562663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:20.599498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c4009b3-4d27-44b7-a4f9-02cfce47522d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.374779 Aug 29 10:48:20.601421 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1596/3217] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:20 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:20.618466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:20.619827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] [instance: c23efe6f-782b-497e-b0f9-cd7bc2248ef6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:20.655309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.656673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.657513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.661622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.663258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.663897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.704567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] HTTP exception thrown: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Request method failure captured: Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 HTTP/1.1 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJe1SDUbjs-6UHTrZPpGLMdN1QDGiD71SpufLYBjWrSjADeikYaYxtPh89V4SLCIT7mrjO2lA9AWAbTScktW9ZOWhVEgHuwP2lb4i0Odik7z9fxoQU_3OeyL9P2B5csB0kBsiKUkliJk1mJCiWSRw-MkVQ8piMIB2BWWS-Tbg1dd-eo Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/adf878bae1464083abe2ebea0b534c1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: adf878bae1464083abe2ebea0b534c1c Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198940758 Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 2e6b9a6bbfcd45b19d5fd0eb07d1dccb Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198940758-project Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c23efe6f-782b-497e-b0f9-cd7bc2248ef6'} Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.712861 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] Returning 404 to user: Instance c23efe6f-782b-497e-b0f9-cd7bc2248ef6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:20.717559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cde2f9a6-4368-4a04-8a76-22f8438de375 tempest-TaggedBootDevicesTest_v242-1198940758 tempest-TaggedBootDevicesTest_v242-1198940758-project] 10.222.0.47 "GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6" status: 404 len: 111 microversion: 2.42 time: 0.112792 Aug 29 10:48:20.724238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1597/3218] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:48:20 2022] GET /compute/v2.1/servers/c23efe6f-782b-497e-b0f9-cd7bc2248ef6 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:20.733580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-401f39f5-930e-479c-b8fb-184c03ee40cd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:20.768185 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-401f39f5-930e-479c-b8fb-184c03ee40cd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-401f39f5-930e-479c-b8fb-184c03ee40cd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/2c77c4bf-036d-4167-b3d8-d412caa555c2/action HTTP/1.1 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: {"os-stop": {}} Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '2c77c4bf-036d-4167-b3d8-d412caa555c2', 'body': {'os-stop': {}}} Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:20.788579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. Aug 29 10:48:20.792803 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:20.796791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-401f39f5-930e-479c-b8fb-184c03ee40cd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 2c77c4bf-036d-4167-b3d8-d412caa555c2 has no mapping to a cell. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:20.800165 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-401f39f5-930e-479c-b8fb-184c03ee40cd tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/2c77c4bf-036d-4167-b3d8-d412caa555c2/action" status: 404 len: 117 microversion: 2.1 time: 0.071720 Aug 29 10:48:20.801098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1598/3219] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:20 2022] POST /compute/v2.1/servers/2c77c4bf-036d-4167-b3d8-d412caa555c2/action => generated 117 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:20.814904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:20.815529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:20.819293 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adffac7f-ac7b-47c9-8217-bab1f0385b9c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action" status: 202 len: 0 microversion: 2.1 time: 1.007482 Aug 29 10:48:20.823156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1622/3220] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:19 2022] POST /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc/action => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:20.827564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:20.828195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:20.833405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.835614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.836453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.838463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.840549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.841241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.867465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.869319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.870369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.879190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:20.880477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:20.883859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:20.898037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:21.186467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:21.199563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-59b24be4-377a-4514-8b50-49729366877e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.377926 Aug 29 10:48:21.200470 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1623/3221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:20 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:21.214583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6e8e4c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.272489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:21.282311 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6aa615fc-affd-41e2-9e3a-6047e2dc941c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.479437 Aug 29 10:48:21.286395 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1599/3222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:20 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:21.304998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.311418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.328492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.331327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.331855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.332663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.335803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.336482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.444185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:21.448643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use.", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:21.449748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.449748 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65 HTTP/1.1 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: exception: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '0912eb29-ded7-434e-9cae-84c961d35d65'} Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:21.452682 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] Aug 29 10:48:21.458168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.461252 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c08e04f-4274-463b-b634-879b3db4407d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1267 microversion: 2.1 time: 0.154472 Aug 29 10:48:21.461252 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1600/3223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:21 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:21.463146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 400 to user: Security Group 0912eb29-ded7-434e-9cae-84c961d35d65 in use. Aug 29 10:48:21.463146 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-ff21122d-bcd5-4871-8244-79a2e6046c48'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:21.464282 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1fcaf79f-8758-423c-b9a3-d4efd273bb68 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65" status: 400 len: 185 microversion: 2.1 time: 0.258361 Aug 29 10:48:21.465042 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1624/3224] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:21 2022] DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65 => generated 185 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:21.467507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:21.475548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.476174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.484737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.485400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.485877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.486590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.487809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.488259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.495963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.496459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.496904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.521212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] Creating event network-changed:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:48:21.527288 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-06b65b44-59f0-4267-bd87-8a1db957077b req-e95c8b95-7d67-4732-920a-030016cc54be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068763 Aug 29 10:48:21.528208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1601/3225] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:21.542306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.543021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.562399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.562897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.563528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.565008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.565716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.566314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.680964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:21.692214 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6cb3c1bc-8b32-4e77-a4e9-62e029eb225c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.225852 Aug 29 10:48:21.698855 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1625/3226] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:21 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:21.717686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.718763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.745434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.759895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.764859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.766006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.766734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.768661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.819371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:48:21.878115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:21.886516 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e0777cc-b119-4593-a4e4-93ff85b9a092 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.357084 Aug 29 10:48:21.893794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1602/3227] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:21 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:21.911629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:21.912184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 3d768f52-1f9f-4405-8593-5410ba866d3b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.927258 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/3d768f52-1f9f-4405-8593-5410ba866d3b/action HTTP/1.1 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: {"suspend": {}} Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3d768f52-1f9f-4405-8593-5410ba866d3b', 'body': {'suspend': {}}} Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:21.928943 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:21.933235 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:21.933235 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:21.933235 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. Aug 29 10:48:21.933235 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:21.942914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 3d768f52-1f9f-4405-8593-5410ba866d3b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:21.943382 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aba4432e-f4c5-4862-890a-cc633fd56738 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 204 len: 0 microversion: 2.1 time: 0.241731 Aug 29 10:48:21.944265 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1626/3228] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:21 2022] DELETE /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:48:21.944400 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2487d7ba-c660-48cc-b6e4-13283b216bc8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/3d768f52-1f9f-4405-8593-5410ba866d3b/action" status: 404 len: 111 microversion: 2.1 time: 0.036918 Aug 29 10:48:21.945670 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1603/3229] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:21 2022] POST /compute/v2.1/servers/3d768f52-1f9f-4405-8593-5410ba866d3b/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:21.956766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.957276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:21.957606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.958813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:21.967578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.968084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.968529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.969819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.970502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.970942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.977989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.986073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.986978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:21.987994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:21.988719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:21.989406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.315544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:22.319079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:22.324611 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-48b34d8d-8665-481e-84a8-2cbc16342f5e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1648 microversion: 2.1 time: 0.374326 Aug 29 10:48:22.325860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1604/3230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:21 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1648 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:22.338767 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44489c8e-60d9-495a-bd28-0813bd82930f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.380384 Aug 29 10:48:22.343328 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1627/3231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:21 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:22.344216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a99905-761f-4dd1-9455-365346817589", "name": "network-vif-plugged", "status": "completed", "tag": "cb8b11e9-b1c7-4450-ab19-a96af3fe15b8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:22.355294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.355723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:22.356467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.356616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:22.359584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.375086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] Creating event network-vif-plugged:cb8b11e9-b1c7-4450-ab19-a96af3fe15b8 for instance f0a99905-761f-4dd1-9455-365346817589 on n-h1-854121-10 Aug 29 10:48:22.377208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.377716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.378762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.382178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.382708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.383156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.383674 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bbf679f0-f380-4914-a664-e00082b8dcfc req-bb3bbc6a-a37e-48de-a7ed-94b049d673dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055261 Aug 29 10:48:22.385992 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1605/3232] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:22.395271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:22.397191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:22.407183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.408169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.408840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.410343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.411560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.412241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.658066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:22.668058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbb5a5e1-548a-4b71-aa9a-2849f9f5663f tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.322989 Aug 29 10:48:22.673648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1628/3233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:22 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:22.684542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:22.686196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:22.698431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.702772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.708876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.709979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.710685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.711436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.743415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:22.761143 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fcc0bdf5-93a5-400f-9a05-6666e8fd828d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.365836 Aug 29 10:48:22.772411 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1606/3234] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:22 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:22.777229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:22.790094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:22.796983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.797481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.797980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.798664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.799117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.799548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.810824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:22.820005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07556eb3-e3cc-4e45-a862-076171753b45 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1267 microversion: 2.1 time: 0.144966 Aug 29 10:48:22.821365 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1629/3235] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:22 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:22.826864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:22.827753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:22.842565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.843896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.845009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.846735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:22.848035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:22.848685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:22.893267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lazy-loading 'flavor' on Instance uuid ba58c202-2540-4594-b2ae-878e488cfeee {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:23.071133 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b4787fe-3f39-4191-8b4f-f24ef6ce3ef6 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.247508 Aug 29 10:48:23.077065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1630/3236] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:22 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:23.081018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:23.088825 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-82e5bbab-64b2-497b-b3c3-dd3aad4899e4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.315364 Aug 29 10:48:23.101725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:23.101725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:23.102004 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1607/3237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:22 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:23.102114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.102494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.102952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.103674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.104976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.104976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.338349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:23.348464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:23.349245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:23.358586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.360936 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c960da37-c5b3-4f71-8082-92933cc4c77e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1514 microversion: 2.1 time: 0.276542 Aug 29 10:48:23.361407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.362630 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1631/3238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:23 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:23.374654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.375450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.375933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.376379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.624467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:23.642101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-364c1101-d5eb-423c-a1a3-77cba9a9bd53 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1648 microversion: 2.1 time: 0.297356 Aug 29 10:48:23.643271 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1608/3239] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:23 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1648 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:23.694348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:23.695359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:23.711410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.711628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.712067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.712885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.718785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.719516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.847668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:23.848307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:23.862925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.863798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.864425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:23.865532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:23.866321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:23.866943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.039959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:24.050031 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52805b26-cb1b-44c9-a99b-12cfc17aa40d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1275 microversion: 2.1 time: 0.209591 Aug 29 10:48:24.061867 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1609/3240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:23 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:24.099486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:24.109172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25b2719b-f296-4e1f-ad2e-34feeff1ef34 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.419080 Aug 29 10:48:24.110612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1632/3241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:23 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:24.115671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:24.116532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.127006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.128288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.128898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.130295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.131274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.132157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.361093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:24.371950 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f79c88f4-40a7-4592-9e5f-76c197424ef4 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.261722 Aug 29 10:48:24.373839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1610/3242] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:24 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:24.387424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:24.388600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.400012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.401274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.401980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.402957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.404192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.405028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.577220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:24.589530 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10a9fcf3-adba-4aaf-a5fb-a0e47a5c45d3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1497 microversion: 2.1 time: 0.206850 Aug 29 10:48:24.605457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1633/3243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:24 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:24.621158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:24.621790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.636544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.637364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.638001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.639839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.640534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.641151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.664926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:24.670690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.683121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.683942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.684420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.685145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.685671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.690467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.706740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lazy-loading 'flavor' on Instance uuid ba58c202-2540-4594-b2ae-878e488cfeee {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:24.736151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'suspend' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state suspended Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: {"suspend": {}} Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'suspend' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state suspended Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'suspend': {}}} Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state suspended. Cannot suspend while the instance is in this state. Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 29 10:48:24.739254 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state suspended Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state suspended Aug 29 10:48:24.743541 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:24.746892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'suspend' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state suspended {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:24.748039 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7b58542-6771-43ba-a3f3-19a53d4e16dc tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 148 microversion: 2.1 time: 0.140183 Aug 29 10:48:24.749169 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1611/3244] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:24 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 148 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:48:24.763767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:24.764850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.780258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.781083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.781754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.782713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.785446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:24.786282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:24.799508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:24.949634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a1d787b-d4e5-42f5-98a0-f90f4c863824 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 202 len: 0 microversion: 2.1 time: 0.190304 Aug 29 10:48:24.951603 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1612/3245] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:24 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:24.961547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:24.962482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:24.981221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:24.999934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.000629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.002956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.003635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.004240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.056894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:25.069303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e30b8d9-458a-4ca9-8491-3c928ec7b8e6 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1648 microversion: 2.1 time: 0.408579 Aug 29 10:48:25.072268 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1634/3246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:24 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1648 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:25.089481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:25.090385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:25.101132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.106493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.107800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.109375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.114316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.115059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.304325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:25.318404 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2012420b-35b6-4de4-af0b-ecb0d73fb412 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1273 microversion: 2.1 time: 0.237854 Aug 29 10:48:25.319551 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1635/3247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:25 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:25.329603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:25.330366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:25.346479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.347429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.350483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.351396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.352118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.352870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.382461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:25.408754 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-21923103-41d5-4888-8f4d-4ccf9d19fb48 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1503 microversion: 2.1 time: 0.450651 Aug 29 10:48:25.412545 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1613/3248] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:24 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:25.422079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:25.430686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:25.440234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:25.442288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.443223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.443908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.444955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.446552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.447766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.734132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:25.750451 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bae9ff11-1db6-4819-9255-e2d68b276704 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1395 microversion: 2.1 time: 0.429278 Aug 29 10:48:25.751275 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1636/3249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:25 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1395 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:25.781237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc", "name": "network-vif-plugged", "status": "completed", "tag": "86e90235-88bd-455f-8c6d-9f3c715d5b06"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:25.797802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:25.798295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:25.798729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:25.836974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] Creating event network-vif-plugged:86e90235-88bd-455f-8c6d-9f3c715d5b06 for instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc on n-h1-854121-10 Aug 29 10:48:25.843434 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c1d69328-efd1-4dce-822f-618660a43fe2 req-aefb9720-2bb9-4ba0-9b6c-ce2720627d69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065966 Aug 29 10:48:25.844536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1637/3250] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:48:25.947158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:25.969072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6df5bd3d-8a42-4247-b318-64cfa4a5ff58 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.550252 Aug 29 10:48:25.971115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1614/3251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:25 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:26.097605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:26.098387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:26.110267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.110912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.111266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.112271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.112745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.113187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.118854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:26.342441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:26.343343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:26.353337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.354300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.354916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.355822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.356538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.365589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.490880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:26.521330 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b00d4f2-c893-423e-89c8-e29873e9a494 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1273 microversion: 2.1 time: 0.183608 Aug 29 10:48:26.526070 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1615/3252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:26 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:26.542251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:26.542987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:26.561661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.565812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.566614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.567561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:26.571296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:26.582847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:26.938864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:26.955461 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d8f7661-7fff-40c3-ab2b-8203ffc0076c tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1648 microversion: 2.1 time: 0.866044 Aug 29 10:48:26.965887 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1638/3253] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:26 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1648 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:26.992217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:26.992831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:27.014159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:27.019738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.020256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.020716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.024920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.025651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.027197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.030506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f44b722e-33eb-4a6c-81c2-1817df9594f5 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1503 microversion: 2.1 time: 0.502701 Aug 29 10:48:27.032270 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1616/3254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:26 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1503 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:27.048181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:27.048181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:27.059403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.060043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.063267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.064046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.064520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.065943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.454647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:27.491878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8134ea4-4c55-4571-a48b-aa3b7d4dbed4 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1576 microversion: 2.1 time: 0.523209 Aug 29 10:48:27.494648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1639/3255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:26 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1576 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:27.515057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:27.515591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:27.519791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:27.531522 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e7b9766-0ba5-44c5-a700-da18e4afd6c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1367 microversion: 2.1 time: 0.498149 Aug 29 10:48:27.532603 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1617/3256] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:27 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:27.548280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:27.551949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:27.556969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.557794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.558422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.559563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.562515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.563678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.577947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.579645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.580283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.583951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:27.584611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:27.585235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:27.945894 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d81b5372-72f9-4576-afb9-2a451274204c tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.436069 Aug 29 10:48:27.946504 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1640/3257] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:48:27 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589/os-interface => generated 284 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:48:27.958482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "name": "network-vif-deleted", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:28.019240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.019850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.020397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.070464 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] Creating event network-vif-deleted:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:48:28.099485 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5dd36c5d-ec4f-49ac-9329-d1ac6be78379 req-aa674c24-0fbf-4c81-88cb-cf77a173ffb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148284 Aug 29 10:48:28.102696 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1641/3258] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:28.142040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c05986-be3f-478f-af02-a76046f11ecc", "name": "network-vif-unplugged", "status": "completed", "tag": "06afd132-f81d-4842-8cfd-230d495299ad"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:28.175641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.183691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.186868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.245520 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] Creating event network-vif-unplugged:06afd132-f81d-4842-8cfd-230d495299ad for instance f7c05986-be3f-478f-af02-a76046f11ecc on n-h1-854121-10 Aug 29 10:48:28.260105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:28.271616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-537b70c0-a5df-44fa-b4c7-34bd921eae83 req-96109ecc-c8c0-4db3-97f0-2b5b0fbe13bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166507 Aug 29 10:48:28.273035 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1642/3259] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:28.283959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:28.285585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2b07848-efef-4ff7-9267-c9a99c857840 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.745021 Aug 29 10:48:28.286731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:28.291825 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1618/3260] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:27 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:28.308265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:28.309347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:28.315185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.315690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.316136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.316865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.317319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.317780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.320268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.321164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.333123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.335152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.335857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.337087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.424754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.425640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.426301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.426939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lazy-loading 'fault' on Instance uuid f7c05986-be3f-478f-af02-a76046f11ecc {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:28.561865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:28.572639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d220b48-8ef1-4efc-bcb4-697a5335fab4 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 200 len: 1306 microversion: 2.1 time: 0.298034 Aug 29 10:48:28.573278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1643/3261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:28 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:28.589969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:28.590890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:28.605787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.606562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.607739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.608659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.609308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.609937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.739595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:28.790942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:28.809130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:28.828912 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9c2aa57-6ede-49fc-8f30-8361b6b55126 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.526826 Aug 29 10:48:28.830081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1619/3262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:28 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:28.854193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:28.860575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:28.861303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:28.863595 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16cd9997-a856-4dd5-8d4d-7f83fc4a46f5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1556 microversion: 2.1 time: 0.288471 Aug 29 10:48:28.866111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1644/3263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:28 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1556 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:28.870921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.871414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.871851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.872873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.873316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.873947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.892964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:28.894571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:28.912122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.912626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.913072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:28.913848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:28.914315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:28.914738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:29.125994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be565d87-f737-4992-ab79-5a6dd46d01e0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239008 Aug 29 10:48:29.133914 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1645/3264] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:48:28 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:29.311812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:29.312830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:29.325195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:29.325757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:29.330132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:29.334274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:29.334976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:29.338412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:29.429279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:29.439752 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-024b9ed3-0014-4e51-befb-529f5403bda7 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.585422 Aug 29 10:48:29.440344 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1620/3265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:28 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:29.464657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:29.465610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 9e44de0b-0ea6-426a-b87c-78d8f2631e1d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:29.475339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/9e44de0b-0ea6-426a-b87c-78d8f2631e1d/action HTTP/1.1 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: {"unpause": {}} Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9e44de0b-0ea6-426a-b87c-78d8f2631e1d', 'body': {'unpause': {}}} Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:29.477327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:29.483225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:29.483225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:29.483225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. Aug 29 10:48:29.483225 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:29.490552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 9e44de0b-0ea6-426a-b87c-78d8f2631e1d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:29.491716 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b18d7ae1-1c17-4c77-999a-49196f7c1755 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/9e44de0b-0ea6-426a-b87c-78d8f2631e1d/action" status: 404 len: 111 microversion: 2.1 time: 0.031205 Aug 29 10:48:29.492506 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1621/3266] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:29 2022] POST /compute/v2.1/servers/9e44de0b-0ea6-426a-b87c-78d8f2631e1d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:29.503924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:29.505343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:29.523613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:29.526713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:29.528855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:29.531380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:29.532093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:29.533676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:29.843726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:30.065284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:30.074591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89924b98-5a4b-4d7e-9a59-b641dbd08648 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.769627 Aug 29 10:48:30.079849 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1646/3267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:29 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:30.088196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:30.092117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:30.103048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:30.108000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:30.110391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:30.111367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:30.111996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:30.117967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:30.146097 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc HTTP/1.1 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f7c05986-be3f-478f-af02-a76046f11ecc'} Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:30.155925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:30.161255 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:30.173364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:30.175740 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff80884d-0962-4d16-aff6-0b63331b385d tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 404 len: 111 microversion: 2.1 time: 0.094387 Aug 29 10:48:30.176751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1647/3268] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:30 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:30.189954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6148a60-ad2c-49a2-9cd5-1f87b26b9625 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6e30310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:30.383026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:30.400780 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee98aaeb-92d2-425b-adeb-82a5f89e992f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.903844 Aug 29 10:48:30.401383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1622/3269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:29 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:30.432468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:30.434143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:30.454467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:30.455327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:30.456917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:30.458904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:30.461481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:30.463440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.263699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:31.282342 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b3441a6-e557-405c-867f-e06b05b1fe02 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.853055 Aug 29 10:48:31.294496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1623/3270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:30 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:31.307908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c", "tag": "b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:31.336624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.338390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.339040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.368131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] Creating event network-changed:b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7 for instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c on n-h1-854121-10 Aug 29 10:48:31.408219 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-20397bc4-c5a6-43c0-9436-1830709288f6 req-ba10c703-f86d-428e-8297-e968f8785006 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108569 Aug 29 10:48:31.409646 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1624/3271] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:31.418969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:31.421884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:31.434113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.436595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.437537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.440227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.442284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.447959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.551904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6148a60-ad2c-49a2-9cd5-1f87b26b9625 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8" status: 202 len: 0 microversion: 2.1 time: 1.370748 Aug 29 10:48:31.553384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1648/3272] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:30 2022] DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8 => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:31.558673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:31.559673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:31.568243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.569088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.569847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.570818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.571499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.572176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.878308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:31.886462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca927d5a-49f7-4c76-86b3-b2e388450563 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1576 microversion: 2.1 time: 0.474410 Aug 29 10:48:31.896705 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1625/3273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:31 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1576 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:31.914103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:31.914819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:31.925943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.926600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.927736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.928601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:31.932871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:31.942118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b054ebb-5275-4944-be1d-34ddc3045921 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.387271 Aug 29 10:48:31.943133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:31.944645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:31.949998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1649/3274] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:31 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:31.968498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c12e993b-1d73-4852-b9c6-8049662c69a8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c7266a60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:32.008926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'unpause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 15 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: {"unpause": {}} Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'unpause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'unpause': {}}} Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state active. Cannot unpause while the instance is in this state. Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:32.011067 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:32.016123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:32.016123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:32.016123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:32.016123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:32.016123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:32.017897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'unpause' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:32.019009 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9ce74ab-57b1-4f68-86ee-a37047365570 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 145 microversion: 2.1 time: 0.121095 Aug 29 10:48:32.030841 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1626/3275] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:31 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 145 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:48:32.043181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:32.044495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:32.057317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:32.058184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:32.058878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:32.059823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:32.061227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:32.074497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:32.520383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:32.532059 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-680734b8-7712-47ff-87a9-72d366c0bfe8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.492588 Aug 29 10:48:32.533244 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1627/3276] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:32.542316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc", "tag": "86e90235-88bd-455f-8c6d-9f3c715d5b06"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:32.587996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:32.588581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:32.589227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:32.614123 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] Creating event network-changed:86e90235-88bd-455f-8c6d-9f3c715d5b06 for instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc on n-h1-854121-10 Aug 29 10:48:32.624766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c6c5f9b8-34f2-4f1f-adf0-02f74b9ab6bc req-0737f276-b030-473d-8506-140e1c2d17fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085890 Aug 29 10:48:32.628349 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1628/3277] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:32.653843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c12e993b-1d73-4852-b9c6-8049662c69a8 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65" status: 202 len: 0 microversion: 2.1 time: 0.700522 Aug 29 10:48:32.656084 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1650/3278] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:31 2022] DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65 => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:32.667483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d3deb5c-51a5-4365-bfb3-69e27577279e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'create', calling method: .version_select at 0x7f66c6ef13a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-803495265", "description": "tempest-description-271358224"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:32.673555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:32.673676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:32.682272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:32.683358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:32.683977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:32.684685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:32.685808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:32.686207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:32.958400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:32.983304 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5caff69f-3ad6-438c-ad09-12b36e352951 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.350175 Aug 29 10:48:32.985091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1629/3279] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:32 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:32.990482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:32.991325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:33.045484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:33.047124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:33.051711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:33.052665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:33.054507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:33.055147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:33.145847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:33.213655 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d3deb5c-51a5-4365-bfb3-69e27577279e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.550020 Aug 29 10:48:33.214769 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1651/3280] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 10:48:32 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:48:33.230910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:33.232592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 3fc74219-cfc7-4d40-895e-72a7ffc3b159] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:33.266526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/3fc74219-cfc7-4d40-895e-72a7ffc3b159/action HTTP/1.1 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 18 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: {"unshelve": null} Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3fc74219-cfc7-4d40-895e-72a7ffc3b159', 'body': {'unshelve': None}} Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:33.268853 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. Aug 29 10:48:33.273077 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:33.282900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 3fc74219-cfc7-4d40-895e-72a7ffc3b159 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:33.286341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-efeb5159-879d-4fc2-b082-c8e3fde934a4 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/3fc74219-cfc7-4d40-895e-72a7ffc3b159/action" status: 404 len: 111 microversion: 2.1 time: 0.057781 Aug 29 10:48:33.291861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1652/3281] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:33 2022] POST /compute/v2.1/servers/3fc74219-cfc7-4d40-895e-72a7ffc3b159/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:33.318000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a240dec8-c9e9-4f4c-8a67-ae8629076427 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Action: 'update', calling method: .version_select at 0x7f66c7485670>, body: {"security_group": {"name": "tempest-sg-hth-246033808", "description": "tempest-description-hth-1723241837"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:33.803346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:33.817617 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c122225-0024-4cc2-a103-9c7defdaf480 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.831047 Aug 29 10:48:33.818848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1630/3282] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:32 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:33.823714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:33.830149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:33.845642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:33.848029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:33.850714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:33.851987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:33.854201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:33.855085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:34.087069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a240dec8-c9e9-4f4c-8a67-ae8629076427 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "PUT /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3" status: 200 len: 217 microversion: 2.1 time: 0.790203 Aug 29 10:48:34.087673 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1653/3283] 10.222.0.47 () {60 vars in 1290 bytes} [Mon Aug 29 10:48:33 2022] PUT /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3 => generated 217 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:34.102772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-29fdfe33-e669-46fc-b315-006b717b4427 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6eeda60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:34.324393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-29fdfe33-e669-46fc-b315-006b717b4427 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3" status: 200 len: 217 microversion: 2.1 time: 0.227117 Aug 29 10:48:34.325006 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1654/3284] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:48:34 2022] GET /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3 => generated 217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:34.335063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a99905-761f-4dd1-9455-365346817589", "tag": "cb8b11e9-b1c7-4450-ab19-a96af3fe15b8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:34.356559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:34.357614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:34.358300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:34.380192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] Creating event network-changed:cb8b11e9-b1c7-4450-ab19-a96af3fe15b8 for instance f0a99905-761f-4dd1-9455-365346817589 on n-h1-854121-10 Aug 29 10:48:34.394167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:34.395360 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-63504924-199b-4748-8e19-08465fe326c9 req-fe61fa37-b3c0-4b0c-9d6d-5a3649b47720 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066214 Aug 29 10:48:34.399160 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1655/3285] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:34.403529 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2feb612e-ce3c-4765-9975-c9516900a63a tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.583402 Aug 29 10:48:34.409384 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1631/3286] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:33 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:34.411535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2f42627-f6a9-494a-b4dc-7e2e213efd54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6dec5e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:34.438920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:34.439924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:34.448144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:34.448904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:34.449531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:34.450447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:34.452517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:34.453498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.224985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:35.236265 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c5703eb-bff2-4488-aa39-5fda3f987b70 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.804396 Aug 29 10:48:35.253488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1632/3287] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:34 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:35.259043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:35.259987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:35.267622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.268371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.269002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.270026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.270648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.271242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.619603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:35.631492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97b8b4a1-b843-43a8-9af6-9db86a8fd0f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.376716 Aug 29 10:48:35.632825 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1633/3288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:35 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:35.672455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:35.675131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:35.697632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.699944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.700478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.702074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.704982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.706960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.750729 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Cannot 'unshelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action HTTP/1.1 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 18 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: {"unshelve": null} Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: exception: Cannot 'unshelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'unshelve': None}} Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba58c202-2540-4594-b2ae-878e488cfeee in vm_state active. Cannot unshelve while the instance is in this state. Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 10:48:35.752497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 409 to user: Cannot 'unshelve' instance ba58c202-2540-4594-b2ae-878e488cfeee while it is in vm_state active {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1ae1d5a-fb21-40cf-984f-538c5c0651a2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action" status: 409 len: 146 microversion: 2.1 time: 0.105208 Aug 29 10:48:35.760520 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1634/3289] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:35 2022] POST /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee/action => generated 146 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:48:35.766384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:35.767080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:35.774446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.775048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.775573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.776353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.776865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.777572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.813807 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2f42627-f6a9-494a-b4dc-7e2e213efd54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3" status: 202 len: 0 microversion: 2.1 time: 1.411513 Aug 29 10:48:35.814834 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1656/3290] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:34 2022] DELETE /compute/v2.1/os-security-groups/97a777fa-b5b1-4394-8207-a70ff89590b3 => generated 0 bytes in 1415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:35.822260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:35.822881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:35.832614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.833107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.833549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.834286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.834737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.835484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.851598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc HTTP/1.1 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f7c05986-be3f-478f-af02-a76046f11ecc'} Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:35.853792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.857912 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.860384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:35.861565 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e5806a02-3f81-4df8-bbbe-63fd181a1bb3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 404 len: 111 microversion: 2.1 time: 0.043062 Aug 29 10:48:35.862553 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1657/3291] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:35 2022] DELETE /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:35.870586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:35.871488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: f7c05986-be3f-478f-af02-a76046f11ecc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:35.878711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.879536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.880352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.881190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:35.881814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:35.882322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:35.899263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc HTTP/1.1 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f7c05986-be3f-478f-af02-a76046f11ecc'} Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:35.901186 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Instance f7c05986-be3f-478f-af02-a76046f11ecc could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c7a7e0f-b489-459c-a2e1-235ae0892898 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc" status: 404 len: 111 microversion: 2.1 time: 0.036595 Aug 29 10:48:35.906207 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1658/3292] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:35 2022] GET /compute/v2.1/servers/f7c05986-be3f-478f-af02-a76046f11ecc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:35.922018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c7485670>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:35.992534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:35.993146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 0912eb29-ded7-434e-9cae-84c961d35d65 not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:35.994556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:35.994556 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65 HTTP/1.1 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '0912eb29-ded7-434e-9cae-84c961d35d65'} Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:35.996637 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] Aug 29 10:48:36.002369 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.007772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 0912eb29-ded7-434e-9cae-84c961d35d65 does not exist Aug 29 10:48:36.007772 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-a2505d30-e06d-4723-bf41-e8eada53973c'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.007772 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-299e8b26-639d-408f-9d54-871149614072 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65" status: 404 len: 194 microversion: 2.1 time: 0.098787 Aug 29 10:48:36.007772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1659/3293] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:35 2022] DELETE /compute/v2.1/os-security-groups/0912eb29-ded7-434e-9cae-84c961d35d65 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:36.017896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6ef1c10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.087835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:36.088928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 71761f48-ba6b-4154-b824-8c487ef390a8 not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:36.089793 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.089793 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8 HTTP/1.1 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '71761f48-ba6b-4154-b824-8c487ef390a8'} Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:36.093028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] Aug 29 10:48:36.098573 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.104478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 71761f48-ba6b-4154-b824-8c487ef390a8 does not exist Aug 29 10:48:36.104478 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-7d7d245d-12b6-4089-8e78-e13295bc00e6'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.104478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5901d08-332d-4a50-8e18-4344ee158fcf tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8" status: 404 len: 194 microversion: 2.1 time: 0.087697 Aug 29 10:48:36.105618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1660/3294] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/os-security-groups/71761f48-ba6b-4154-b824-8c487ef390a8 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:36.112107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c6eb91f0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.118567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:36.127645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a4c39d8-50f0-48ef-a651-2377759d5ef3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.365837 Aug 29 10:48:36.151095 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1635/3295] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:35 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:36.161227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.161904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.173385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.173840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.174302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.175291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.175922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.176516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.181163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:36.182072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 90a35f0a-22fe-4759-8429-b3f2c556330f not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:36.182927 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.182927 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f HTTP/1.1 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '90a35f0a-22fe-4759-8429-b3f2c556330f'} Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:36.185317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 90a35f0a-22fe-4759-8429-b3f2c556330f does not exist Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-227fdc9c-39af-4865-b649-715f4c94fb10'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.191275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf7387a2-398c-43b5-8fd6-a92d6400a6d1 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f" status: 404 len: 194 microversion: 2.1 time: 0.082429 Aug 29 10:48:36.194650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1661/3296] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/os-security-groups/90a35f0a-22fe-4759-8429-b3f2c556330f => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:36.201802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c791ee50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.292178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:36.292806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group b3f2692d-88ee-4817-957c-d9ad5692c620 not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:36.293333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.293333 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620 HTTP/1.1 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b3f2692d-88ee-4817-957c-d9ad5692c620'} Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:36.298397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] Aug 29 10:48:36.302920 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.306602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group b3f2692d-88ee-4817-957c-d9ad5692c620 does not exist Aug 29 10:48:36.306602 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-b8ee95cf-7dc3-4006-bff1-e2641c9a7243'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.309112 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9a713011-bd89-48de-a9cc-18811c05f96e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620" status: 404 len: 194 microversion: 2.1 time: 0.110889 Aug 29 10:48:36.310437 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1662/3297] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/os-security-groups/b3f2692d-88ee-4817-957c-d9ad5692c620 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:36.319761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c74853a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.374726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:36.375871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:36.376748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.376748 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec HTTP/1.1 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '12a71cc6-e7fb-402b-bdb9-df1472a090ec'} Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:36.379857 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group 12a71cc6-e7fb-402b-bdb9-df1472a090ec does not exist Aug 29 10:48:36.383823 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-88dd4fee-4db3-4752-964a-2db8f9a57e29'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.389361 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b4d17f5-fe79-4d13-a21c-dc4fc1a75913 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec" status: 404 len: 194 microversion: 2.1 time: 0.070565 Aug 29 10:48:36.389361 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1663/3298] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/os-security-groups/12a71cc6-e7fb-402b-bdb9-df1472a090ec => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:36.396496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c733a3a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.438402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG neutronclient.v2_0.client [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist", "detail": ""}} {{(pid=128681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 10:48:36.439383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.security_group_api [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Neutron security group a66ea10e-084d-40ee-b8b9-6e9311e53fee not found {{(pid=128681) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 10:48:36.441218 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.441218 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee HTTP/1.1 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: exception: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a66ea10e-084d-40ee-b8b9-6e9311e53fee'} Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 10:48:36.443661 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Security group a66ea10e-084d-40ee-b8b9-6e9311e53fee does not exist Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: Neutron server returns request_ids: ['req-fcc8cd27-adfd-4b7e-8b17-84ca3bd91349'] {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0bec262-ee92-4478-8879-41b09da49849 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee" status: 404 len: 194 microversion: 2.1 time: 0.055814 Aug 29 10:48:36.450977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1664/3299] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/os-security-groups/a66ea10e-084d-40ee-b8b9-6e9311e53fee => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:36.455959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.456554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:36.457019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.465872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.466093 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae06912a-d365-4970-8479-c78f4ca4df9e tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.313803 Aug 29 10:48:36.467752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1636/3300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:36 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:36.471201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.471766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.472645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.473291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.473830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.489431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702844785_updated"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:36.492079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: 01f06ddf-1270-4150-9f59-aa77c549302b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.502521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/servers/01f06ddf-1270-4150-9f59-aa77c549302b HTTP/1.1 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 81 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702844785_updated"}} Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '01f06ddf-1270-4150-9f59-aa77c549302b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1702844785_updated'}}} Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 10:48:36.504366 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance 01f06ddf-1270-4150-9f59-aa77c549302b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40129e1a-2876-4a3d-914c-886548d4a3a8 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "PUT /compute/v2.1/servers/01f06ddf-1270-4150-9f59-aa77c549302b" status: 404 len: 111 microversion: 2.1 time: 0.020430 Aug 29 10:48:36.508630 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1637/3301] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:48:36 2022] PUT /compute/v2.1/servers/01f06ddf-1270-4150-9f59-aa77c549302b => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:48:36.511999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:48:36.516151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.516866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.524136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.524629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.525076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.525807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.526394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.526822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.629145 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b843444-5ada-4c61-9dca-fee5e6721978 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 204 len: 0 microversion: 2.1 time: 0.177151 Aug 29 10:48:36.634705 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1665/3302] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:36 2022] DELETE /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:48:36.644176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.644884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.651130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.651620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.652077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.652743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.653204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.653628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.743842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:36.755633 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ec7f5827-d718-495a-b727-010f76857aca tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.243732 Aug 29 10:48:36.757170 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1638/3303] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:36 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:36.763232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.764984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.776233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.776945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.777403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.778182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.778920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.779639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.874890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:36.884456 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b739ec25-c629-45d3-8d8d-bc737040b90f tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1647 microversion: 2.1 time: 0.244298 Aug 29 10:48:36.885456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1666/3304] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:36 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1647 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:36.891474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:36.892120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:36.898233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.898723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.899163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.899862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:36.900323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:36.900745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:36.989287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:36.997592 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d41d9b3-30e8-4885-9fd8-2b85d0a64363 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.239130 Aug 29 10:48:37.012774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1639/3305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:36 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:37.074260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:37.086647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3dda886e-0bf4-4c9a-9190-052f9179cdc9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.199929 Aug 29 10:48:37.088707 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1667/3306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:36 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:37.111274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a34a75ad-807b-49a5-881f-916d211550e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a34a75ad-807b-49a5-881f-916d211550e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: request: PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee HTTP/1.1 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 280 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.115156 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a34a75ad-807b-49a5-881f-916d211550e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:37.118822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a34a75ad-807b-49a5-881f-916d211550e3 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 400 len: 619 microversion: 2.1 time: 0.010924 Aug 29 10:48:37.126039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:37.126676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:37.128867 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1640/3307] 10.222.0.47 () {60 vars in 1257 bytes} [Mon Aug 29 10:48:37 2022] PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:37.135103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.135786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.136396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.137342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.138811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.139410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.312975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:37.322164 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c8f2986-b577-4aaa-b770-8c834f5f3f0b tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.200531 Aug 29 10:48:37.334978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1668/3308] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:37 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:37.349950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:37.350824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:37.359520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.360259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.360874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.361785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.362245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.362832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.391899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c", "name": "network-vif-plugged", "status": "completed", "tag": "b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:37.403682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.404871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.406064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.422348 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] Creating event network-vif-plugged:b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7 for instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c on n-h1-854121-10 Aug 29 10:48:37.434234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3763e98c-0f10-41fd-8025-3480023aeea9 req-09783d6a-e678-409f-9fe7-281ac93b9d45 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046060 Aug 29 10:48:37.435508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1669/3309] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:37.551958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:37.567992 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-882346c0-f3d2-4f0c-80ec-69233c29d3bb tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.224013 Aug 29 10:48:37.569273 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1641/3310] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:37 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:37.590371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c20f40a9-11fc-4464-95f1-5aa8dc851c5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c20f40a9-11fc-4464-95f1-5aa8dc851c5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee HTTP/1.1 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 24 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": ""}} Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee', 'body': {'server': {'name': ''}}} Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '' Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:48:37.594841 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 10:48:37.600028 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:37.601862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c20f40a9-11fc-4464-95f1-5aa8dc851c5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:37.602717 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c20f40a9-11fc-4464-95f1-5aa8dc851c5d tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 400 len: 108 microversion: 2.1 time: 0.016810 Aug 29 10:48:37.603286 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1670/3311] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:48:37 2022] PUT /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:48:37.612391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:37.613011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:37.619240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.619734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.620189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.620944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.621411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.621920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.765830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:37.775853 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f234662-864b-44e9-ae35-53aebe7b8703 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1506 microversion: 2.1 time: 0.167109 Aug 29 10:48:37.776712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1642/3312] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:37 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:37.913411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:37.932440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:37.945084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.945957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.946586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:37.947516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:37.948317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:37.948754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:38.020443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:38.021080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:38.033745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:38.034299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:38.034766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:38.036027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:38.036027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:38.036383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:38.312221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:38.327730 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c344d47-1d03-435f-aafa-869fd8514fd3 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1647 microversion: 2.1 time: 0.420129 Aug 29 10:48:38.338161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1671/3313] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:37 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1647 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:38.411075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:38.420641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ee384e6-78a5-47a4-a174-2a521d673a1c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.404209 Aug 29 10:48:38.426842 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1643/3314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:38 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:39.290383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dfdc16-7136-4ba3-83ed-7cd89f4a9dae", "name": "network-vif-deleted", "tag": "66dcd2ce-f732-4d60-ac7e-39676181965f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:39.304514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:39.305264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:39.305971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:39.309470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:39.327814 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] Creating event network-vif-deleted:66dcd2ce-f732-4d60-ac7e-39676181965f for instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae on n-h1-854121-10 Aug 29 10:48:39.351113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:39.352410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:39.377011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:39.378888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5ef3d5cb-b2c4-4310-84e9-3f4097f3a254 req-9df860d6-1274-49de-b4c7-3e65b0116a7a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082740 Aug 29 10:48:39.379900 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1672/3315] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:39.381450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:39.382499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:39.383268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:39.384214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:39.384827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:39.448927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:39.449644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:39.464795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:39.472772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:39.473553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:39.477000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:39.477666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:39.478506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:39.524285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:39.539658 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0cb7d48-16ce-48d8-b118-2b21cf5b920e tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1301 microversion: 2.1 time: 0.192249 Aug 29 10:48:39.553729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1644/3316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:39 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1301 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:39.696240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:39.705633 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c86a5c6d-7d8d-4e89-8ce7-aee7b4995d5c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1315 microversion: 2.1 time: 0.260779 Aug 29 10:48:39.712770 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1673/3317] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:39 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:40.568548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:40.569219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:40.579124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:40.579753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:40.582262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:40.583101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:40.584086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:40.584536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:40.624628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:40.625405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:40.626051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:40.626687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lazy-loading 'fault' on Instance uuid 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:40.734361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:40.735549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:40.736913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2fe9f9e5bb4de980a20b42acf06483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3af429e3ea43649e18c5124c6c7ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:40.749243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:40.749679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a54d794-69e2-40bb-a7c3-387344026b54 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 200 len: 1306 microversion: 2.1 time: 0.188837 Aug 29 10:48:40.751260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:40.753906 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1645/3318] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:40 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:40.754082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:40.758018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:40.758977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:40.759585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:40.973110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:40.989995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27e4e7d8-7fef-4b84-9140-87bae28c3e7e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1501 microversion: 2.1 time: 0.260030 Aug 29 10:48:41.006534 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1674/3319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:40 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:41.021934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:41.023889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:41.032160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.032929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.033535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.037233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.038014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.038624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.102879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'flavor' on Instance uuid 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:41.369534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-09d2c5d7-0d27-4bf2-9f1d-cbe8200922af tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c/action" status: 202 len: 0 microversion: 2.1 time: 0.353865 Aug 29 10:48:41.371752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1646/3320] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:48:41 2022] POST /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:41.386093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:41.387010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:41.408614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.410066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.418196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.419578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.420241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.421980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.621735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:41.652707 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7401ff4d-1396-40cf-9dca-85ba973505b1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.275864 Aug 29 10:48:41.657746 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1675/3321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:41 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:41.772684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:41.773508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] [instance: 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:41.785586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.786224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.786668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.787526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:41.788030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:41.788548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:41.796335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:41.818434 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] HTTP exception thrown: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Request method failure captured: Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae HTTP/1.1 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJkPGQC99ZfPpSgcw-a_YvkYZr7Ak7DU13NGmC887873ot0haVB5ZpfHrNsxMuKSLYNSPGmtg09Whuqj6ZlxXXt_H_U8QJ0TAMxkvWdMXox4UMLyVIrCPDNYMhmGcvNTZYu1rq9SfgOWzUfjwEC5dzePpZsfaB6bBXbSka5knJ-K0Hc Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b3af429e3ea43649e18c5124c6c7ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5b3af429e3ea43649e18c5124c6c7ca9 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367314017 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 6d2fe9f9e5bb4de980a20b42acf06483 Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-SecurityGroupsTestJSON-367314017-project Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '96dfdc16-7136-4ba3-83ed-7cd89f4a9dae'} Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:41.824763 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Returning 404 to user: Instance 96dfdc16-7136-4ba3-83ed-7cd89f4a9dae could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a307dd11-b47c-4888-9b5b-d01dcd5b2e47 tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae" status: 404 len: 111 microversion: 2.1 time: 0.059810 Aug 29 10:48:41.829664 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1647/3322] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:41 2022] GET /compute/v2.1/servers/96dfdc16-7136-4ba3-83ed-7cd89f4a9dae => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:41.836382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ccc0c85-1a2d-45c8-87c2-ee2ebd650aff tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c77a6c10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:42.088095 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ccc0c85-1a2d-45c8-87c2-ee2ebd650aff tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/139924b7-603c-4d50-b4b8-7a06085bcff9" status: 202 len: 0 microversion: 2.1 time: 0.255953 Aug 29 10:48:42.091762 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1676/3323] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:41 2022] DELETE /compute/v2.1/os-security-groups/139924b7-603c-4d50-b4b8-7a06085bcff9 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:42.096995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b2dfabf-f933-453c-b319-5c12552f641b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] Calling method '.version_select at 0x7f66c663ff70>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:42.492989 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b2dfabf-f933-453c-b319-5c12552f641b tempest-SecurityGroupsTestJSON-367314017 tempest-SecurityGroupsTestJSON-367314017-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/1f52a60c-4eba-4b1e-bbd9-3706780dca3f" status: 202 len: 0 microversion: 2.1 time: 0.399763 Aug 29 10:48:42.494423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1648/3324] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:48:42 2022] DELETE /compute/v2.1/os-security-groups/1f52a60c-4eba-4b1e-bbd9-3706780dca3f => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:42.682073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:42.683123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:42.703302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:42.704090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:42.704738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:42.711169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:42.713741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:42.717125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:43.289654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:43.302951 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d5553009-c8f2-4af6-91b3-e3fbb9f8fbb2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.626086 Aug 29 10:48:43.303548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1677/3325] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:42 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:44.154894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.158513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.171181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.172391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.172842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.174977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.175456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.176539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.218173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:48:44.327494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.328926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.336359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:44.343601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.344043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.344624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.345437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.345976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.349006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.349170 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2e9ddd57-8bf9-432f-8aaf-f1f4f34d7be4 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "DELETE /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 204 len: 0 microversion: 2.1 time: 0.199647 Aug 29 10:48:44.350273 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1649/3326] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:44 2022] DELETE /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:48:44.361140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.362539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.369872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.370708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.371664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.373493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.374408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.375013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.696475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:44.705289 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c872881-b16a-4334-923a-01b692ff4a78 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1664 microversion: 2.1 time: 0.350604 Aug 29 10:48:44.706870 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1650/3327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:44 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1664 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.721903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.722414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.722499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee HTTP/1.1 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'de87605b-3cef-45a8-b1f0-ce3c0c3be2ee'} Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:44.740405 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-897c8d0f-a91a-426b-9636-f17d46122123 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 404 len: 111 microversion: 2.1 time: 0.033567 Aug 29 10:48:44.745213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1651/3328] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:44 2022] DELETE /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:44.760812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.761466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: de87605b-3cef-45a8-b1f0-ce3c0c3be2ee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.772260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:44.783160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0978746a-a5b3-4d05-b699-a47296661e16 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.462460 Aug 29 10:48:44.787467 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1678/3329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:44 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:44.790721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.791218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.791668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.792400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.792845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.801417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.821842 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee HTTP/1.1 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'de87605b-3cef-45a8-b1f0-ce3c0c3be2ee'} Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:44.823327 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance de87605b-3cef-45a8-b1f0-ce3c0c3be2ee could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6bae6092-0f5e-4507-92bb-4e253589482f tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee" status: 404 len: 111 microversion: 2.1 time: 0.072046 Aug 29 10:48:44.829373 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1652/3330] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:44 2022] GET /compute/v2.1/servers/de87605b-3cef-45a8-b1f0-ce3c0c3be2ee => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:44.838782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:44.840221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:44.854500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.855736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.856530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.857395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:44.858024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:44.858633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:44.893982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:48:45.080403 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3dbc9790-7eb4-4252-a50f-6be233cb5cef tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 204 len: 0 microversion: 2.1 time: 0.247881 Aug 29 10:48:45.086089 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1679/3331] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:48:44 2022] DELETE /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:48:45.094071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:45.094826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:45.105298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.114715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.115314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:45.116156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.116707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.117214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:45.589420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:45.602312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90947798-f855-4322-ba67-9830004ce017 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.515603 Aug 29 10:48:45.603496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1653/3332] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:45 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:45.735381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:45.736829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:45.746934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.747422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.748819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:45.750503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.750960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.751386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:45.808977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:45.811491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:45.829418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.830556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.832566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:45.836951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:45.837730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:45.840315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:46.153509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:46.163436 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dfaefd3d-b426-4f0d-a815-863054dba9d6 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1664 microversion: 2.1 time: 0.434626 Aug 29 10:48:46.164522 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1680/3333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:45 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1664 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:48:46.186008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:46.194756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbd575d8-c745-4289-81e2-cbf4c858d7f1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.392267 Aug 29 10:48:46.206849 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1654/3334] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:45 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:46.623901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:46.628352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:46.646082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:46.656535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:46.657878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:46.658837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:46.659470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:46.660074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:46.971578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:46.983747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4538c1b0-581e-4b90-b7b3-1c5fdf2484c2 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 0.364130 Aug 29 10:48:47.001494 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1681/3335] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:46 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:47.190246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:47.191595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:47.200305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:47.202029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:47.202970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:47.203958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:47.204634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:47.205296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:47.219738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:47.221207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:47.236886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:47.237479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:47.238028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:47.239017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:47.239777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:47.240284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:47.562868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:47.573549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3c84f9e-5651-48f4-8884-1a05e9149903 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1664 microversion: 2.1 time: 0.389360 Aug 29 10:48:47.574948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1655/3336] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:47 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1664 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:48.007131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:48.007788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:48.020311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:48.021152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:48.021842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:48.023987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:48.024962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:48.025648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:48.056085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:48.070611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27a8a2a9-e202-4d3e-986b-32660e9aa5a1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.855372 Aug 29 10:48:48.079646 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1682/3337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:47 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:48.600596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:48.603706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:48.621548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:48.622278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:48.624623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:48.626769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:48.628655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:48.629433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:49.184359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4c22d37f6c48d59b0fa7e832c0451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba4ea8e9c94ae5a32cc7a933a777cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:49.216899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ac0e623-ee65-4556-a280-e732af84d9b9 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 200 len: 1512 microversion: 2.1 time: 1.212679 Aug 29 10:48:49.218845 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1656/3338] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:48 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 1512 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:49.228474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba58c202-2540-4594-b2ae-878e488cfeee", "name": "network-vif-deleted", "tag": "625de70a-e5fd-4d3d-a0e1-ccd5927581ab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:49.259330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:49.271749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-179cc8ea-f934-46ec-b1be-cd40b2f8a68b tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1664 microversion: 2.1 time: 0.676690 Aug 29 10:48:49.273407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:49.273841 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1683/3339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:48 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1664 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:49.275305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:49.276657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:49.287479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:49.290498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:49.304506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:49.306484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:49.307377 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] Creating event network-vif-deleted:625de70a-e5fd-4d3d-a0e1-ccd5927581ab for instance ba58c202-2540-4594-b2ae-878e488cfeee on n-h1-854121-10 Aug 29 10:48:49.308793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:49.309741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:49.313997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:49.315535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:49.322016 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-961a16bf-a81c-4d2d-9244-6b7bb86aaf1a req-63e801de-72cf-42f2-9157-cfb19a5c165e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100461 Aug 29 10:48:49.324965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1657/3340] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:48:49.784156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:49.792387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed86b262-2fb2-46e4-8753-f8df788dc52f tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.516314 Aug 29 10:48:49.795657 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1684/3341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:49 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:50.008429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ebb153-3529-4259-bb6e-a34116068b61", "name": "network-vif-deleted", "tag": "ef3cb91c-8716-4a47-83e6-800275922dc4"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:50.025003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.026766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.027394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.066506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] Creating event network-vif-deleted:ef3cb91c-8716-4a47-83e6-800275922dc4 for instance 89ebb153-3529-4259-bb6e-a34116068b61 on n-h1-854121-10 Aug 29 10:48:50.072791 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1aca9360-969c-4174-aa0a-c3639951d45f req-e5515bf9-350b-4933-af27-eaca76373580 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072363 Aug 29 10:48:50.075140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1658/3342] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:48:50.240167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:50.240799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] [instance: ba58c202-2540-4594-b2ae-878e488cfeee] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:50.251700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.252534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.259388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.262972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.264725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.265873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.288269 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] HTTP exception thrown: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Request method failure captured: Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee HTTP/1.1 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJiCGPad3cYS49s0mwlBp-3ibDp2MkO44sZUM951wduz4Ox6GdwZ_W4J0kns70n_c5dkf7nT99KtihZJIQshOm7Ink1qjIft9EV52W-eofxmRDR2zf-qybEPrCCKszG1cxQhd5vXBZTLX7NSLUpqNH9jxzYbftdnf6D2__cjJoPOLDw Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e3ba4ea8e9c94ae5a32cc7a933a777cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e3ba4ea8e9c94ae5a32cc7a933a777cb Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-127345611 Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 7e4c22d37f6c48d59b0fa7e832c0451d Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-127345611-project Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ba58c202-2540-4594-b2ae-878e488cfeee'} Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:50.290271 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. Aug 29 10:48:50.295201 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:48:50.303244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:50.304642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:50.308907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] Returning 404 to user: Instance ba58c202-2540-4594-b2ae-878e488cfeee could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:50.313159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c0ee68a-193f-444a-82b9-16ca4c812f66 tempest-ServersNegativeTestJSON-127345611 tempest-ServersNegativeTestJSON-127345611-project] 10.222.0.47 "GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee" status: 404 len: 111 microversion: 2.1 time: 0.076906 Aug 29 10:48:50.317638 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1685/3343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:50 2022] GET /compute/v2.1/servers/ba58c202-2540-4594-b2ae-878e488cfeee => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:50.320652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.321352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.322508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.323428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.324814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.325410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.366443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.367136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.367723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.368324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lazy-loading 'fault' on Instance uuid 89ebb153-3529-4259-bb6e-a34116068b61 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:48:50.441365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20069173f154e48966504d891c5e9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914255253974433e81e245445f69dc44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:50.454192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f3b572e-9018-48e3-ab47-d2994bf7a5b2 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 200 len: 1315 microversion: 2.1 time: 0.155700 Aug 29 10:48:50.456671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1659/3344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:50 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:50.817591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:50.818386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:50.833587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.835535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.837759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:50.839867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:50.841091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:50.844109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:51.411210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:51.452869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1bf09c3-ea52-4a00-998d-a16f081361cb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.637908 Aug 29 10:48:51.457458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1686/3345] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:50 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:51.477893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:51.479451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] [instance: 89ebb153-3529-4259-bb6e-a34116068b61] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:51.498182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:51.499718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:51.501159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:51.502313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:51.502930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:51.503547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:51.524657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] HTTP exception thrown: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Request method failure captured: Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 HTTP/1.1 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJk_OfeUzcG0QE5PlD3roGr_tTDCn_f6hlm4BlEGA1n_mcF5Ex8Y-0QpffxUu0FvmksiVr0U6XWNYSNjXWJGYWU8BrUjlWLc-Xk2lbSaFH2KMiRabMqaio4wwbjaf63ptQZiGF-b6TQxnEQD18esonzThEioJFkNVk0DMLZ5A0lK9nU Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 914255253974433e81e245445f69dc44 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestFqdnHostnames-714742626 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/914255253974433e81e245445f69dc44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_914255253974433e81e245445f69dc44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/914255253974433e81e245445f69dc44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/914255253974433e81e245445f69dc44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestFqdnHostnames-714742626 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 914255253974433e81e245445f69dc44 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-714742626 Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestFqdnHostnames-714742626-project Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c20069173f154e48966504d891c5e9fc Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestFqdnHostnames-714742626-project Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '89ebb153-3529-4259-bb6e-a34116068b61'} Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:48:51.535874 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Returning 404 to user: Instance 89ebb153-3529-4259-bb6e-a34116068b61 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7d68cad-81f1-4f0d-a0d8-219dc9c77ed7 tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61" status: 404 len: 111 microversion: 2.1 time: 0.064574 Aug 29 10:48:51.540400 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1660/3346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:51 2022] GET /compute/v2.1/servers/89ebb153-3529-4259-bb6e-a34116068b61 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:48:51.551094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9dba003-a1eb-4be4-911c-9c598e319cce tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] Calling method '.version_select at 0x7f66c72b8ca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:51.580523 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9dba003-a1eb-4be4-911c-9c598e319cce tempest-ServersTestFqdnHostnames-714742626 tempest-ServersTestFqdnHostnames-714742626-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470080170" status: 202 len: 0 microversion: 2.1 time: 0.034828 Aug 29 10:48:51.583824 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1687/3347] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470080170 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:48:52.477530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:52.478808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:52.481009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:48:52.496596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:52.497109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:52.498193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:52.503576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:52.504093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:52.505644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:52.926603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:52.940911 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24887c44-a706-43f5-867c-5666c49a3ddd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.464088 Aug 29 10:48:52.958852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1661/3348] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:52 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:53.965626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:53.967700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:54.000990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:54.001968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:54.002519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:54.003440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:54.006347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:54.006912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:54.420572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:54.428869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-595ac60b-bf59-4edf-8135-6985687639dc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.469508 Aug 29 10:48:54.429470 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1688/3349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:53 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:55.450043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:55.450983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:55.469853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:55.470521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:55.470971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:55.471696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:55.474406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:55.475072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:55.969512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:55.983363 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1bf84812-9456-4369-96e4-7587e3e9402c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.537489 Aug 29 10:48:55.996538 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1662/3350] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:55 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:57.005041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:57.005674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:57.020468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:57.021234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:57.022094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:57.023013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:57.028225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:57.029078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:57.399195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:57.413871 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fd951a0-f8f2-4b1c-b80a-85b5661e8a06 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.412668 Aug 29 10:48:57.414459 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1689/3351] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:56 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:58.440707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:48:58.441869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:48:58.459094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:58.463228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:58.464870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:58.466745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:48:58.472095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:48:58.474108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:48:58.997237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-54175673", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a0b90d3c-ce19-44a7-8bf5-2f988efd695e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:48:59.142136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] validate_networks() for [('a0b90d3c-ce19-44a7-8bf5-2f988efd695e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:48:59.156909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:48:59.180166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e4795b85-da09-4a59-93e2-35805dd63b3c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.744846 Aug 29 10:48:59.186366 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1663/3352] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:48:58 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:48:59.756493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-98887a8a-8bc2-4810-a22f-32e4ab28ea0e tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Action: 'create', calling method: .version_select at 0x7f66c6f040d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1825609369"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:00.402987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:00.403469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:00.404212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:00.404820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:00.405046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:00.438767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:00.439566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:00.440830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:00.442271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:00.442924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:00.443537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:00.517567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:00.530682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for user 5e0f169bfe1145e08502f830dfd8cb9b and project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:00.571416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:00.577849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:00.606828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-98887a8a-8bc2-4810-a22f-32e4ab28ea0e tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.135510 Aug 29 10:49:00.608008 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1664/3353] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Aug 29 10:48:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1138 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 10:49:00.614645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:00.615975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:00.640095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:00.645845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:00.646415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:00.647197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:00.647725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:00.648111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:00.721958 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed50536a-f4db-4523-953e-15d6efcf5276 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070294 Aug 29 10:49:00.730078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1690/3354] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:49:00.737523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0245d644-8194-4f73-b207-7a060607fe29 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c724cca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:00.942802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0245d644-8194-4f73-b207-7a060607fe29 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.211307 Aug 29 10:49:00.944100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1691/3355] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:00 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:01.027482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:01.039781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-350c37c2-2ae5-4297-9de0-87614f2978bc tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.430447 Aug 29 10:49:01.079501 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1665/3356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:00 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:01.175249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-901402002", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a0b90d3c-ce19-44a7-8bf5-2f988efd695e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:01.320564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] validate_networks() for [('a0b90d3c-ce19-44a7-8bf5-2f988efd695e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:49:01.957479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ab6164c-814c-4d5e-9dab-dc9b02951383 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c71d5670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:02.162055 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ab6164c-814c-4d5e-9dab-dc9b02951383 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.208717 Aug 29 10:49:02.162639 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1666/3357] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:01 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:49:02.173342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:02.174026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:02.202618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:02.203163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:02.203625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:02.204324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:02.204819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:02.205269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:02.936838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:02.961673 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ccf62eb-bfde-4fa0-8d11-42d9729a6f66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.789093 Aug 29 10:49:02.979492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1667/3358] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:02 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:03.181641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d396084-2a57-4b54-a91f-d066651c32d4 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c71d59d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:03.399251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d396084-2a57-4b54-a91f-d066651c32d4 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.223804 Aug 29 10:49:03.400418 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1668/3359] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:03 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:03.662363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:03.663020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:03.663275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:03.663993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:03.664566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:03.695012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:03.696330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:03.697188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:03.702532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:03.703220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:03.703883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:03.739977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:03.786883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:03.798247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for user 5e0f169bfe1145e08502f830dfd8cb9b and project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:03.843708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:03.860256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:03.991759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:03.992695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:03.997821 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eccc2314-c78d-410c-b097-52c77723b41d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.826529 Aug 29 10:49:04.003282 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1692/3360] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:49:04.026532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:04.028757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:04.029236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:04.030332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:04.030801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:04.047347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:04.242481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-158036340", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "451", "networks": [{"uuid": "a0b90d3c-ce19-44a7-8bf5-2f988efd695e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:04.365885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] validate_networks() for [('a0b90d3c-ce19-44a7-8bf5-2f988efd695e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:49:04.900082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:04.904477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:04.911949 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d061bcfe-6586-46f5-8f28-7b0e384e74d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.926658 Aug 29 10:49:04.914095 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1669/3361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:03 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:04.926966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bfc917e-b86b-404c-9b87-5c921c73deb3 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c63c6670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:05.012044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9bfc917e-b86b-404c-9b87-5c921c73deb3 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 346 microversion: 2.1 time: 0.095776 Aug 29 10:49:05.013672 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1670/3362] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:04 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:05.324410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-596338450", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "308bdc6b-e8d8-4508-a1cf-ceecbfb08e3a"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:05.523131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] validate_networks() for [('308bdc6b-e8d8-4508-a1cf-ceecbfb08e3a', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:49:05.813678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:05.814633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:05.815285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:05.815886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:05.816489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:05.831787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:05.832287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:05.832770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:05.833517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:05.834141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:05.834580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:05.887562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:05.906972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Getting quotas for user 5e0f169bfe1145e08502f830dfd8cb9b and project 6ada15edf7104a898cf2bd66f8b16c18. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:05.953134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:05.955540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:06.085787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61165c23-3de3-4ef5-be7d-80808e2d97fe tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.847818 Aug 29 10:49:06.090759 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1693/3363] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:49:06.118370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fcaaa833-8733-408e-9a66-944218a4507b tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Action: 'create', calling method: .version_select at 0x7f66cb1a65e0>, body: {"snapshot": {"volume_id": "a3979018-558e-4b4c-8c94-6f00b18dec17", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1759103044"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:06.664288 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fcaaa833-8733-408e-9a66-944218a4507b tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.553319 Aug 29 10:49:06.664890 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1694/3364] 10.222.0.47 () {60 vars in 1162 bytes} [Mon Aug 29 10:49:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:06.670303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:06.674351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:06.691047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:06.691558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:06.692050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:06.692750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:06.693220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:06.693660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:07.281773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:07.282307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:07.282889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:07.283555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:07.284196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:07.304537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:07.305210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:07.305784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:07.306674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:07.307382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:07.307798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:07.352453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Getting quotas for project 6b81794535a44ff99cd8443007202c05. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:07.369759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Getting quotas for user a84e65d141e5499292a377f651a7e9ee and project 6b81794535a44ff99cd8443007202c05. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:07.380912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:07.390016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49c4fc47-6e93-4d15-8d01-cb51b89eb468 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.724013 Aug 29 10:49:07.398551 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1695/3365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:06 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:07.406756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:07.412679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:07.415526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:07.420606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:07.435325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:07.436211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:07.436896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:07.439377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:07.440142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:07.442415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:07.542430 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15885f25-f982-42e7-be12-899f92eab350 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.526073 Aug 29 10:49:07.550591 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1671/3366] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:49:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:49:07.556929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cce896a8-6112-4084-93e7-f2123b1a80fa tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6e3f9d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:07.758726 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cce896a8-6112-4084-93e7-f2123b1a80fa tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 287 microversion: 2.1 time: 0.206625 Aug 29 10:49:07.759829 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1672/3367] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:07 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 287 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:07.767099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-634335ac-2a23-4dc5-86aa-de86e01965d0 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:07.767964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-634335ac-2a23-4dc5-86aa-de86e01965d0 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:07.837201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:07.855762 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83b95396-8235-450a-bbbb-dfa7d24f991b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1272 microversion: 2.1 time: 0.455955 Aug 29 10:49:07.861330 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1696/3368] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:07 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:07.875187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ba94a4b8-4e05-4f98-ad45-bb0c682396d2 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c76e7280>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:07.971642 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ba94a4b8-4e05-4f98-ad45-bb0c682396d2 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.107626 Aug 29 10:49:07.972826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1697/3369] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 29 10:49:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:07.985071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b681173-da30-4af6-96aa-ca0b56451ef6 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c71664c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:08.059395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b681173-da30-4af6-96aa-ca0b56451ef6 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 287 microversion: 2.1 time: 0.077975 Aug 29 10:49:08.060314 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1698/3370] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:07 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:08.421243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:08.422055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:08.437002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:08.438126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:08.454526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:08.455741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:08.456727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:08.457542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:08.535388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-634335ac-2a23-4dc5-86aa-de86e01965d0 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:08.548250 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-634335ac-2a23-4dc5-86aa-de86e01965d0 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1215 microversion: 2.1 time: 0.786233 Aug 29 10:49:08.549590 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1673/3371] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:07 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1215 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:08.782424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb40fd7-a6de-4171-84cd-dc3d59bcc184", "tag": "57706e61-c403-49ff-adeb-f17279ff9329"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:08.802197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:08.806592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:08.807048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:08.836010 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] Creating event network-changed:57706e61-c403-49ff-adeb-f17279ff9329 for instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 on n-h1-854121-10 Aug 29 10:49:08.854656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8577a751-ecf1-4826-aa97-d8b7bd700119 req-fbd0f023-48ae-49f8-a127-46f7627d27dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077588 Aug 29 10:49:08.855762 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1674/3372] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:08.889929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:08.890642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:08.906585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:08.907096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:08.907539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:08.908256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:08.912243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:08.912695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.115326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:09.124836 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-29eb9f50-a02f-4af9-99db-b86c810b8348 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.708243 Aug 29 10:49:09.130649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1699/3373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:08 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:09.135939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f2adc36-647d-49bd-b5a6-7212597552b2 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c76e29d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:09.201797 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f2adc36-647d-49bd-b5a6-7212597552b2 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 287 microversion: 2.1 time: 0.069751 Aug 29 10:49:09.208232 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1700/3374] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:09 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:09.241852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:09.271886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-537d973c-4436-405a-a3f9-d6cd70776f8d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1278 microversion: 2.1 time: 0.389179 Aug 29 10:49:09.272885 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1675/3375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:08 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1278 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:09.350859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:09.358468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:09.364837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Searching by: {'deleted': False, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:09.376592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.377947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.380432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.381534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.387734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.390197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.576112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:09.578939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:09.613432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.618962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.620574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.621683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.622594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.623323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.786397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:09.794780 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e563189-1e55-470f-bdf7-c04664908baa tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1267 microversion: 2.1 time: 0.226032 Aug 29 10:49:09.795395 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1676/3376] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:09 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:49:09.832389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:09.906034 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02112dfd-7947-43c4-8961-ecbbca19852a tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.565329 Aug 29 10:49:09.907332 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1701/3377] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:49:09 2022] GET /compute/v2.1/servers => generated 334 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:09.923523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:09.939056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:09.942033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Searching by: {'deleted': False, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:09.950433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.951736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.952377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:09.953292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:09.953950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:09.955266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.166174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:10.166873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:10.191538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.192040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.192487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.193203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.208466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.208938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.212936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:10.377025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:10.390254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.391027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.391639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.766975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dcb50f83-7025-47e4-b926-df3b4acf35b8 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.849091 Aug 29 10:49:10.768708 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1677/3378] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:49:09 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:10.788484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-931a4301-818d-4bdf-ab49-dad5376e2dc7 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c64ada60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:10.851614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:10.867288 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb4d4e7c-80b1-4814-81d3-bfd6846f5ec0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.708532 Aug 29 10:49:10.871767 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1702/3379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:10 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:10.884259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:10.887716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:10.895404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-931a4301-818d-4bdf-ab49-dad5376e2dc7 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 288 microversion: 2.1 time: 0.125197 Aug 29 10:49:10.895977 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1678/3380] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:10 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:10.901018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-79dc7c65-9d65-4eab-bcb7-91d6e19b5177 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:10.919794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.922537 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-79dc7c65-9d65-4eab-bcb7-91d6e19b5177 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024616 Aug 29 10:49:10.923029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.923831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.923998 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1679/3381] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:49:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:10.925403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.928708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:10.929326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:10.930475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.931996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.950427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.955250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.958274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:10.960802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:10.963386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:10.964160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.210907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:11.238192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ab2f527-192b-423e-b4e1-f2431bdf3952 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1273 microversion: 2.1 time: 0.310143 Aug 29 10:49:11.239782 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1680/3382] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:10 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:11.259799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74c9c255-3322-48df-9bd8-609a8dbb8cc8 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6ef93a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:11.328092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:11.342338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1b0d8ad-e97b-4f99-8674-a12d9926a7d8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1278 microversion: 2.1 time: 0.465936 Aug 29 10:49:11.343720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1703/3383] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:10 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1278 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:11.362197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:11.364300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:11.382652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.386436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.387823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.391249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.392986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.394895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.401733 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74c9c255-3322-48df-9bd8-609a8dbb8cc8 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 202 len: 0 microversion: 2.1 time: 0.159321 Aug 29 10:49:11.402552 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1681/3384] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 29 10:49:11 2022] DELETE /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:11.412626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7739c55b-f9af-4866-83f9-286e7493cbff tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6e97d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:11.477217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:49:11.492045 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7739c55b-f9af-4866-83f9-286e7493cbff tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 287 microversion: 2.1 time: 0.083017 Aug 29 10:49:11.492910 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1682/3385] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:11 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:11.497671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f640f2-6165-4749-852b-342c549110cb", "tag": "4258a877-52ad-4679-adc4-06ab9f9da3c6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:11.531957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.540904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.541950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.602052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] Creating event network-changed:4258a877-52ad-4679-adc4-06ab9f9da3c6 for instance 90f640f2-6165-4749-852b-342c549110cb on n-h1-854121-10 Aug 29 10:49:11.617973 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b842e6ad-c7a3-4b7c-9363-b2e85fd2dfd3 req-69d512cc-e187-443f-8454-493a615e8854 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122455 Aug 29 10:49:11.618808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1683/3386] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:11.788680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-554f0e4c-1b07-4fc9-8750-f437c6f3f094 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 204 len: 0 microversion: 2.1 time: 0.439552 Aug 29 10:49:11.789284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1704/3387] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:49:11 2022] DELETE /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:49:11.798814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:11.799587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:11.821734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.821976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.822422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.823334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.823967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.824590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.891938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:11.892574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:11.905333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:11.916087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.916756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.917217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:11.919291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:11.921995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:11.922491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:12.465749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:12.475389 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c6c9dc4-8316-447d-96cc-eb06f2d7a293 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1700 microversion: 2.1 time: 0.681519 Aug 29 10:49:12.476648 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1684/3388] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:11 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1700 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:12.481479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:12.492071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:12.506266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:12.506765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:12.507389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:12.509082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:12.509839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:12.510614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:12.825491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:12.835693 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8ea4bdc-fbe8-420a-8165-5d5a10091f44 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.948382 Aug 29 10:49:12.851073 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1705/3389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:11 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:49:12.858135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:12.859147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:12.867184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:12.868012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:12.868625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:12.869497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:12.870164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:12.870747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:12.914063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:12.927620 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-419f4910-9700-40f2-9d05-c8d38563d35e tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.448267 Aug 29 10:49:12.929091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1685/3390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:12 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:12.935515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67013749-a67d-40f6-878c-a534ccc939a1 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6ef9670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:13.003389 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67013749-a67d-40f6-878c-a534ccc939a1 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 200 len: 287 microversion: 2.1 time: 0.073007 Aug 29 10:49:13.008139 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1686/3391] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:12 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:13.319329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:13.336187 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7606c370-e05f-4337-a02f-b980cbb617c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.483631 Aug 29 10:49:13.337804 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1706/3392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:12 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:13.498037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:13.498820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:13.515074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:13.515567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:13.526618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:13.527613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:13.528246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:13.529560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:13.860515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:13.861139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:13.877379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:13.878254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:13.878708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:13.880270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:13.881239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:13.882326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:14.427266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:14.444231 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c07c794f-78d1-4086-ba18-f1524b37beae tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.589000 Aug 29 10:49:14.451469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:14.466158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1707/3393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:13 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:14.475797 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b949218f-23af-45c1-8a9c-77beaede2b58 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1700 microversion: 2.1 time: 0.982530 Aug 29 10:49:14.478370 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1687/3394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:13 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1700 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:14.482164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:14.484430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:14.499720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22373311-2ae5-4dcf-9a68-9573d6187d53 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c63c6040>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:14.542459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:14.543005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:14.543475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:14.578443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:14.582790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:14.583282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:14.625175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-22373311-2ae5-4dcf-9a68-9573d6187d53 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] HTTP exception thrown: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22373311-2ae5-4dcf-9a68-9573d6187d53 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Request method failure captured: Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 HTTP/1.1 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJmb5FjbmtJqstNWXklEEWEXtTtw6TiRNOio-wbIEQIWPRWfUVjAKKDRtBI36BjYJgb4WbJ0yEQ43lYTrNALQkpFY4rEFZ3ZYwD1IOfNj5WMluY4inh3ObYEhfHSkVlihvt1BGJ_HsWlWEBdN_kpkdhLrCquRhWrw2kzsO3K4YuPH38 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e8b8a1fa81d14acda8c082487b62cfe4 Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: exception: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c74c0153-3c52-4940-b7ae-5c56c6688aa2'} Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. (HTTP 404) (Request-ID: req-cec9d465-e1a4-44ca-8621-5e5a3895a67d) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:14.640147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22373311-2ae5-4dcf-9a68-9573d6187d53 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Returning 404 to user: Snapshot c74c0153-3c52-4940-b7ae-5c56c6688aa2 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:14.644270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22373311-2ae5-4dcf-9a68-9573d6187d53 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2" status: 404 len: 111 microversion: 2.1 time: 0.161599 Aug 29 10:49:14.650535 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1688/3395] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 10:49:14 2022] GET /compute/v2.1/os-snapshots/c74c0153-3c52-4940-b7ae-5c56c6688aa2 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:14.652005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:14.652628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:14.674023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:14.674531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:14.674976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:14.675689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:14.676150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:14.676582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.519193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:15.534838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e31d326-8dd2-49b7-992b-77470bff0462 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.887195 Aug 29 10:49:15.536530 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1689/3396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:14 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:15.549515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2634f36-ac80-4fe0-b38b-384391596761 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6ef93a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:15.559430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:15.569967 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d36f96b6-4f68-4c8b-8c93-c872c02a17b4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 1.099293 Aug 29 10:49:15.573962 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1708/3397] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:14 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:15.591833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:15.592673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:15.617788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.618300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.618743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.623524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.625346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.627429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.677862 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d20d74b5-2da4-4e0c-ae9a-be9c6ea3cd12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/ips" status: 200 len: 148 microversion: 2.1 time: 0.102470 Aug 29 10:49:15.678819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1709/3398] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:49:15 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/ips => generated 148 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:15.683627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:15.685575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:15.692098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.692883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.693515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.694440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.695267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.695891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.722156 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2634f36-ac80-4fe0-b38b-384391596761 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 202 len: 0 microversion: 2.1 time: 0.183414 Aug 29 10:49:15.727063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1690/3399] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:49:15 2022] DELETE /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:15.741343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:15.745671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:15.777133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.777980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.780082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.781642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:15.783788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:15.784427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:15.924251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:16.588615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:16.601660 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1796c8d4-a0b3-4fd0-93cf-98a8fbbfd307 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1700 microversion: 2.1 time: 0.873220 Aug 29 10:49:16.603025 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1691/3400] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:15 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1700 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:16.620555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:16.641043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b40bf168-aa72-46e6-b822-145145976282"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:16.649425 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6896b631-327a-44a4-b289-90cc5b839b23 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.969253 Aug 29 10:49:16.650873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1710/3401] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:15 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:16.654952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:16.657504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c162c2d2-3b43-42b5-a024-c6bc21fec80e tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c791ee50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:16.683219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.684341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.689181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.693521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.694389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.695001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.756675 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c162c2d2-3b43-42b5-a024-c6bc21fec80e tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.104229 Aug 29 10:49:16.757246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1711/3402] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:16 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:16.762478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38737e8b-b172-4bcc-9eb3-d4cf4872512d", "tag": "df530762-68d4-48a1-bbba-0107c563728a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:16.783420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.784137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.784891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.809155 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] Creating event network-changed:df530762-68d4-48a1-bbba-0107c563728a for instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d on n-h1-854121-10 Aug 29 10:49:16.822069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3a2030ba-9d51-4914-a01c-44cfdc1b8ad1 req-44b4d118-24a6-486b-aaac-5acae1404918 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062893 Aug 29 10:49:16.823437 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1712/3403] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:16.832004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:16.833203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:16.846039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.846790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.847467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.848963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.849649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.850518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.894802 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/os-volume_attachments HTTP/1.1 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 74 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: {"volumeAttachment": {"volumeId": "b40bf168-aa72-46e6-b822-145145976282"}} Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': 'eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc', 'body': {'volumeAttachment': {'volumeId': 'b40bf168-aa72-46e6-b822-145145976282'}}} Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:49:16.897010 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff Aug 29 10:49:16.901160 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:16.905680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 400 to user: Invalid volume: volume b40bf168-aa72-46e6-b822-145145976282 is already attached to instances: 1e84f4fb-ead3-47cf-82d1-48637080f1ff {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:16.906935 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9143afb-e287-456b-a158-04a8d43352b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.302446 Aug 29 10:49:16.908258 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1692/3404] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:49:16 2022] POST /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc/os-volume_attachments => generated 174 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:49:16.914435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:16.915662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:16.924581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.925658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.926383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:16.927331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:16.931394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:16.932299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:17.658257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:17.668490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:17.674548 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7968474f-d699-4636-ad9d-abe44528d1f3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.848572 Aug 29 10:49:17.690148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-213237ac-dda1-40d2-b4b5-9833247355df tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.769919 Aug 29 10:49:17.690148 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1693/3405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:16 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:17.694448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:17.695292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:17.697758 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1713/3406] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:16 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:17.710804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:17.711872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:17.712274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:17.712890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:17.713556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:17.714521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:17.717428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:17.718228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:17.725880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:17.726390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:17.726889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:17.727555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:17.728138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:17.728582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:17.743468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:17.790481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:49:17.926017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:17.955651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41702b17-2576-44f9-9933-b6ac01dd30a2 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1632 microversion: 2.1 time: 0.244117 Aug 29 10:49:17.957157 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1714/3407] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:17 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1632 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:17.974610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:17.982008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:17.993393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:17.998697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:17.999441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.000539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.001197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.001865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.014186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-588f12db-5080-4a07-b6ac-5eb4e8e95dae tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 204 len: 0 microversion: 2.1 time: 0.329613 Aug 29 10:49:18.018256 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1694/3408] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:49:17 2022] DELETE /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:49:18.023907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d7fc07-8823-4b73-8c7c-5e93f38cc831", "tag": "bb967869-2072-42f0-8c1b-23d5a364e312"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:18.046723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.051028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.051714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.094679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] Creating event network-changed:bb967869-2072-42f0-8c1b-23d5a364e312 for instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 on n-h1-854121-10 Aug 29 10:49:18.103694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6cf1db83-e0be-49b8-b814-270e25b3cc40 req-5e294c9b-dece-4510-b001-db4115c527f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083842 Aug 29 10:49:18.106333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1695/3409] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:18.112690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-652c4190-2a45-42cb-8060-49bcc66da00d tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6e4c5e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:18.231610 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-652c4190-2a45-42cb-8060-49bcc66da00d tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.121687 Aug 29 10:49:18.232337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1696/3410] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:18 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:18.239024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:18.240734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:18.266496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.268984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.271877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.273984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.275799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.277594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.593771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:18.602404 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2a365eb-b403-4e1d-93f4-b6fb131985d9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.642882 Aug 29 10:49:18.606542 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1715/3411] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:17 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:18.619235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb40fd7-a6de-4171-84cd-dc3d59bcc184", "name": "network-vif-plugged", "status": "completed", "tag": "57706e61-c403-49ff-adeb-f17279ff9329"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:18.644406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.647948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.652202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.677086 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] Creating event network-vif-plugged:57706e61-c403-49ff-adeb-f17279ff9329 for instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 on n-h1-854121-10 Aug 29 10:49:18.683746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-914c020a-939c-4b0f-8736-0e49122ce524 req-585563a9-a151-411b-9dd9-8b6076ac8fe6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068356 Aug 29 10:49:18.687715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1716/3412] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:18.708386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:18.709389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:18.719186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.719984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.720848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.721855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.722614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.726820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:18.731237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:18.736296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.742536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c198587e-0d06-4887-952b-7874774f9c85 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1680 microversion: 2.1 time: 0.508599 Aug 29 10:49:18.743130 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1697/3413] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:18 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1680 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:18.752665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:18.755222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:18.772321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.773077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.773739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:18.775368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:18.777186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:18.777875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.368466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:19.377322 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4caf944c-c5b6-4c73-9c63-0e973770af8c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.674257 Aug 29 10:49:19.390543 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1717/3414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:18 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:19.399449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:19.400071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:19.418714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.421377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.423231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.424500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.424979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.425415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.659940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:19.675423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee79eea8-5e2c-439f-b85a-585fbe4a0bd5 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1632 microversion: 2.1 time: 0.283937 Aug 29 10:49:19.683630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:19.692849 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7640d083-ced5-4c47-a4aa-40ba068f1226 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.948639 Aug 29 10:49:19.694102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1718/3415] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:19 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1632 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:19.710490 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1698/3416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:18 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:19.710769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5962bc6-68c8-4c06-9608-6ebb6828c707 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66cb1a6040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:19.729073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:19.734809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:19.742351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:19.760703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.761473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.762278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.766189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.766952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.767559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.842767 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5962bc6-68c8-4c06-9608-6ebb6828c707 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 200 len: 345 microversion: 2.1 time: 0.148036 Aug 29 10:49:19.844105 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1719/3417] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:19 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:19.849274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c544997-e71f-4469-a745-db7526a5cddd tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Action: 'create', calling method: .version_select at 0x7f66c7c45a60>, body: {"keypair": {"name": "tempest-keypair-837590850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxjb3gWDebFPO0EEWhBQ8E1MnkDOoJ1Sy5cRHGAEzWQS8U4YkMmTbAdonRrkcR35Y4CH8RtSb+dJD9vpnEHFSzcv/XdE4zzZaYVoxa7D0x3bKEEPIsb6cqQQPP6a0rjWA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:19.882425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7c544997-e71f-4469-a745-db7526a5cddd tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Getting quotas for project f057d6a6e36e46be8ea64b5cbf9a8075. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:19.895375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-7c544997-e71f-4469-a745-db7526a5cddd tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Getting quotas for user 49a766c739f647b1a3f0187f77519fe5 and project f057d6a6e36e46be8ea64b5cbf9a8075. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:19.951502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c544997-e71f-4469-a745-db7526a5cddd tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.105877 Aug 29 10:49:19.952132 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1720/3418] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:49:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:49:19.962024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:19.962645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:19.974449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.975218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.975847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:19.976562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:19.977018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:19.977442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:20.109616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:20.375607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=10 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:20.765920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:20.777274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:20.780783 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97337e6f-7bcf-4276-baed-b0b121aa10bc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1680 microversion: 2.1 time: 0.827306 Aug 29 10:49:20.799983 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1721/3419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:19 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1680 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:20.806376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:20.807175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:20.808428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb9ccf65-f7b6-4279-850d-44cafe4dfcfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 1.095023 Aug 29 10:49:20.817950 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1699/3420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:19 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:20.818183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:20.826653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:20.827522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:20.828371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a99905-761f-4dd1-9455-365346817589", "name": "network-vif-deleted", "tag": "cb8b11e9-b1c7-4450-ab19-a96af3fe15b8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:20.831588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:20.832161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:20.834310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:20.840055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:20.840918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:20.842145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:20.870573 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] Creating event network-vif-deleted:cb8b11e9-b1c7-4450-ab19-a96af3fe15b8 for instance f0a99905-761f-4dd1-9455-365346817589 on n-h1-854121-10 Aug 29 10:49:20.882007 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bb868d56-9257-4451-abef-858f6ef91e30 req-36949b91-fe2e-47a3-bc95-ee80a9722fac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062673 Aug 29 10:49:20.882915 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1700/3421] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:20.895220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:20.896243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:20.910104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:20.910596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:20.911035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:20.911746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:20.912202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:20.912620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.335934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbfc61871ca4d42916442e0f674fd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6bfe0f01c849c5a54583df4c61dfb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:21.349376 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f48fa2d-766d-442d-bf07-e93a4695f707 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 200 len: 1632 microversion: 2.1 time: 0.465030 Aug 29 10:49:21.349995 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1701/3422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:20 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 1632 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:21.370338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:21.371296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:21.391312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.391812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.392257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.393016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.393476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.394047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.608744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:21.616794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12d969a4-bb04-4be8-84b8-4ad82d3c7a82 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.815432 Aug 29 10:49:21.619162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1722/3423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:20 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:21.645569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d0f2db-ce71-4579-8ae3-b85af09a5651 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66cb1a6310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:21.726455 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-24d0f2db-ce71-4579-8ae3-b85af09a5651 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] HTTP exception thrown: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d0f2db-ce71-4579-8ae3-b85af09a5651 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Request method failure captured: Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 HTTP/1.1 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJmb5FjbmtJqstNWXklEEWEXtTtw6TiRNOio-wbIEQIWPRWfUVjAKKDRtBI36BjYJgb4WbJ0yEQ43lYTrNALQkpFY4rEFZ3ZYwD1IOfNj5WMluY4inh3ObYEhfHSkVlihvt1BGJ_HsWlWEBdN_kpkdhLrCquRhWrw2kzsO3K4YuPH38 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e8b8a1fa81d14acda8c082487b62cfe4 Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: exception: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a3979018-558e-4b4c-8c94-6f00b18dec17'} Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. (HTTP 404) (Request-ID: req-0bb3ccaf-9f22-4d55-83ae-debecbfec54a) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:21.730710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.737118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24d0f2db-ce71-4579-8ae3-b85af09a5651 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Returning 404 to user: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:21.742278 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24d0f2db-ce71-4579-8ae3-b85af09a5651 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 404 len: 109 microversion: 2.1 time: 0.113724 Aug 29 10:49:21.744508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1723/3424] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:21 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:21.756952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f1f2964-2196-415d-b035-b233929b9c22 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66cb142160>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:21.819165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:21.832596 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4bf9d081-9ffa-4e51-bcac-94156e5ea3c2 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.481365 Aug 29 10:49:21.849831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-7f1f2964-2196-415d-b035-b233929b9c22 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] HTTP exception thrown: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f1f2964-2196-415d-b035-b233929b9c22 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Request method failure captured: Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 HTTP/1.1 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJmb5FjbmtJqstNWXklEEWEXtTtw6TiRNOio-wbIEQIWPRWfUVjAKKDRtBI36BjYJgb4WbJ0yEQ43lYTrNALQkpFY4rEFZ3ZYwD1IOfNj5WMluY4inh3ObYEhfHSkVlihvt1BGJ_HsWlWEBdN_kpkdhLrCquRhWrw2kzsO3K4YuPH38 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e8b8a1fa81d14acda8c082487b62cfe4 Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: exception: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a3979018-558e-4b4c-8c94-6f00b18dec17'} Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. (HTTP 404) (Request-ID: req-bde41ce1-8b0b-44a6-b606-64bebaa83152) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:21.856410 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:21.865180 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:21.876434 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1702/3425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:21 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:21.876434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:21.876434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:21.877250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f1f2964-2196-415d-b035-b233929b9c22 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Returning 404 to user: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:21.877250 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7f1f2964-2196-415d-b035-b233929b9c22 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 404 len: 109 microversion: 2.1 time: 0.129816 Aug 29 10:49:21.878587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1724/3426] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:49:21 2022] DELETE /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:21.892047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:21.893080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:21.893555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.894960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.895418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.896136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.896593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.897015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.914232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.916241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.917777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:21.921019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:21.922283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:21.924853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.350746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:22.365921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dedb9717-0b68-4098-8109-f100a99c19c6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1680 microversion: 2.1 time: 0.503734 Aug 29 10:49:22.379482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1703/3427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:21 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1680 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:22.379482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-417cc66f-8e01-4da6-8dce-4c4dd20f6130 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Calling method '.version_select at 0x7f66c6ef93a0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:22.415002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-417cc66f-8e01-4da6-8dce-4c4dd20f6130 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] HTTP exception thrown: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-417cc66f-8e01-4da6-8dce-4c4dd20f6130 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Request method failure captured: Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 HTTP/1.1 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJmb5FjbmtJqstNWXklEEWEXtTtw6TiRNOio-wbIEQIWPRWfUVjAKKDRtBI36BjYJgb4WbJ0yEQ43lYTrNALQkpFY4rEFZ3ZYwD1IOfNj5WMluY4inh3ObYEhfHSkVlihvt1BGJ_HsWlWEBdN_kpkdhLrCquRhWrw2kzsO3K4YuPH38 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c9b1de15154dc0874dc71068de3cde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 33c9b1de15154dc0874dc71068de3cde Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1392967841 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e8b8a1fa81d14acda8c082487b62cfe4 Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1392967841-project Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a3979018-558e-4b4c-8c94-6f00b18dec17'} Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. (HTTP 404) (Request-ID: req-441fe84c-4af3-4de6-8875-d79b18485470) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:22.419869 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-417cc66f-8e01-4da6-8dce-4c4dd20f6130 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] Returning 404 to user: Volume a3979018-558e-4b4c-8c94-6f00b18dec17 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-417cc66f-8e01-4da6-8dce-4c4dd20f6130 tempest-VolumesSnapshotsTestJSON-1392967841 tempest-VolumesSnapshotsTestJSON-1392967841-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17" status: 404 len: 109 microversion: 2.1 time: 0.053955 Aug 29 10:49:22.425679 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1704/3428] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:22 2022] GET /compute/v2.1/os-volumes/a3979018-558e-4b4c-8c94-6f00b18dec17 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:22.442960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:22.443518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] [instance: f0a99905-761f-4dd1-9455-365346817589] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:22.462339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.462848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.463295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.465221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.465221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.465811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.473033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:22.485137 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55e4791d-532f-4c7c-a007-2aac20d61974 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.604506 Aug 29 10:49:22.487918 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1725/3429] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:21 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:22.510930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] HTTP exception thrown: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Request method failure captured: Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 HTTP/1.1 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJlXgF-I5-xekmjqJUtdPtWtKQBADiCe7EUUj05v-Mz9F0Kq6kb19ZuHrPh8MLVDfYqXB3ooDn4yoyyaIkvFbeO7_CbL68Zgx4vvl4ohJLNSAo8u1TbP9MjFbqgC4_76bWNMukDxov7mbLkzi-QZezBIrL-2LJChJgxEPd-SPkBQ4ZQ Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 8c6bfe0f01c849c5a54583df4c61dfb3 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-1490430558 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c6bfe0f01c849c5a54583df4c61dfb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8c6bfe0f01c849c5a54583df4c61dfb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8c6bfe0f01c849c5a54583df4c61dfb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8c6bfe0f01c849c5a54583df4c61dfb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-1490430558 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 8c6bfe0f01c849c5a54583df4c61dfb3 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-1490430558 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-1490430558-project Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 1fbfc61871ca4d42916442e0f674fd26 Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-1490430558-project Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f0a99905-761f-4dd1-9455-365346817589'} Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:22.514065 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. Aug 29 10:49:22.520622 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:22.524822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Returning 404 to user: Instance f0a99905-761f-4dd1-9455-365346817589 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:22.526051 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-875d7c6c-6cd9-4631-b7d1-632b36e06051 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589" status: 404 len: 111 microversion: 2.1 time: 0.102725 Aug 29 10:49:22.527211 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1705/3430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:22 2022] GET /compute/v2.1/servers/f0a99905-761f-4dd1-9455-365346817589 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:22.535730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f100c6c1-567f-44b8-83d5-426f405aad18 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] Calling method '.version_select at 0x7f66cb1a6040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:22.572831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f100c6c1-567f-44b8-83d5-426f405aad18 tempest-ServersTestJSON-1490430558 tempest-ServersTestJSON-1490430558-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-758768027" status: 202 len: 0 microversion: 2.1 time: 0.040790 Aug 29 10:49:22.573427 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1726/3431] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-758768027 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:22.644425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:22.648997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:22.673343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:22.679513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.682343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.685376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.697498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.698323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.699904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.870670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:22.872096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:22.880563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.883877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.884507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:22.886114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:22.890441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:22.892300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:23.351508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:23.361981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3667bba6-ad15-484c-bf52-68fa10820feb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.726173 Aug 29 10:49:23.362858 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1706/3432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:22 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:23.376235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:23.390330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:23.390659 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2974ef03-7eb7-436c-9c69-e52e44273464 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.524203 Aug 29 10:49:23.391430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:23.391710 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1727/3433] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:22 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:49:23.399682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:23.400978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:23.401764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:23.402845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:23.403510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:23.404174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:23.510549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:23.511576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:23.520967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:23.521664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:23.522223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:23.523152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:23.523686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:23.524208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:23.529333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:23.537810 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-473ebe88-0d37-45e3-a96c-53a400a7bce1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 200 len: 1612 microversion: 2.1 time: 0.151489 Aug 29 10:49:23.538585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1707/3434] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:23 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 1612 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:24.112310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc", "name": "network-vif-deleted", "tag": "86e90235-88bd-455f-8c6d-9f3c715d5b06"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:24.121839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:24.127674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:24.128384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:24.129022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:24.138386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9a3cc15-3bcd-46b2-be1c-b26705918043 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1507 microversion: 2.1 time: 0.632015 Aug 29 10:49:24.144275 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] Creating event network-vif-deleted:86e90235-88bd-455f-8c6d-9f3c715d5b06 for instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc on n-h1-854121-10 Aug 29 10:49:24.150335 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6a16efe7-139f-406c-95c3-0da53169e4e8 req-675ef239-6e99-4e76-afeb-aded716fc9a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041405 Aug 29 10:49:24.151677 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1708/3435] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:49:24.157869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1728/3436] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:23 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1507 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:49:24.385800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:24.388119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:24.411239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:24.411766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:24.412485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:24.413495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:24.418315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:24.420130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:24.420909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:24.421643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:24.422271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:24.423181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:24.423801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:24.424391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:24.426034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:24.427363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:25.540929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:25.558592 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b5c9b52-f9e3-4501-ba75-00b7b9635184 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 1.177599 Aug 29 10:49:25.572856 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1709/3437] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:24 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:25.589352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:25.596790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:25.617381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:25.622415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:25.629347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:25.634219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:25.636584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:25.640786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:25.693095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc HTTP/1.1 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc'} Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:25.697205 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:49:25.701494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:25.707331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:25.711767 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a7fcbf4-5b56-4c16-9003-b699c78a4fb9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 404 len: 111 microversion: 2.1 time: 0.136751 Aug 29 10:49:25.719463 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1710/3438] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:25 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:25.726590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38737e8b-b172-4bcc-9eb3-d4cf4872512d", "name": "network-vif-plugged", "status": "completed", "tag": "df530762-68d4-48a1-bbba-0107c563728a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:25.755310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:25.758812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:25.761875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:25.799466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] Creating event network-vif-plugged:df530762-68d4-48a1-bbba-0107c563728a for instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d on n-h1-854121-10 Aug 29 10:49:25.816907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-83c486e8-87c0-4b8a-920d-be20a1b99fb8 req-ed8b2706-9e66-49b1-8525-311c62add1d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095426 Aug 29 10:49:25.821534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1711/3439] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:25.828772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:25.830767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:25.854936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:25.856363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:25.858231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:25.859367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:25.859950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:25.860488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:26.056085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:26.070890 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48dfe591-37d9-4025-9d47-72009a413ccd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 1.662431 Aug 29 10:49:26.071767 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1729/3440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:24 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:26.081014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2eba1192-6c4b-46b7-b91b-79a1875af770 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '.version_select at 0x7f66cb1989d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:26.102446 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2eba1192-6c4b-46b7-b91b-79a1875af770 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552193147" status: 202 len: 0 microversion: 2.1 time: 0.029247 Aug 29 10:49:26.103701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1730/3441] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552193147 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:26.366338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77280d0c-d07a-47da-8ca4-5230f8ecb225 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Action: 'create', calling method: .version_select at 0x7f66cb1a6820>, body: {"keypair": {"name": "tempest-keypair-738459067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJNuzISt697jRpfUT5IMLy22bLqpGNdrYKhQmvvRy78uVq6cacO6EkAYG9pJcpRA6fL3pF+nZSwyizSYrijLy67f2fzWgANI3AnMxKVH1UE1Kkf7z7yKsDPQ/1wZGFZzg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:26.413412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-77280d0c-d07a-47da-8ca4-5230f8ecb225 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:26.446485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-77280d0c-d07a-47da-8ca4-5230f8ecb225 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for user e64edcaf463d45b0a104bf51c8cf1c6b and project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:26.518125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77280d0c-d07a-47da-8ca4-5230f8ecb225 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.413047 Aug 29 10:49:26.524360 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1731/3442] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:49:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:26.625363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-342c0373-8d92-42bd-9a88-2d9c16cfed45 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Action: 'create', calling method: .version_select at 0x7f66cb168040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1336300910", "metadata": {"Type": "work"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-342c0373-8d92-42bd-9a88-2d9c16cfed45 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 122 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1336300910", "metadata": {"Type": "work"}}} Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: method: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1336300910', 'metadata': {'Type': 'work'}}}} Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:49:26.640670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-342c0373-8d92-42bd-9a88-2d9c16cfed45 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:26.645575 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-342c0373-8d92-42bd-9a88-2d9c16cfed45 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121319 Aug 29 10:49:26.650423 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1732/3443] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 29 10:49:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:49:26.660817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:26.672095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-254cad5d-a7ff-4b18-b11a-5c68bfbb1844 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.848459 Aug 29 10:49:26.673963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1712/3444] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:25 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:26.679864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:26.681392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:26.685139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1637022151", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "453b3a88-c55d-4d11-83ba-3874bb1e137c"}, {"port": "95f22f43-ba65-4323-8dc1-b3d94b0cd93d", "tag": "port-1"}, {"port": "2e0c26f5-0c19-4878-8c92-671fdcd5dc9d", "tag": "port-2"}, {"uuid": "a32f804d-86a2-455a-9b36-dddda2ab0d76", "tag": "net-1"}, {"uuid": "a32f804d-86a2-455a-9b36-dddda2ab0d76"}, {"uuid": "79e978d1-b654-4ede-be03-884ba3af4fd8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "79e978d1-b654-4ede-be03-884ba3af4fd8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8679cdeb-0664-4935-8dd2-c043a2e1dca1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fd40ee32-0e4d-4472-97fa-ad026aea4d27", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "04cc3dac-7328-4a6e-8a23-139a70dd42d1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--71689154"}], "key_name": "tempest-keypair-837590850", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:26.689639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:26.691184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:26.691792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:26.692709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:26.693655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:26.694946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:26.939767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] validate_networks() for [('453b3a88-c55d-4d11-83ba-3874bb1e137c', None, None, None, None, None), (None, None, '95f22f43-ba65-4323-8dc1-b3d94b0cd93d', None, None, None), (None, None, '2e0c26f5-0c19-4878-8c92-671fdcd5dc9d', None, None, None), ('a32f804d-86a2-455a-9b36-dddda2ab0d76', None, None, None, None, None), ('a32f804d-86a2-455a-9b36-dddda2ab0d76', None, None, None, None, None), ('79e978d1-b654-4ede-be03-884ba3af4fd8', '10.2.2.100', None, None, None, None), ('79e978d1-b654-4ede-be03-884ba3af4fd8', '10.2.2.200', None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:49:27.423828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:27.441796 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7ae1bae-949e-4070-8360-640fd2e152f9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1320 microversion: 2.1 time: 0.766006 Aug 29 10:49:27.451473 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1713/3445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:26 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1320 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:27.456738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27c6726a-6445-4d35-91cd-550bc4565c44 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Action: 'create', calling method: .version_select at 0x7f66c6d8a310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-167883970", "metadata": {"Type": "work"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27c6726a-6445-4d35-91cd-550bc4565c44 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 119 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-167883970", "metadata": {"Type": "work"}}} Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-167883970', 'metadata': {'Type': 'work'}}}} Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi '0' Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:49:27.468286 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27c6726a-6445-4d35-91cd-550bc4565c44 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:27.473121 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27c6726a-6445-4d35-91cd-550bc4565c44 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017920 Aug 29 10:49:27.477798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1714/3446] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 29 10:49:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:49:27.488478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:27.491440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:27.516287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:27.517020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:27.517470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:27.518230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:27.518783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:27.519274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:28.391431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:28.399644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d338eed1-1df2-4870-9de6-e94860a540f3 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.920723 Aug 29 10:49:28.400228 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1715/3447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:27 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:28.416065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0abccee-bd65-44f7-b1eb-6b91ffa866b5 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Action: 'create', calling method: .version_select at 0x7f66c78f9b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-644955223", "metadata": {"Type": "work"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0abccee-bd65-44f7-b1eb-6b91ffa866b5 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 118 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-644955223", "metadata": {"Type": "work"}}} Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-644955223', 'metadata': {'Type': 'work'}}}} Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi '' Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:49:28.439722 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0abccee-bd65-44f7-b1eb-6b91ffa866b5 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:28.444297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0abccee-bd65-44f7-b1eb-6b91ffa866b5 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.039977 Aug 29 10:49:28.451559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1716/3448] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 29 10:49:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:49:28.463904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:28.464518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:28.491472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:28.491970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:28.501394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:28.507234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:28.509945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:28.510435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:29.014234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:29.025991 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2f7918d-6068-46de-a643-827ee210f871 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.573375 Aug 29 10:49:29.068831 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1717/3449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:28 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:29.097454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:29.100580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:29.144017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:29.144754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:29.149662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:29.150810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:29.151515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:29.152155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:29.343213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'services' on Instance uuid 1e84f4fb-ead3-47cf-82d1-48637080f1ff {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:49:29.507530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-13be883e-d697-416d-aabc-ee2f7804be02 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments/b40bf168-aa72-46e6-b822-145145976282" status: 202 len: 0 microversion: 2.1 time: 0.436769 Aug 29 10:49:29.519101 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1718/3450] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:49:29 2022] DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments/b40bf168-aa72-46e6-b822-145145976282 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:29.524838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e256ea2-ae2b-49b8-91a0-d30456d0e40b tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Calling method '.version_select at 0x7f66c7035d30>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:29.611334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-2e256ea2-ae2b-49b8-91a0-d30456d0e40b tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] HTTP exception thrown: Volume tempest-invalid-1528567180 could not be found. Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e256ea2-ae2b-49b8-91a0-d30456d0e40b tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1528567180 HTTP/1.1 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume tempest-invalid-1528567180 could not be found. Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'tempest-invalid-1528567180'} Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1528567180 could not be found. (HTTP 404) (Request-ID: req-a72945b1-882b-4092-805c-e44d604984e9) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:29.614501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1528567180 could not be found. Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1528567180 could not be found. Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1528567180 could not be found. Aug 29 10:49:29.620001 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:29.626165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e256ea2-ae2b-49b8-91a0-d30456d0e40b tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 404 to user: Volume tempest-invalid-1528567180 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:29.627233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2e256ea2-ae2b-49b8-91a0-d30456d0e40b tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1528567180" status: 404 len: 99 microversion: 2.1 time: 0.106629 Aug 29 10:49:29.632734 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1719/3451] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:49:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1528567180 => generated 99 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:49:29.642845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:29.643905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:29.663645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:29.664368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:29.666521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:29.667478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:29.669852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:29.673584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:30.585097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:30.605539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bceaca92-1f87-4305-802d-409b9f647310 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1511 microversion: 2.1 time: 0.970174 Aug 29 10:49:30.610079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1720/3452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:29 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:30.625213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f640f2-6165-4749-852b-342c549110cb", "name": "network-vif-plugged", "status": "completed", "tag": "4258a877-52ad-4679-adc4-06ab9f9da3c6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:30.658734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:30.659215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:30.659648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:30.663963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:30.696381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] Creating event network-vif-plugged:4258a877-52ad-4679-adc4-06ab9f9da3c6 for instance 90f640f2-6165-4749-852b-342c549110cb on n-h1-854121-10 Aug 29 10:49:30.719291 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f6bce25f-01df-4bd2-b947-9f43b814c0ca req-610e8197-530e-4e4a-a7d3-cd71b523d538 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105950 Aug 29 10:49:30.728430 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1721/3453] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:30.769140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:30.771561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:30.786164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:30.786850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:30.787386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:30.788854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:30.789534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:30.791227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:31.589410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:31.608716 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ed89cfc-6ef2-4167-a4bb-745b3474a292 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.878658 Aug 29 10:49:31.609334 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1722/3454] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:30 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:31.624130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:31.631399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:31.649467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:31.654494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:31.657687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:31.658548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:31.661943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:31.664290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:31.760105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b5aa2eba-2cd4-45c7-a77d-e39c33e44f36 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142827 Aug 29 10:49:31.760871 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1723/3455] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:31 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:31.772564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9c6eeace-fb06-4488-af49-c6ba4f36d838 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003800 Aug 29 10:49:31.784008 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1724/3456] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 29 10:49:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 10:49:31.797618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1085457656", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b4884ef7-c64a-407f-b236-8c548e29ba7e"}], "security_groups": [{"name": "tempest-securitygroup--121047966"}], "key_name": "tempest-keypair-738459067", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:32.004158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] validate_networks() for [('b4884ef7-c64a-407f-b236-8c548e29ba7e', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:49:33.086538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:33.098322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for user e64edcaf463d45b0a104bf51c8cf1c6b and project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:33.130960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:33.131380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:33.131853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:33.132260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:33.132670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:33.157422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.162344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.163026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.163979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.164629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.165056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.209810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:33.224041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Getting quotas for user e64edcaf463d45b0a104bf51c8cf1c6b and project 4b41f0fdba61433c99f4da0e93fd25e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:33.240054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:33.242832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:33.346957 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b9be7b8-ae1d-4485-a655-310e34a129d6 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.561685 Aug 29 10:49:33.368393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1725/3457] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:49:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:49:33.385189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:33.385854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:33.430469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.431095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.431598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.432424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.432958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.433477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.715727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:49:33.716777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:49:33.717243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:49:33.718185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:49:33.718700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:49:33.742341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.742846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.743294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.744165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.744489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.744893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.794727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Getting quotas for project f057d6a6e36e46be8ea64b5cbf9a8075. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:33.802418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Getting quotas for user 49a766c739f647b1a3f0187f77519fe5 and project f057d6a6e36e46be8ea64b5cbf9a8075. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:33.830315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:33.850167 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-690a14b8-cd86-49c4-a5a6-762ef6d6e761 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.479854 Aug 29 10:49:33.853536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1726/3458] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:33 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:33.865539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:33.866187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:33.879062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.879493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.879958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:33.880680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:33.881494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:33.886480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.191367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:49:34.198720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8679cdeb-0664-4935-8dd2-c043a2e1dca1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fd40ee32-0e4d-4472-97fa-ad026aea4d27',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04cc3dac-7328-4a6e-8a23-139a70dd42d1',volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:49:34.264288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:34.279826 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8005081-774f-4108-ae7c-1ad74c454369 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1511 microversion: 2.1 time: 0.424911 Aug 29 10:49:34.282172 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1727/3459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:33 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:34.294087 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80bed8ca-a3a3-4f68-96a7-6affe4d10013 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007747 Aug 29 10:49:34.301205 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1728/3460] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:49:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 10:49:34.313374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:34.317588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:34.334041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.335222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.335943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.336936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.337938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.338883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.611639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:34.623607 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1bc04cb-c0e0-4d52-8a69-6ecdeee1c243 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.320421 Aug 29 10:49:34.625240 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1729/3461] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:34 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:34.630602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d7fc07-8823-4b73-8c7c-5e93f38cc831", "name": "network-vif-plugged", "status": "completed", "tag": "bb967869-2072-42f0-8c1b-23d5a364e312"}, {"server_uuid": "0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c", "name": "network-vif-plugged", "status": "completed", "tag": "b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:34.655608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.656255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.656876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.728406 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Creating event network-vif-plugged:bb967869-2072-42f0-8c1b-23d5a364e312 for instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 on n-h1-854121-10 Aug 29 10:49:34.728925 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] Creating event network-vif-plugged:b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7 for instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c on n-h1-854121-10 Aug 29 10:49:34.742789 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f1a4eb1a-bf34-48de-8126-23e716f92329 req-2c05462f-20f9-4998-9bba-017a289f2fc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115931 Aug 29 10:49:34.743745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1730/3462] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:34.759573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:34.767115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:34.780032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.783462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.795322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.796170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.796746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.797200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.885376 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ad2230a-8ee9-49d4-a747-5ddbd82841d5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134676 Aug 29 10:49:34.891348 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1731/3463] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:34 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:34.896499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:34.900886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:34.918113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.918880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.920045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:34.922837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:34.924238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:34.925510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.036503 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31d82bc4-4ce5-4f97-aa78-55c38bb6a453 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 8.378898 Aug 29 10:49:35.037793 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1733/3464] 10.222.0.47 () {62 vars in 1189 bytes} [Mon Aug 29 10:49:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 8381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:49:35.048753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.050405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:35.073484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.075109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.076378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.077007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.077923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.078560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.083837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.085080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce97b6d6-442c-4a7a-8719-5106ccc03afb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1281 microversion: 2.1 time: 0.192212 Aug 29 10:49:35.086131 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1732/3465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:34 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:35.092537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8c49bb6-3085-43e9-8377-784f4598ad56 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Calling method '.version_select at 0x7f66c6ebd4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.142242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d8c49bb6-3085-43e9-8377-784f4598ad56 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] HTTP exception thrown: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8c49bb6-3085-43e9-8377-784f4598ad56 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-volumes/060b44e7-212a-4105-affa-f2c0b9b4106b HTTP/1.1 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '060b44e7-212a-4105-affa-f2c0b9b4106b'} Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. (HTTP 404) (Request-ID: req-beb8e7a4-7125-4ab3-8539-c3fe71be9168) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:35.145594 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8c49bb6-3085-43e9-8377-784f4598ad56 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 404 to user: Volume 060b44e7-212a-4105-affa-f2c0b9b4106b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8c49bb6-3085-43e9-8377-784f4598ad56 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/060b44e7-212a-4105-affa-f2c0b9b4106b" status: 404 len: 109 microversion: 2.1 time: 0.059496 Aug 29 10:49:35.151698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1733/3466] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:49:35 2022] DELETE /compute/v2.1/os-volumes/060b44e7-212a-4105-affa-f2c0b9b4106b => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:35.161830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.162452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:35.180276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.181026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.181627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.182656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.183462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.184086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.473250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.487144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-edabcb89-f4b2-4862-bfc4-c1dcfec564af tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1512 microversion: 2.1 time: 0.448065 Aug 29 10:49:35.505036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1734/3467] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:35.514656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.519216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.519852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:35.525344 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bab910b2-9833-4ca1-84cd-ba5c02ce9b62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.375149 Aug 29 10:49:35.526948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1734/3468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:35.543752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1515fa1e-3d00-40b9-9d44-4df12f72f543 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Calling method '.version_select at 0x7f66c6e24ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.592670 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1515fa1e-3d00-40b9-9d44-4df12f72f543 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] HTTP exception thrown: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1515fa1e-3d00-40b9-9d44-4df12f72f543 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Request method failure captured: Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-volumes/1482d436-9279-4259-86e0-7eec2aa7900e HTTP/1.1 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm14UeoOMuWsIlD2qzeyhB39BCNvtwL9DhRE0hpEATBJmVzD7fAFwwXeLDAvea6DY4FKQlsHFcXciGYrhWb502q8f5fZDOMLZQ6wFCDQiBxXyij0mpulG2lluxXri2Xs5bJjgcrI7WH9TeSSm615CJLSsf_B71lY74TZY8oQeNjjFw Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/389b2c0e7c5e42a1a41a2db21cbdcf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 389b2c0e7c5e42a1a41a2db21cbdcf43 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesNegativeTest-2375001 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 505cf2ad3b2c43dc929361a5dae68025 Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesNegativeTest-2375001-project Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '1482d436-9279-4259-86e0-7eec2aa7900e'} Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. (HTTP 404) (Request-ID: req-3d47f0ce-0e96-45ec-8cf6-a489683e5fb9) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:49:35.598243 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. Aug 29 10:49:35.604035 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:49:35.609600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1515fa1e-3d00-40b9-9d44-4df12f72f543 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] Returning 404 to user: Volume 1482d436-9279-4259-86e0-7eec2aa7900e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:35.612492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1515fa1e-3d00-40b9-9d44-4df12f72f543 tempest-VolumesNegativeTest-2375001 tempest-VolumesNegativeTest-2375001-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1482d436-9279-4259-86e0-7eec2aa7900e" status: 404 len: 109 microversion: 2.1 time: 0.070545 Aug 29 10:49:35.620127 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1735/3469] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/os-volumes/1482d436-9279-4259-86e0-7eec2aa7900e => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:35.626640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.645840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.653369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:35.676686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.680973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.681586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.682656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.683539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.684248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.684386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.685845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.686460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:35.694520 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0e9185f6-0a12-4a9d-8920-9a8478c0c237 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1285 microversion: 2.32 time: 0.181521 Aug 29 10:49:35.701101 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1735/3470] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:35.721122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:35.725195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:35.743613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.744311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.745163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.746097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:35.746696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:35.747382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:35.908604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:36.137050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:36.156405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.156897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.157566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.292402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:36.305444 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a60841c8-6ad8-4baf-93c4-2b2086cc32bd tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1315 microversion: 2.1 time: 0.602382 Aug 29 10:49:36.318408 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1736/3471] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:36.331168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:36.335349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:36.352458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.361985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.362714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.364404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.366712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.367364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.532707 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c1f58e8-fdbc-46df-8515-be35734d7ea0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206296 Aug 29 10:49:36.537105 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1737/3472] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:36 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:36.551482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:36.558583 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34be7baf-d8bd-4ae3-beb6-f4fd630003d9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.937174 Aug 29 10:49:36.560435 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1736/3473] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:49:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:36.586821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:36.587501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:36.587853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:36.599705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.600426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.601066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.601557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.602192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.602493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.602613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.603584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.604865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.605211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.606221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.608645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.836179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:36.853167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a50a57b-7f9f-4780-8fbf-d9663d9793a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1329 microversion: 2.1 time: 0.314689 Aug 29 10:49:36.859861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1738/3474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:36 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1329 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:36.877252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:36.909897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:36.912061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-54175673', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:36.925201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:36.955883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.959788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.963694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:36.968019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:36.968811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:36.972267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:37.147040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:37.169686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb9e0524-cd46-43bc-bfd4-4450405bd99b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.583817 Aug 29 10:49:37.170753 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1737/3475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:36 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:37.197878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:37.212954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:37.298145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:37.392569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:37.409506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:37.414350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:37.417758 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-399abd98-70bf-49c8-a581-0bbcabb4bb44 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1285 microversion: 2.32 time: 0.237681 Aug 29 10:49:37.439018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1738/3476] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:37 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:37.461077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:37.464632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:37.495428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:37.500139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:37.501106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:37.505161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:37.507404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:37.508138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:37.557476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:37.566759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:37.571777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:37.572639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:37.992963 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8549f36-f00b-4ed4-9281-3c6f56ec1e25 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-54175673" status: 200 len: 1514 microversion: 2.1 time: 1.129909 Aug 29 10:49:37.993564 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1739/3477] 10.222.0.47 () {58 vars in 1259 bytes} [Mon Aug 29 10:49:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-54175673 => generated 1514 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:38.005215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:38.012130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:38.031342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.035910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.039022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.040023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.042073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.044696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.104629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:38.180874 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25a6f937-42f7-43d2-a75f-21cad2d5e796 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179564 Aug 29 10:49:38.190131 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1740/3478] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:37 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:38.217875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:38.224432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:38.247793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.249212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.254169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.255355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.256083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.258346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.392509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:38.404460 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0e3f3d7-e18f-449a-985d-4bb94e23215c tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1503 microversion: 2.1 time: 0.960888 Aug 29 10:49:38.405254 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1739/3479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:37 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1503 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:38.428245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:38.441665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:38.445898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:38.456540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.457329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.459099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.460276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.460903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.462242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.464330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:38.483173 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0c0eb67-d78e-429c-bd6c-8889471e56a3 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1335 microversion: 2.1 time: 0.290026 Aug 29 10:49:38.485467 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1741/3480] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:38 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1335 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:38.501408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:38.502459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:38.536159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.536668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.537118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.537915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.538391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.538826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:38.625609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:38.804025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:38.816833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:38.817340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:38.817797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.059352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.071794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-744185f5-ff3c-40ab-8c5e-c9b2d600c0a4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.584134 Aug 29 10:49:39.075967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1742/3481] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:38 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:39.088662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.089457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:39.105409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.106683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.108205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.111176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.115176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.115748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.196536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88efe491-8508-48be-a6aa-0d1da0bd58d4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.790037 Aug 29 10:49:39.197489 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1740/3482] 10.222.0.47 () {58 vars in 1173 bytes} [Mon Aug 29 10:49:38 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:39.203696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.210114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:39.239831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.246176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.246690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.247560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.248075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.248570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.379502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4968832-29bd-4fc7-98e2-a17f2ef42625 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "DELETE /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.302033 Aug 29 10:49:39.396003 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1743/3483] 10.222.0.47 () {58 vars in 1296 bytes} [Mon Aug 29 10:49:39 2022] DELETE /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831/os-server-password => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:49:39.413938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.416379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:39.452420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.452903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.453351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.454136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.454603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.455038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.565592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4cba1613-3151-4b0c-a14e-7668b455d131 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165848 Aug 29 10:49:39.569595 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1744/3484] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:39 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:39.575339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.595604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.596069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.servers [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Removing options 'limit' from query {{(pid=128681) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 10:49:39.596843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:39.630422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.631023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.631487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.632439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.640554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.644532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.653783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.664155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.665742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.666939 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e916884-48cd-41d6-ac9c-b6b277e49e30 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1583 microversion: 2.32 time: 0.468157 Aug 29 10:49:39.667566 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1741/3485] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:39 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1583 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:39.684042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.685248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:39.719231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.719709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.720530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.723638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.729621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.730359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.787990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:39.800517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.806604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5863b21b-45b2-4388-84ab-c068cab23e03 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.126482 Aug 29 10:49:39.807212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.807782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.817580 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1742/3486] 10.222.0.47 () {58 vars in 1293 bytes} [Mon Aug 29 10:49:39 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831/os-server-password => generated 16 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:49:39.830986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:39.831868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:39.845766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.846311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.846771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:39.848659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:39.848970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:39.849408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.251478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78bb30e5-7eba-4c3b-a39c-0c0c55fdb1c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.679782 Aug 29 10:49:40.253717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1745/3487] 10.222.0.47 () {58 vars in 1161 bytes} [Mon Aug 29 10:49:39 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:40.258648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:40.259361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:40.275705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.276481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.278186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.279876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.281665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.282356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.337657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:49:40.345733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:40.350129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:40.363448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10542e55-29e2-44cc-94a8-af1d288fcdd0 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 0.543185 Aug 29 10:49:40.364315 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1743/3488] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:39 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:40.370503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:40.378410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:40.391865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.393078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.395150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.401032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.401693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.402320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.548768 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d152f12-a022-4c9a-acf5-4628097cb233 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "DELETE /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 204 len: 0 microversion: 2.1 time: 0.291304 Aug 29 10:49:40.549692 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1746/3489] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:49:40 2022] DELETE /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:49:40.561545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:40.573890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:40.577952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:40.595950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.598570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.599941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.603824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.604617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.605280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.789914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:40.839316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:40.853482 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d8edf5e-6443-40a9-ad2d-7aaad40beb66 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.482275 Aug 29 10:49:40.869468 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1744/3490] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:40 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:40.891359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:40.891960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:40.929192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.934435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.938571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.939353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:40.944756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:40.945248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:40.948464 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dfcf1c00-47d6-407c-a4c4-0faab15d0809 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?status=active" status: 200 len: 1008 microversion: 2.1 time: 0.397130 Aug 29 10:49:40.949081 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1747/3491] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:49:40 2022] GET /compute/v2.1/servers?status=active => generated 1008 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:40.965373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:40.980506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:41.015086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:41.019159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:41.019709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:41.023483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:41.027186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:41.027702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:41.176248 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e300663-533e-4855-bba1-7880b13bf2d1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220944 Aug 29 10:49:41.190171 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1748/3492] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:49:40 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff/os-volume_attachments => generated 25 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:49:41.224240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:41.231523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:41.248144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:41.248329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:41.268718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:41.271444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:41.276053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:41.278950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:42.834651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:42.856115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:42.859070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:42.864909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd087186-a86a-467c-8e31-141a83d564e4 tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1509 microversion: 2.1 time: 1.994264 Aug 29 10:49:42.868174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:42.869291 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1745/3493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:40 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1509 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:42.875582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5021ae5f-5587-409f-a0cd-6001a869a3ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1659 microversion: 2.32 time: 1.678110 Aug 29 10:49:42.878279 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1749/3494] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:41 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1659 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:42.881492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:42.898026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:42.898026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:42.906314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:42.906788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.servers [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Removing options 'limit' from query {{(pid=128682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 10:49:42.907494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:42.911828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:42.912324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:42.912762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:42.918485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:42.919569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:42.920017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:42.927375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:42.927863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:42.928306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:42.929044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:42.929501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:42.929957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:42.980638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:49:43.039244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:43.139105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89b3a6a5-a687-438d-8a78-d37bfb73247b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1008 microversion: 2.1 time: 0.250550 Aug 29 10:49:43.139105 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1746/3495] 10.222.0.47 () {58 vars in 1150 bytes} [Mon Aug 29 10:49:42 2022] GET /compute/v2.1/servers?limit=100000 => generated 1008 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:43.156807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:43.157800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:43.172105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:43.175991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.176880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.178107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.179531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.182952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.183589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.239510 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8eac7073-d1bd-4e31-b1da-6475602e8afb tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 204 len: 0 microversion: 2.1 time: 0.359822 Aug 29 10:49:43.240301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1750/3496] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:49:42 2022] DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:49:43.253687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:43.261397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:43.277791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.278809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.279273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.279998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.280461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.280928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.749242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:43.786089 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b150339-26b2-4606-afa7-ba4dee87d82f tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 0.656833 Aug 29 10:49:43.790005 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1747/3497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:43 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:43.809281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:43.834258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:43.836223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:43.850457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.850933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.857785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.863273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:43.863986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:43.867409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:43.949534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:44.041938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b5d4cd2c-830b-4127-9be4-e72b39723f70 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1008 microversion: 2.1 time: 0.250607 Aug 29 10:49:44.047368 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1748/3498] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:49:43 2022] GET /compute/v2.1/servers => generated 1008 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:44.068945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:44.071706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:44.085117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.085949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.086744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:44.087573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.088373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.088952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:44.145514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:44.161236 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f129a411-11e2-4499-8756-c671b193a15b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.916159 Aug 29 10:49:44.173299 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1751/3499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:43 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:44.178437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:44.193353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:44.210683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.211509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.212187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:44.213148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.213905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.214605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:44.220809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:44.844260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e65d141e5499292a377f651a7e9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81794535a44ff99cd8443007202c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:44.860349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d59e7102-20de-4513-8141-087466f9a4da tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 200 len: 1467 microversion: 2.1 time: 0.685645 Aug 29 10:49:44.861720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1752/3500] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:44 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 1467 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:44.880965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:44.882803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:44.894418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.895299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.895999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:44.896961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:44.897660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:44.898393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:45.605132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:45.628277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d9186f57-93c3-4794-859b-5ce85e180a08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1681 microversion: 2.1 time: 1.572405 Aug 29 10:49:45.631811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1749/3501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:44 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1681 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:45.654396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:45.667035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:45.672011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:45.699466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:45.702713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:45.707012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:45.708183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:45.708906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:45.712044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:45.955415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:45.967091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:45.971147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:45.979990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:45.988440 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd1196c2-fcf2-437b-8033-22160093cb27 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1659 microversion: 2.32 time: 1.125229 Aug 29 10:49:45.992613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1753/3502] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:44 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1659 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:45.998220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb", "tag": "8d7d3ffb-ab02-4a2f-b9be-75e17b836035"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:46.049432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:46.050321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:46.054846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:46.102411 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] Creating event network-changed:8d7d3ffb-ab02-4a2f-b9be-75e17b836035 for instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb on n-h1-854121-10 Aug 29 10:49:46.124048 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-70e7fdf1-7f41-40e5-afae-17fe55ee4d7d req-b231ff61-f53f-4d56-8ba3-3a43bb90ec7d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129827 Aug 29 10:49:46.125362 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1754/3503] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:46.130679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:46.134582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:46.159907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:46.166593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:46.167374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:46.168438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:46.173155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:46.174646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:46.183023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d545f629-bd47-464c-8a0a-bac7f3989376 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.548966 Aug 29 10:49:46.189836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1750/3504] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:49:45 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:46.195112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:46.209172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:46.224247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:46.224768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:46.225538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:46.228481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:46.229227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:46.230704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.670159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:47.681446 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64fc2ef5-858b-452b-b830-cff5fc306942 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 1.554544 Aug 29 10:49:47.683284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1755/3505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:46 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:47.695362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:47.696272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] [instance: 04d7fc07-8823-4b73-8c7c-5e93f38cc831] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:47.705410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.706160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.707055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.707341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:47.708487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.709121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.709741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.725873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cb76120-3192-4f16-9f88-79cd46b2e62c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 1.534361 Aug 29 10:49:47.740913 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1751/3506] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:46 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:47.754813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:47.758656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] HTTP exception thrown: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Request method failure captured: Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 HTTP/1.1 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJmgGK0V0KJZ8YAvYRcNc5vFLEadWvKN7ICfqHawv-G5ZmBV7WHdmGb6HGCxVRQLP2lFIoJlZPcCBeIiOtirO_jBchbSBSU2hXoiHuB07Ne3wuU0hbYc4tX2gzr_xXRy4FnvVIQCvQrct55J1gph8RlaFMddzW8T578xHRtvALN99Zs Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 6b81794535a44ff99cd8443007202c05 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerPasswordTestJSON-1080178337 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6b81794535a44ff99cd8443007202c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6b81794535a44ff99cd8443007202c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6b81794535a44ff99cd8443007202c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6b81794535a44ff99cd8443007202c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerPasswordTestJSON-1080178337 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 6b81794535a44ff99cd8443007202c05 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1080178337 Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerPasswordTestJSON-1080178337-project Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a84e65d141e5499292a377f651a7e9ee Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerPasswordTestJSON-1080178337-project Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '04d7fc07-8823-4b73-8c7c-5e93f38cc831'} Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:47.762242 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. Aug 29 10:49:47.768781 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:47.772910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:47.773586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.servers [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Removing options 'limit' from query {{(pid=128682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 10:49:47.774453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:47.777752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] Returning 404 to user: Instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:47.779183 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d2b4ddf-b9e0-4ab6-beb0-d739a64d600b tempest-ServerPasswordTestJSON-1080178337 tempest-ServerPasswordTestJSON-1080178337-project] 10.222.0.47 "GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831" status: 404 len: 111 microversion: 2.1 time: 0.088313 Aug 29 10:49:47.779971 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1756/3507] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:47 2022] GET /compute/v2.1/servers/04d7fc07-8823-4b73-8c7c-5e93f38cc831 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:47.781735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.782401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.783011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.784026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.784890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.785492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.808054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:47.808683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:47.814354 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d3aaca9-c252-425d-b730-434dbeb84262 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.071850 Aug 29 10:49:47.815537 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1752/3508] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 29 10:49:47 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:47.837633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.848453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.860647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:47.861417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:47.861933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:47.863577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.263423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e84f4fb-ead3-47cf-82d1-48637080f1ff", "name": "network-vif-unplugged", "status": "completed", "tag": "a359ca53-7be2-4e90-b120-a61430700f9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:48.297037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.297528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.297999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.341689 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] Creating event network-vif-unplugged:a359ca53-7be2-4e90-b120-a61430700f9b for instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff on n-h1-854121-10 Aug 29 10:49:48.367682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1cd95303-3687-42b9-a610-aec75ef0b7a3 req-300c4fc5-1ffb-48ba-a9fa-742d4395ed25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.549120 Aug 29 10:49:48.374909 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1753/3509] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:48.396649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:48.404307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:48.425300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.425826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.438573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.441540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.442289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.446922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.584104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:48.613142 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d997146b-22b1-41e0-8cda-cc84ef9b4e2b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1681 microversion: 2.1 time: 0.819223 Aug 29 10:49:48.615735 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1757/3510] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:47 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1681 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:48.647248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:48.676486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:48.677298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-54175673', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:49:48.701848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.702680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.703350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.706920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.707609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.708216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:48.802921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:48.871086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:49:48.943851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2c15f585-61ea-44e4-b9a5-b19eb7defba8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-54175673" status: 200 len: 344 microversion: 2.1 time: 0.318630 Aug 29 10:49:48.945559 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1758/3511] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Aug 29 10:49:48 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-54175673 => generated 344 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:48.952916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d7fc07-8823-4b73-8c7c-5e93f38cc831", "name": "network-vif-deleted", "tag": "bb967869-2072-42f0-8c1b-23d5a364e312"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:48.984962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:48.986153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:48.988859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.016937 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] Creating event network-vif-deleted:bb967869-2072-42f0-8c1b-23d5a364e312 for instance 04d7fc07-8823-4b73-8c7c-5e93f38cc831 on n-h1-854121-10 Aug 29 10:49:49.024027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3fa0ddfd-dcef-4b08-a440-e30605cba997 req-febe70cc-c29d-4163-abaa-658d65e42046 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076854 Aug 29 10:49:49.028033 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1759/3512] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:49.049360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:49.050402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:49.069481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.078534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.082692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.087211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.088260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.092764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.390141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:49.404232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:49.408607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:49.411448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5351b496-7f25-484d-b6ba-ddbaf69d2217 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1749 microversion: 2.32 time: 1.032609 Aug 29 10:49:49.415860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1754/3513] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:48 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1749 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:49.422886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:49.423810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:49.431382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.432260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.432966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.433942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.436185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.436872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.711026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:49.728273 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0eeb2a0c-c7d2-48e4-a707-83bdb83eb1b7 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 0.697086 Aug 29 10:49:49.729452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1760/3514] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:49 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:49.748382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:49.761852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.762718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.763411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.791695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=20 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:49.820705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:49:49.932671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3372ab93-48c0-4ab9-91b8-bde7f622d885 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "POST /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184/action" status: 202 len: 0 microversion: 2.1 time: 0.200926 Aug 29 10:49:49.933734 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1761/3515] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:49:49 2022] POST /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:49.940723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:49.941564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:49.958559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.958975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.959731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:49.960464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:49.964304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:49.964959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:50.319929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:50.332052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fff02ac6-79d6-425a-bea8-e913356038e9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.914468 Aug 29 10:49:50.344908 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1755/3516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:49 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:50.349967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:50.355856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:50.365091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:50.373577 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-098ce9d5-748d-4596-8e98-b89e86745c2e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1614 microversion: 2.1 time: 0.437956 Aug 29 10:49:50.385727 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1762/3517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:49 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1614 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:50.400962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:50.401474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:50.401949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:50.402678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:50.403811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:50.404523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:50.442700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:50.443346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:50.458235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:50.458733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:50.460466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:50.462515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:50.463473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:50.463927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:51.069004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:51.078126 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eda8c899-0842-43ba-aa2a-f6c696976252 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1521 microversion: 2.1 time: 0.731874 Aug 29 10:49:51.097787 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1756/3518] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:50 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:51.109333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:51.110383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:51.121568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:51.123020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:51.126357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:51.127365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:51.128689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:51.131411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:51.659248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:51.699882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:51.714524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:51.716343 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd5b9c7c-4e06-4913-a251-e2dcf5b46dd9 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1749 microversion: 2.32 time: 1.277818 Aug 29 10:49:51.717117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1763/3519] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:50 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1749 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:49:51.774614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:51.775679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:51.805936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:51.806747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:51.807404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:51.808586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:51.809221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:51.810626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.047207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:52.064656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bbaba7a-a0f6-4bd5-a86b-d97596e5c664 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 0.965264 Aug 29 10:49:52.070439 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1757/3520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:51 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:52.082306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:52.090544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:52.128227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.130668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.131359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.132324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.141736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.142325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.249747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.254345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.256617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.258919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'fault' on Instance uuid 1e84f4fb-ead3-47cf-82d1-48637080f1ff {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:49:52.454159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:52.464057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e47cc03-938b-4eda-8bf0-48f67c958a4f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 200 len: 1332 microversion: 2.1 time: 0.392376 Aug 29 10:49:52.469894 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1758/3521] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:52 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 1332 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:52.611492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:52.640839 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4065a311-e861-42e9-a41d-ebc3d4691c58 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 0.890794 Aug 29 10:49:52.652772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1764/3522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:51 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:52.683505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:52.689917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:52.756203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.756742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.773564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e84f4fb-ead3-47cf-82d1-48637080f1ff", "name": "network-vif-deleted", "tag": "a359ca53-7be2-4e90-b120-a61430700f9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:52.774985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.775838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.786397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.790869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.806481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.809187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.812956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.850644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] Creating event network-vif-deleted:a359ca53-7be2-4e90-b120-a61430700f9b for instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff on n-h1-854121-10 Aug 29 10:49:52.878974 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bbdd6074-129b-4152-be90-b417a4915d1e req-954e8a34-8ba6-469c-90d0-71b44d192b96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407398 Aug 29 10:49:52.884259 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1759/3523] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:52.902031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:52.903283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:52.939164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.954444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.956181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:52.962767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:52.964795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:52.969860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:54.424794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:54.445317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:54.451620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:54.458632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e91ac470-e18e-49a1-99da-3327b3b8233a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1794 microversion: 2.32 time: 1.572605 Aug 29 10:49:54.470561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1760/3524] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:52 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1794 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:54.490644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:54.492347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:54.506524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:54.507942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:54.510770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:54.511726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:54.514672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:54.515474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:54.578347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:54.797808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:54.821122 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2833ee86-b18d-459d-929f-07262be4ddcd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1521 microversion: 2.1 time: 2.165899 Aug 29 10:49:54.821636 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1765/3525] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:52 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1521 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:54.869382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:54.870051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:54.898026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:54.899704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:54.901020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:54.913262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:54.917357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:54.922799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:54.996469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff HTTP/1.1 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1e84f4fb-ead3-47cf-82d1-48637080f1ff'} Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:49:54.998434 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:49:55.004184 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:49:55.006176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:49:55.007223 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f242efb6-b054-49ba-b642-156c8903f550 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 404 len: 111 microversion: 2.1 time: 0.156514 Aug 29 10:49:55.008314 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1766/3526] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:54 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:49:55.014722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:55.016324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:55.027803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:55.029410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:55.030102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:55.031004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:55.031625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:55.032212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:56.202317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:56.234907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3cb06136-9e8c-4ce8-a523-7710386af54a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 1.762900 Aug 29 10:49:56.240207 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1761/3527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:54 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:56.267802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0c251c8-e984-4fc3-b908-d6ace5def50c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '.version_select at 0x7f66cb16f4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:56.324025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0c251c8-e984-4fc3-b908-d6ace5def50c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348994504" status: 202 len: 0 microversion: 2.1 time: 0.073924 Aug 29 10:49:56.328417 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1762/3528] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348994504 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:49:56.341777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:56.342435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:56.352038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:56.352972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:56.353683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:56.354460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:56.355278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:56.355893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:56.614962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:56.623171 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0aae7a37-97df-4364-9d43-6af9eb789997 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1523 microversion: 2.1 time: 1.613470 Aug 29 10:49:56.627449 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1767/3529] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:55 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1523 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:56.640000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb", "name": "network-vif-plugged", "status": "completed", "tag": "8d7d3ffb-ab02-4a2f-b9be-75e17b836035"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:56.666183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:56.666872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:56.667471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:56.716276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] Creating event network-vif-plugged:8d7d3ffb-ab02-4a2f-b9be-75e17b836035 for instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb on n-h1-854121-10 Aug 29 10:49:56.742399 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-39d72d49-abc8-475f-8154-0dc0cba84e25 req-e0f65d04-6049-44ff-a85f-dc648f504742 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108037 Aug 29 10:49:56.745350 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1768/3530] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:56.768723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:56.769482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:56.784571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:56.786364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:56.789999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:56.791338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:56.793387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:56.795344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.400786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:57.420756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:57.424345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:57.428142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5d5ee87-2627-4912-b327-15a9115c77b0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1839 microversion: 2.32 time: 1.097425 Aug 29 10:49:57.428730 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1763/3531] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:56 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1839 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:49:57.443019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:57.444243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:57.459365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:57.462976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:57.466750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.468466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:57.471101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:57.471812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.707626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:57.730507 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d85d0488-76e5-4d7c-a02c-7dc4ea5f9bc2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1521 microversion: 2.1 time: 0.982088 Aug 29 10:49:57.734161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1769/3532] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:56 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1521 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:57.744464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "c33d5932-5453-449b-9e0f-2a24c345b9bc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:57.764528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:57.765444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:57.766807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.790463 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] Creating event network-changed:c33d5932-5453-449b-9e0f-2a24c345b9bc for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:49:57.798539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:57.800089 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4ad8a2c1-4ac6-4ad4-a875-65474e479794 req-5553b1d2-196b-4371-8e1e-b3f7934edfc3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062066 Aug 29 10:49:57.802476 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1770/3533] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:57.812881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:57.814080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:57.825618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:57.826886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:57.827683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.829282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:57.830528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:57.834350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:57.870523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:58.050207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:58.062347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03a5c7e0-483a-4ddc-8228-dbd3a94ed3e9 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1402 microversion: 2.1 time: 0.630753 Aug 29 10:49:58.065720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1764/3534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:57 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1402 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:58.370779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:58.390616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d534b29e-0f16-4078-b054-1700ad8b112d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1505 microversion: 2.1 time: 0.585782 Aug 29 10:49:58.391208 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1771/3535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:57 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:58.454835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:58.455463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:58.458702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95909f79-83bb-4eed-ab94-2f7ef483bb64 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: .version_select at 0x7f66c66e1af0>, body: {"keypair": {"name": "tempest-keypair-1215548223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Ra4LT/CiZoH1YPMbq+bCMPYEaXt6lyAZSxkasTIqYArqxqKK3ZqqNpseB0c+/AxyyXa+3FfLjGYZ5YnNPRAcHMLLynaN0xSjUz/i5aFUXrzqFJ3sAoIjUx0lJsdY5Rg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:49:58.472679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:58.473176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:58.473618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:58.474369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:58.474834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:58.475268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:58.491139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-95909f79-83bb-4eed-ab94-2f7ef483bb64 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:49:58.499500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-95909f79-83bb-4eed-ab94-2f7ef483bb64 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:49:58.534766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95909f79-83bb-4eed-ab94-2f7ef483bb64 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089697 Aug 29 10:49:58.535847 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1765/3536] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:49:58.758557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:58.759590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:58.787887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:58.796635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:58.800815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:58.803522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:58.806099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:58.808571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:58.815298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:49:59.230220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:59.245773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:59.255508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:59.256721 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6e3dfb2-7efa-4acd-92d1-46f9e362b6e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1839 microversion: 2.32 time: 0.808768 Aug 29 10:49:59.286215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1772/3537] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:49:58 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1839 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:49:59.291270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:59.291898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:59.311066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:59.311644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:59.312011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:59.312729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:59.313187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:59.313627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:59.381171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:49:59.390436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7c0d6ef-720d-490f-8b51-9be32e73f219 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1521 microversion: 2.1 time: 0.639526 Aug 29 10:49:59.391023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1766/3538] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:58 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:49:59.415417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:49:59.416272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:49:59.425598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:59.426389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:59.427002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:49:59.427884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:49:59.428601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:49:59.429283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:00.383178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:00.394952 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9be1df0f-5c7b-4544-bfab-c30db0f2a5bb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1505 microversion: 2.1 time: 0.983570 Aug 29 10:50:00.397979 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1767/3539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:59 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1505 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:00.408928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:00.427497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:00.431694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:00.451217 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d56661a-347d-4138-be68-98db56c4ab9c tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1588 microversion: 2.1 time: 1.163635 Aug 29 10:50:00.452176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:00.453819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:00.454349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:00.455094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:00.456120 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1773/3540] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:49:59 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1588 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:00.467953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:00.467953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:00.473960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:00.478894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:00.500662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:00.506130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:00.508927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:00.513976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:00.514491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:00.514951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:01.136488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:01.147841 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07cbedd3-5c06-4b3b-82d5-e3c6be757403 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1521 microversion: 2.1 time: 0.688079 Aug 29 10:50:01.149104 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1774/3541] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:00 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:01.156186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "95f22f43-ba65-4323-8dc1-b3d94b0cd93d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:01.167293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:01.168573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:01.169264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:01.187104 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] Creating event network-changed:95f22f43-ba65-4323-8dc1-b3d94b0cd93d for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:01.193646 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cf1923c2-1a29-4514-ba54-121027b6b755 req-0faa142f-9da1-4f6a-b80b-915e58dede1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042788 Aug 29 10:50:01.195081 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1775/3542] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:01.206886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:01.210790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:01.226667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:01.227756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:01.228482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:01.229474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:01.231219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:01.232011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:01.371486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:01.388796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:01.393506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:01.396289 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fcbfdfc-1641-4ada-8922-9fbb813ede1d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1860 microversion: 2.32 time: 0.995992 Aug 29 10:50:01.397157 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1768/3543] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:00 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1860 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:01.530000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3247217e-a6ea-4342-8ef0-de5ce566b6d1 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332226 Aug 29 10:50:01.530820 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1776/3544] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:50:01 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:01.543146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:01.545449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:01.569154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:01.575013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:01.579640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:01.585132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:01.607831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:01.613434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:02.092662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-250485877", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bb98c5d8-8227-42c4-8629-d940b6e4d115"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:02.173256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:02.185531 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21b471fe-1fbe-4e30-a766-d0fef44fb603 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 200 len: 1448 microversion: 2.1 time: 0.650074 Aug 29 10:50:02.194038 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1777/3545] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:01 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 1448 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:02.195462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] validate_networks() for [('bb98c5d8-8227-42c4-8629-d940b6e4d115', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:50:02.202656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:02.252534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:02.255660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:02.258112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:02.284103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.server_external_events [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] Unable to find a host for instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c. Dropping event network-vif-unplugged {{(pid=128681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 10:50:02.286091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ca680417-cb23-4860-8765-2057722ea573 req-bf347ede-1fa4-45ba-827b-7cfce33e3387 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089216 Aug 29 10:50:02.287247 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1778/3546] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 10:50:02.292594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:02.293314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:02.321189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:02.321889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:02.322502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:02.323308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:02.323886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:02.325991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:02.928425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:02.948306 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a9bd286-884f-4659-a84f-3968ce9922a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1498 microversion: 2.1 time: 0.659491 Aug 29 10:50:02.960159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1779/3547] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:02 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1498 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:02.973013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:02.978016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:02.997749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:02.998505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:02.999460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:03.000363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:03.002261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:03.002899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:03.079498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:50:03.104910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Working on deleting snapshot f8a224c1-d7c8-493e-b76d-929aa5a4f9a5 from shelved instance... Aug 29 10:50:03.459685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:03.461303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:03.462206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:03.462945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:03.463576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:03.489358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:03.490488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:03.492741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:03.493755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:03.495173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:03.496426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:03.544685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:50:03.559501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for user 4874da72fc8d49748fe5ade5c4942f04 and project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:50:03.593263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:50:03.597794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:50:03.713405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b01a776-9e96-49a1-8921-15aa3dad26bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.312908 Aug 29 10:50:03.714098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1769/3548] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:50:03.723815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:03.727823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:03.743983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:03.744519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:03.744972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:03.747768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:03.748234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:03.755220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:04.678999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:04.699566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:04.700791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:04.701292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:04.703380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Doing local delete in cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128681) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 10:50:04.708322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:04.711276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:04.713959 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2c05ba59-0595-436a-928a-68ffd9031b5b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1881 microversion: 2.32 time: 0.984392 Aug 29 10:50:04.714658 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1770/3549] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:03 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1881 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:04.714963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:04.715537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 10:50:04.727025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] deallocate_for_instance() {{(pid=128681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 29 10:50:04.750105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:04.764235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:04.769722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:04.801351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:04.801916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:04.802368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:04.803115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:04.803576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:04.804010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:04.918520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:05.009231 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-183e9dcb-ac37-4476-8534-6942c5c39a91 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.293462 Aug 29 10:50:05.014313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1771/3550] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Aug 29 10:50:04 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:05.020880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:05.021762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:05.030415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.031172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.031808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:05.032718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.033342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.034117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:05.321900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:05.344279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c09af84-ebbb-4697-8f3f-23f8db2ec12b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1221 microversion: 2.1 time: 0.318143 Aug 29 10:50:05.345145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1772/3551] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:05 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1221 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:05.371253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "2e0c26f5-0c19-4878-8c92-671fdcd5dc9d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:05.428771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.431931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.432688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:05.463903 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] Creating event network-changed:2e0c26f5-0c19-4878-8c92-671fdcd5dc9d for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:05.479517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-45c873bb-f410-4a11-9df9-a2b9cac2769c req-bde6a3bc-bb13-4a9b-9980-602898d5e0e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126239 Aug 29 10:50:05.484913 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1773/3552] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:05.504521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:05.552339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.553988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.554502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:05.749637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Going to try to start instance {{(pid=128682) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 10:50:05.861202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-332c09f8-9590-431c-ae63-f0c75ce2efab tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "POST /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184/action" status: 202 len: 0 microversion: 2.1 time: 0.372386 Aug 29 10:50:05.862741 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1774/3553] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:50:05 2022] POST /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:50:05.873376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:05.876180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:05.893675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.894921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.898110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:05.899061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:05.901967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:05.902599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:06.514359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:06.526852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1883daf-791b-4a06-a0ec-0eb851c1b923 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1588 microversion: 2.1 time: 0.658770 Aug 29 10:50:06.542313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1775/3554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:05 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1588 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:06.549289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:06.549935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:06.556327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:06.556821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:06.557341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:06.558088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:06.558556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:06.558985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:07.577573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:07.593848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:07.596416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:07.598170 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2347908d-2432-4b28-99f4-545860bb8847 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1881 microversion: 2.32 time: 1.054542 Aug 29 10:50:07.599232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1776/3555] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:06 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1881 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:07.605348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb", "tag": "8d7d3ffb-ab02-4a2f-b9be-75e17b836035"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:07.626300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:07.627080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:07.627673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:07.643874 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] Creating event network-changed:8d7d3ffb-ab02-4a2f-b9be-75e17b836035 for instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb on n-h1-854121-10 Aug 29 10:50:07.650288 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3aa910b6-13f2-4592-a7ee-da7bba52650a req-2a9b9f35-6ef1-4413-b1e6-c32a123a7340 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048595 Aug 29 10:50:07.652533 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1777/3556] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:07.680107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:07.680821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:07.691252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:07.692960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:07.693592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:07.694803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:07.695676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:07.696284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.049241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Updating instance_info_cache with network_info: [] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 10:50:08.417293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:08.427533 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9e802fa-bfdf-4f0b-91ad-c754f5d155ae tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1507 microversion: 2.1 time: 0.772070 Aug 29 10:50:08.432145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1778/3557] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:07 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:08.441615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:08.443501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:08.455825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:08.458835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:08.459652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.462740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:08.463389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:08.464078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.608772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:08.623560 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb69864a-343d-46eb-933d-fccd569304d1 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 204 len: 0 microversion: 2.1 time: 5.660994 Aug 29 10:50:08.627557 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1780/3558] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:50:02 2022] DELETE /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 0 bytes in 5666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:50:08.634116 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-457c9ab9-074f-42db-b431-8963aa070a83 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1275 microversion: 2.1 time: 0.196326 Aug 29 10:50:08.635962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1654055633", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db70ecf5-8fd1-4a4e-acd4-79d8294a110e"}], "security_groups": [{"name": "tempest-securitygroup--1419160949"}], "key_name": "tempest-keypair-1215548223", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:08.658581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1779/3559] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:08 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:08.663936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "61eeaaae-4621-43d9-aad2-3e22a010a9da"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:08.694861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:08.695858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:08.697099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.724232 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] Creating event network-changed:61eeaaae-4621-43d9-aad2-3e22a010a9da for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:08.738587 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-10d0c38f-1491-450f-870b-65b19a7dc03d req-40df93be-06f6-4080-879f-65300f204d45 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078442 Aug 29 10:50:08.739697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1780/3560] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:08.744926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:08.745521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:08.766507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:08.767008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:08.767473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.768167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:08.768629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:08.769058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:08.772269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:08.983486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] validate_networks() for [('db70ecf5-8fd1-4a4e-acd4-79d8294a110e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:50:09.526396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:09.565485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:09.567119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:09.568341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-693ae1d6-f2c2-4ec1-9b96-f3cc2c059681 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1881 microversion: 2.32 time: 0.827530 Aug 29 10:50:09.569117 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1781/3561] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:08 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1881 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:09.586391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:09.587670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:09.593386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:09.599189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:09.600580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:09.601222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:09.603093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:09.604242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:09.604991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:09.650726 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c HTTP/1.1 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c'} Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:09.652397 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:50:09.661981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f92b471e-18d6-4c56-b468-5e5f75d85daf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 404 len: 111 microversion: 2.1 time: 0.079400 Aug 29 10:50:09.677953 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1782/3562] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:09 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:50:09.691853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:09.691853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:09.698059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:09.698536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:09.699201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:09.700278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:09.700911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:09.701512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:10.133433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:10.144793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28a1448b-d025-415c-967e-7921366078a0 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1507 microversion: 2.1 time: 0.465543 Aug 29 10:50:10.150720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1783/3563] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:09 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:10.155906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:10.156514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:10.195309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:10.195722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:10.201566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:10.202631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:10.210286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:10.211743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:10.961626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:10.962226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:10.962554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:10.963159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:10.963742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:10.965802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:10.983227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:10.985805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:10.986548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:10.987537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:10.988165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:10.988809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:11.002577 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02e55eab-a6cf-4aa7-bc5e-6809fed87fd5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 0.821580 Aug 29 10:50:11.003514 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1784/3564] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:10 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:11.008402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c", "name": "network-vif-deleted", "tag": "b0a3b41d-1746-4daa-897d-8a7e1e0ca7a7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:11.010655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:50:11.018743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:50:11.031480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:11.031974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:11.032413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:11.037649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:50:11.040556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:50:11.056185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_external_events [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] Unable to find a host for instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c. Dropping event network-vif-deleted {{(pid=128682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 10:50:11.057114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0ad3dcec-3a4f-45a6-96d0-6cb251c29cf0 req-1a75331c-6204-4f07-a78f-fef56107a049 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.052418 Aug 29 10:50:11.058112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1785/3565] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 10:50:11.073917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-296431894", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:11.125874 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9dadb189-9251-4a74-8d7c-54627dc1dbc9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.496874 Aug 29 10:50:11.129451 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1781/3566] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:50:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:50:11.148110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:11.148790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:11.159361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:11.159361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:11.159801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:11.161691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:50:11.162307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:11.162936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:11.163533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:12.325416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:12.342964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:12.344587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:12.347151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c83565c4-186c-46b0-9f94-d7a6bd4ce6c8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1881 microversion: 2.32 time: 1.213760 Aug 29 10:50:12.347721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1782/3567] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:11 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1881 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:12.361558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "fac7f7da-8cf8-4406-ae02-640005dca23c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:12.373480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:12.374226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:12.375227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:12.387392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] Creating event network-changed:fac7f7da-8cf8-4406-ae02-640005dca23c for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:12.395514 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3b9ee435-5199-475e-8ef3-09a13e375de1 req-6c7521dd-1cab-4914-9265-10de47ce7454 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046596 Aug 29 10:50:12.396656 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1783/3568] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:12.416053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:12.417987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:12.429393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:12.431201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:12.431832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:12.432724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:12.433356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:12.434881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:12.603681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:12.610273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:12.616499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ea1f70b-a5a9-40d7-b59e-1ec5d3956f5c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1294 microversion: 2.1 time: 0.218045 Aug 29 10:50:12.617392 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1784/3569] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:12 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:12.632609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:12.633528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:12.642043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:12.642742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:12.643327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:12.644585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:12.645328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:12.645971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.185843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:13.187050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:13.187673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:13.188227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:13.188757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:13.195618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:13.214235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ea738fe-43a6-401c-bd73-470c2ae4adc6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1511 microversion: 2.1 time: 0.592641 Aug 29 10:50:13.217120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.217629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.218150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.218823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.219283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.219824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.235343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1785/3570] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:12 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:13.261803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:13.262556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:13.275893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.276597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:50:13.279683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.282791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.284288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.289530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:50:13.290435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.290791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.326358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:50:13.333166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:50:13.417639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c60c3530-a3f7-430a-9e2e-048db9b003e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358403 Aug 29 10:50:13.418302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1786/3571] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:50:13.430103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef6b9b48-aa63-4815-a256-635a41937148", "tag": "7e0e2002-c768-4018-afdd-a62a955e41bf"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:13.442289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.443721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.444321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.464028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] Creating event network-changed:7e0e2002-c768-4018-afdd-a62a955e41bf for instance ef6b9b48-aa63-4815-a256-635a41937148 on n-h1-854121-10 Aug 29 10:50:13.472050 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8391840a-3984-4d4f-ad0d-ff6498bdb33c req-b2694875-fb89-4a2b-b149-bdbba7b60cb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048760 Aug 29 10:50:13.472819 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1787/3572] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:13.479242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:13.487842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:13.488301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.servers [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Removing options 'limit' from query {{(pid=128682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 10:50:13.489077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:13.490248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.503273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.504278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.508254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.509069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.509788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.514495 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eacbf3e4-8c66-45cb-8745-f77da7b43451 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040544 Aug 29 10:50:13.515685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1788/3573] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 29 10:50:13 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:50:13.521668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:13.522631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:13.541216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.542049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.543411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.545177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:13.546024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:13.546615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:13.906015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:13.915483 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f085f2ce-c53a-449f-a650-50770636a0ed tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 0.674220 Aug 29 10:50:13.916338 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1786/3574] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:13 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:13.922732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91613142-9e70-4ad3-8194-a9d12de8f7c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:13.923730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91613142-9e70-4ad3-8194-a9d12de8f7c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.054967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.064607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-91613142-9e70-4ad3-8194-a9d12de8f7c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.067777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.069370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.071783 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-092aaced-b51f-441b-aa79-f14e70e4fa5d tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.554339 Aug 29 10:50:14.072526 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1789/3575] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:13 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:14.088854 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91613142-9e70-4ad3-8194-a9d12de8f7c8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1214 microversion: 2.1 time: 0.158494 Aug 29 10:50:14.088854 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1787/3576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:13 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:14.088854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:14.088854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.089271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.089673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.091328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.092580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.093208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.094041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.115572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:14.120677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.134883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.135649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.137072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.138517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.139157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.139793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.554509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.564279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.569071 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5aa6c06-28bc-4556-a12d-14507b66bcb5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1511 microversion: 2.1 time: 0.491221 Aug 29 10:50:14.570029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1788/3577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:14 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:14.575521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f1a48a8d-52ef-46c5-b91d-e92a98c059cd tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.475315 Aug 29 10:50:14.587257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1790/3578] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:14 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:14.599708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:14.602332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.611913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.612597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.613202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.614369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.615137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.615810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.817635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "990c889f-15bb-4bc8-8674-6d5ffc9fa781"}, {"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "274fa1af-4d11-424e-b9a9-d946b476348f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:14.829137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.829633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.830223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.844832 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Creating event network-changed:990c889f-15bb-4bc8-8674-6d5ffc9fa781 for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:14.845392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] Creating event network-changed:274fa1af-4d11-424e-b9a9-d946b476348f for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:14.851604 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-395b50fa-6ef3-467b-94e2-a24d2f56739d req-f672e606-3524-40a7-b7e9-703a4aa120d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.280283 Aug 29 10:50:14.852648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1789/3579] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:14.932432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:14.937308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:14.938628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.943004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d30a785d-269c-4c9d-9133-1759ad58621c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1512 microversion: 2.1 time: 0.354335 Aug 29 10:50:14.943627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1791/3580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:14 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:14.960084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.960582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.961034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.961963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:14.962600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:14.963184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:14.972634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:14.975576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:14.999849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.004819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.006916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.010526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.015144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.018766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.694463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:15.714592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:15.726796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6da35e8a-5910-45f7-a2cd-85794c2184e4 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 0.794031 Aug 29 10:50:15.740511 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f65e4cd6-ac00-4e49-82b1-5bac3f51d569 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1511 microversion: 2.1 time: 0.765497 Aug 29 10:50:15.740617 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1790/3581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:14 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:15.740705 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1792/3582] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:14 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1511 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:15.740705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:15.740705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:15.750995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:15.751557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:15.767241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.767756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.774590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.776973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.777469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.777900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.778476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.778928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.779579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.780462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:15.782717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:15.783301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:15.994920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.009677 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb39901b-1978-41e8-aefc-4e1771be2507 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1210 microversion: 2.1 time: 0.275685 Aug 29 10:50:16.010628 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1793/3583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:15 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1210 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:16.016540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:16.017147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:16.033282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.033807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.034257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.034977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.035426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.045541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.470930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.487804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.489620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.492588 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08b3a09b-f38c-40a6-9b73-3374dec9141b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.761272 Aug 29 10:50:16.499540 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1791/3584] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:15 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:16.504890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:16.511387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.512566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:16.562591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:16.574663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8740c962-7554-4f59-8189-bdd0b4119e8b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.562819 Aug 29 10:50:16.578309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1794/3585] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:16 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:16.728817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.729609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.730431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.731888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.732951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.733561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.770494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:16.771149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:16.788532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.794984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.797819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.798632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:16.802588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:16.808001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:16.946472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:17.087806 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f490f1a-3fc1-4491-ac22-b8284864714f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.587141 Aug 29 10:50:17.091235 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1792/3586] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Aug 29 10:50:16 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:17.103861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a89248c-19fc-437e-a607-a698abe2b4e4", "tag": "fb0a127d-9de7-41ea-a71d-30c75533bc8f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:17.124612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.130688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.131311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.147017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] Creating event network-changed:fb0a127d-9de7-41ea-a71d-30c75533bc8f for instance 2a89248c-19fc-437e-a607-a698abe2b4e4 on n-h1-854121-10 Aug 29 10:50:17.162201 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4e241b7c-dbf8-4fce-9be0-72a12f85a1ef req-692397ad-c354-4638-8891-9a6a5864e2cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069423 Aug 29 10:50:17.163499 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1793/3587] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:17.174468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:17.176281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:17.191784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.192898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.194988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.195946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.196592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.198361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.482228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:17.496094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-626423b4-2811-4cd6-a5ee-e870285ab30a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1284 microversion: 2.1 time: 0.330525 Aug 29 10:50:17.496351 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1794/3588] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:17 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:17.514505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:17.515124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:17.529444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.530246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.530872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.531573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.532199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.532619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.805121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:17.817447 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-578891ec-884e-44bc-b8d3-0c72d0a7f680 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 1.073551 Aug 29 10:50:17.818076 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1795/3589] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:16 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:17.834537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:17.835352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:17.847611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.848372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.848976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.850114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.850738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.851337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.881450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:17.895625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45ca89c4-e095-4de6-895b-7b48b32b6ff8 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1511 microversion: 2.1 time: 0.393532 Aug 29 10:50:17.898009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1795/3590] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:17 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:17.905285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:17.906144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:17.912858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.913352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.913825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:17.914713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:17.915428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:17.916032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.322510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.331805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.332101 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d57e4756-bc20-4c66-98c9-253218422673 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.432337 Aug 29 10:50:18.332692 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1796/3591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:17 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:18.337313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:18.337942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:18.345397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.346914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.348099 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b58e91c0-f19e-4ce8-aa74-40ef8db23bbf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.528674 Aug 29 10:50:18.348665 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1796/3592] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:17 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:18.348806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.349258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.352930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.355335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.362027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.363305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.518499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:18.518894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:18.526599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.527558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.528785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.530225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.531019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.531795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.653215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.657564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:18.665937 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1021790a-9b56-43a2-8b7a-11179c6677fd tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1512 microversion: 2.1 time: 0.332189 Aug 29 10:50:18.666522 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1797/3593] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:18 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:18.687963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-020bedcf-fbdc-4a74-8fee-539792cb13cf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1272 microversion: 2.1 time: 0.173281 Aug 29 10:50:18.689076 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1797/3594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:18 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:18.691077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:18.691689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:18.698496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.700380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.700994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.701937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.702583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.703024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.844254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:18.845524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:18.875472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.876312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.876917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:18.877945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:18.878590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:18.879171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.090186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:19.106967 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11f84b7c-e26b-47f5-b54b-fdac25872686 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1511 microversion: 2.1 time: 0.422351 Aug 29 10:50:19.126984 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1798/3595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:18 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:19.138827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6b9b48-aa63-4815-a256-635a41937148", "name": "network-vif-plugged", "status": "completed", "tag": "7e0e2002-c768-4018-afdd-a62a955e41bf"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:19.160081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.160604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.161022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.198482 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] Creating event network-vif-plugged:7e0e2002-c768-4018-afdd-a62a955e41bf for instance ef6b9b48-aa63-4815-a256-635a41937148 on n-h1-854121-10 Aug 29 10:50:19.207799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b4f619ed-a3a8-4178-8aef-3a06c0e8e459 req-4ec75a91-f896-44cd-b1c0-c48c1d31eb14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092078 Aug 29 10:50:19.208416 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1799/3596] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:19.224360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:19.229345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:19.230258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:19.243804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.244292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.244731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.245465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.245951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.246371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.310351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:19.357503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:19.367451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.367943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.368395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.713798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:19.723590 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7df0c656-e847-4457-9782-3fb3ca20147b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 0.886165 Aug 29 10:50:19.742034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1798/3597] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:18 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:19.750833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:19.754612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:19.763456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.764147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.764751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.766290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.766918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.767665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.928718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37ada450-f475-4be1-bfce-e962e09f438d tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.718555 Aug 29 10:50:19.947512 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1800/3598] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:50:19 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:19.953101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:19.953878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:19.962906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.963588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.964222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:19.965114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:19.970022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:19.970697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.231897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.240584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bac850b4-5cd9-4922-bb90-be4fdb707718 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.497395 Aug 29 10:50:20.241769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1799/3599] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:19 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:20.246864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:20.247835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:20.254069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.254552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.254985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.255678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.256130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.256753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.432688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.454671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59da953c-e793-444c-833b-66219b93e70e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1272 microversion: 2.1 time: 0.211573 Aug 29 10:50:20.455433 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1800/3600] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:20 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:20.469426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.479280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.481391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.485178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d00a33a-f123-4c1a-907d-cbc64c7b8e95 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.534279 Aug 29 10:50:20.487564 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1801/3601] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:19 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:20.492789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:20.503424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.504295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:20.661254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.662223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.662681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.663476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.664168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.664770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.757221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:20.759414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:20.785240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.785830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.790216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.791104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:20.796784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:20.797264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:20.820813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:20.830005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:20.944212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e55b4a6-196e-4a7f-b486-1f62f29273c4 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1008 microversion: 2.1 time: 0.468514 Aug 29 10:50:20.945649 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1801/3602] 10.222.0.47 () {58 vars in 1150 bytes} [Mon Aug 29 10:50:20 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1008 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:20.970877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:20.988827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:20.993502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:21.014921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.016224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.016839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.018217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.018860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.019588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.205603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:21.282880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d8ec3f1-9065-4e94-91b4-4e34701acc71 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1008 microversion: 2.1 time: 0.317714 Aug 29 10:50:21.286613 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1802/3603] 10.222.0.47 () {58 vars in 1212 bytes} [Mon Aug 29 10:50:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1008 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:21.292318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:21.293925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:21.301534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.302870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.303569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.304525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.305142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.305908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.321758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:21.335111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d2b6ce0-7d14-4917-a538-fba99f65fbdc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1317 microversion: 2.1 time: 0.588223 Aug 29 10:50:21.337372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1802/3604] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:20 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:21.351062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:21.359562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:21.362457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:21.372665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.373750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.374522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.375653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.376277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.376867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.619903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:21.715970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:21.724326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c2ba322-fa5c-48aa-af9c-500da25af765 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.436266 Aug 29 10:50:21.738429 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1803/3605] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:21 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:21.738429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:21.738429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:21.745583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:21.748509 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fda31863-2f00-4445-9e6f-55205bc599ef tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1008 microversion: 2.1 time: 0.409627 Aug 29 10:50:21.749909 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1803/3606] 10.222.0.47 () {58 vars in 1196 bytes} [Mon Aug 29 10:50:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1008 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:21.751302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.752089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.752235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.752935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.753391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.753855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.757168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:21.758061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:21.774870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.776024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.776497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:21.777237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:21.777713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:21.778685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:22.206811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:22.217849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:22.221718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:22.223377 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6370db20-952f-4f1f-acd8-9c551cc954b4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.472245 Aug 29 10:50:22.240881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1804/3607] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:21 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:22.254686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:22.269674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:22.276126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:22.277057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ea4b6b2-8335-48c1-b192-3ca0e39c1903 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.543103 Aug 29 10:50:22.277580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': 'e-54175673', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:22.278781 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1804/3608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:21 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:22.293043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:22.294607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:22.296386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:22.297427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:22.298185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:22.299044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:22.721729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1846698958", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:22.799372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:22.818034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] validate_networks() for [('36449cf8-e9e0-41e6-b0ca-629e7e377241', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:50:22.893591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7dc8663e-3d6b-458c-a36e-e1bdb32a1acb tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=e-54175673" status: 200 len: 344 microversion: 2.1 time: 0.646881 Aug 29 10:50:22.894319 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1805/3609] 10.222.0.47 () {58 vars in 1156 bytes} [Mon Aug 29 10:50:22 2022] GET /compute/v2.1/servers?name=e-54175673 => generated 344 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:22.901616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:22.902698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:22.910424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:22.911129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:22.913856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:22.915097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:22.916398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:22.917486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.162145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:23.174970 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9733053b-6845-4cab-ab07-4861afa3184f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1507 microversion: 2.1 time: 0.279307 Aug 29 10:50:23.175864 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1806/3610] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:22 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:23.183569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:23.185777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:23.196759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.197662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.198448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.201385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.202011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.202922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.312976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:23.527342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:23.539671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c2ffdec-71c9-4c35-b492-9df1f0f92007 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.362505 Aug 29 10:50:23.541078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1807/3611] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:23 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:23.548172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45163e11-9eb7-4f06-bdfd-cd3719bc3007", "tag": "cbcf22cc-f226-4f61-82d3-5d1c1e426219"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:23.561782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.563025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.563721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.582935 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] Creating event network-changed:cbcf22cc-f226-4f61-82d3-5d1c1e426219 for instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 on n-h1-854121-10 Aug 29 10:50:23.591032 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cbf53e45-b3e7-4a70-8397-b9482d191260 req-e169884e-1a5f-458e-ab07-270bbb0259f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047345 Aug 29 10:50:23.593266 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1808/3612] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:23.597119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:23.597544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:23.598050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:23.598465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:23.598880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:23.600974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:23.610386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:23.611707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:23.614312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.614806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.615266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.615981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.616441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.616866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.621498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.622167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.622939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.624787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.625376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.625940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.665684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Getting quotas for project 5b1a273d9e8143ff9f1d7c79e1d81f92. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:50:23.672478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Getting quotas for user da810a1262894dd2add4e5ccddd7957a and project 5b1a273d9e8143ff9f1d7c79e1d81f92. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:50:23.702130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:50:23.704660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:50:23.735370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:23.812065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-346f5807-61c6-47cb-bafd-45f9e9ac7e83 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1008 microversion: 2.1 time: 0.216963 Aug 29 10:50:23.813413 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1809/3613] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Aug 29 10:50:23 2022] GET /compute/v2.1/servers?name=-instance => generated 1008 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:23.819541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:23.821023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:23.828968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.829123 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ecee762-e8ed-42d2-a62b-627a95ea62a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.546281 Aug 29 10:50:23.829761 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1805/3614] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:50:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:50:23.830446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.831208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.832399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.833010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.833588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.854169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:23.856031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:23.882103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.883269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.883746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:23.884488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:23.885138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:23.885781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.415795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:24.429940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2c4b5b5e-2eaf-4023-9721-d4be6f9d3be5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1507 microversion: 2.1 time: 0.614543 Aug 29 10:50:24.432229 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1810/3615] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:23 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:24.456079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:24.457005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:24.470566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.471141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.471943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.473039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.473564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.474373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.528981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:24.544382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:24.548635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:24.549937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f6e21ce-34bf-4c22-9028-6e1439d52363 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.719170 Aug 29 10:50:24.566473 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1806/3616] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:23 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:24.571937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:24.581379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:24.582546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-5417567', 'deleted': False, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:24.588798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.589526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.590190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.591809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.592816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.593665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.740576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:24.826404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ff766ca-6f65-418d-85c1-e68222a02c4f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5417567" status: 200 len: 344 microversion: 2.1 time: 0.258633 Aug 29 10:50:24.827675 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1807/3617] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 10:50:24 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5417567 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:24.835880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:24.842259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:24.848915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.849621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.850561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:24.852447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:24.853089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:24.853750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.049450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:25.060199 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6af88f3-35fa-4f31-9380-76e95ffc1f6e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1218 microversion: 2.1 time: 0.230251 Aug 29 10:50:25.061101 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1808/3618] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:24 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:25.083528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a89248c-19fc-437e-a607-a698abe2b4e4", "name": "network-vif-plugged", "status": "completed", "tag": "fb0a127d-9de7-41ea-a71d-30c75533bc8f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:25.102800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.103298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.103739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.112495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:25.120907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] Creating event network-vif-plugged:fb0a127d-9de7-41ea-a71d-30c75533bc8f for instance 2a89248c-19fc-437e-a607-a698abe2b4e4 on n-h1-854121-10 Aug 29 10:50:25.124082 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3bf3bb7c-8e12-4ce4-acc4-430a3d65eb19 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.689689 Aug 29 10:50:25.126701 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-450942e3-0d83-4db5-a457-b2c78664cb61 req-14e594b9-e3d8-4b1f-8877-beb6c200bb14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050243 Aug 29 10:50:25.127841 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1809/3619] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:25.133421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:25.138295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.140131 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1811/3620] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:24 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:25.145963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.146257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:25.147029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.147856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.148282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.149331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.151475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.152139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.155072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.155559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.158332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.166699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.167485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.168194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.275843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:25.276354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:25.276908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:25.277385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:25.278147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:25.347121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:25.350468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.357973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.358475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.358919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.359629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.360085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.360524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.378552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db816e0f-31ea-4a0d-8bba-11e0cfde0212 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.234195 Aug 29 10:50:25.379090 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1812/3621] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:25 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:25.386228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:25.386735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.396662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.397364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.398019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.398889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.399512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.400100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.413678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ae8822c-37d5-44ae-963c-4c4b9067b184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "POST /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148/action" status: 202 len: 1109 microversion: 2.1 time: 0.284291 Aug 29 10:50:25.414801 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1810/3622] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:50:25 2022] POST /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148/action => generated 1109 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 10:50:25.431704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:25.432454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.439258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.439761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:50:25.439989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.440649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.441679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.442266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.442846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.554382 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b0a497e-e9c2-49c5-97f8-58619f7c6d2c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "DELETE /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 204 len: 0 microversion: 2.1 time: 0.173858 Aug 29 10:50:25.556371 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1813/3623] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:50:25 2022] DELETE /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:50:25.568182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:25.569585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.579629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.580647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.581801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.582873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.583595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.584440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.748498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:25.760584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62ed8984-ffad-4c57-a2fb-f4c37213f708 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.332434 Aug 29 10:50:25.774416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1811/3624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:25 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:25.774416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:25.774416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:25.781199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.781931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.782199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.782922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:25.783389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:25.783805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:25.809331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:25.819578 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d80baa75-3d17-4880-a615-4b7665afc819 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1517 microversion: 2.1 time: 0.257825 Aug 29 10:50:25.820158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1814/3625] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:25 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:26.007584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.018045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.026265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.027536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d3fb0786-d378-4468-bb04-672d57eff3ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.259750 Aug 29 10:50:26.042120 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1812/3626] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:25 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:26.082732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:26.083702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:26.086083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:26.091582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.092454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.093071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.094375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.095216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.095655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.150056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:26.151316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:26.158468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.159022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.159687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.160597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.161158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.161830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.183755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.197690 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5bd4d02e-2da3-4789-b8dc-2ed95cb223e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1210 microversion: 2.1 time: 0.119026 Aug 29 10:50:26.198898 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1815/3627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:26 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:26.304447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.312492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3253072b-0c11-4721-85a4-e52c9304221a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.166339 Aug 29 10:50:26.313086 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1813/3628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:26 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:26.400301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:26.400918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:26.408962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.409453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.409920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.410628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.411087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.411520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.546182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:26.556894 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-18c9d70e-1fdd-4e4e-ad90-88019dbb1d45 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.160405 Aug 29 10:50:26.557483 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1816/3629] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:26 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:26.782155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:26.782885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:26.791844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.792490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.792808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.793480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.793990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.794412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.845987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:26.846779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:26.871514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.872526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.872955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:26.875558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:26.876045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:26.876478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.286821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.295910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1684f249-3377-4335-9833-b4c9afc7ce6b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1517 microversion: 2.1 time: 0.457485 Aug 29 10:50:27.309142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1817/3630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:26 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:27.314833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:27.315673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:27.320104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.322660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.323356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.323790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.324659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.325855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.326628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.332253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:27.333157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cc6144e4-abf5-4e6c-8048-ededd4a1ac0e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.555348 Aug 29 10:50:27.333773 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1814/3631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:26 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:27.340040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:27.341517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:27.349139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.349961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.351957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.353180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.353959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.354692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.567496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.582875 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40c08943-8fd7-4d21-b11b-6d59188a0baf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1266 microversion: 2.1 time: 0.247609 Aug 29 10:50:27.583999 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1815/3632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:27 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:27.600395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:27.601913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:27.619061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.621064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.621882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.623353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.623986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.624609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.645850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:27.757788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.773549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.780474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.784307 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d7feeea-5ea9-4eea-a250-d8f45a81ba80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.473339 Aug 29 10:50:27.787968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1818/3633] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:27 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:27.812219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:27.813478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:27.815805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:27.822172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbe1f781-694f-4f5a-b06c-ba108e06fa4d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.236519 Aug 29 10:50:27.835371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1816/3634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:27 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:27.844247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.844754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.845369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:27.847448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:27.848329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:27.848909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.019837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:28.029628 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e7d0dbce-5a10-4a1a-9904-2432fb21a2bf tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1368 microversion: 2.1 time: 0.239322 Aug 29 10:50:28.030772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1819/3635] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:27 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:28.150931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38737e8b-b172-4bcc-9eb3-d4cf4872512d", "name": "network-vif-deleted", "tag": "df530762-68d4-48a1-bbba-0107c563728a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:28.165483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.166061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.166759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.184189 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] Creating event network-vif-deleted:df530762-68d4-48a1-bbba-0107c563728a for instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d on n-h1-854121-10 Aug 29 10:50:28.191963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-204b25e8-2240-4622-aa78-1cf6bf678985 req-1d8fb530-d81e-42e9-893b-9b36eebbdc43 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044357 Aug 29 10:50:28.193096 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1817/3636] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:28.316846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:28.317464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:28.324035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.324524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.324960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.326489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.326947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.327428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.358246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:28.359309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:28.361917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:28.365127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.365595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.366291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.366991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lazy-loading 'fault' on Instance uuid 38737e8b-b172-4bcc-9eb3-d4cf4872512d {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:28.368674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.369493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.370129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.371063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.371659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.371927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.412156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:28.424557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-426adc6f-20c5-46b8-91f6-96e63e3793a3 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1310 microversion: 2.1 time: 0.111292 Aug 29 10:50:28.425160 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1820/3637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:28 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1310 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:28.530521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:28.547145 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e3a1c0c-5371-41e6-b6b8-a4ab0c4e1f42 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.193820 Aug 29 10:50:28.547755 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1818/3638] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:28 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:28.606862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:28.608860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:28.616345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.617322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.617804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.618979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.619977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.620426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.705582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:28.715521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11ce48aa-c3d9-45b7-a3bb-93978bc63510 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1266 microversion: 2.1 time: 0.112820 Aug 29 10:50:28.717805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1821/3639] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:28 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:28.812996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:28.813950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:28.825970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.826709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.827162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.827871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.828494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.829094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.847720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:28.848355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:28.854580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.855064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.855650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:28.856354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:28.857121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:28.857556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.239467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.245024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.249627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e7c76cc6-b2e6-4161-996b-29813337db05 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.408893 Aug 29 10:50:29.250480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1822/3640] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:28 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:29.255755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:29.256493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:29.258917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.260555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.261928 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ac43685-ee3f-4bca-8bfa-cb4be0b072e4 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.454589 Aug 29 10:50:29.262808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1819/3641] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:28 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.268534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.355328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:29.425832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.435701 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ead82f0-8e01-4fc2-ac22-760bf3b9080f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1558 microversion: 2.1 time: 0.183092 Aug 29 10:50:29.436833 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1823/3642] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:29 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:29.462098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:29.462695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:29.488490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:29.490075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:29.500114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.504253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.504971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.505246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.507850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.509015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.509183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.510049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.510377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.511406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.512116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.514068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.598209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.601147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.601822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.602515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lazy-loading 'fault' on Instance uuid 38737e8b-b172-4bcc-9eb3-d4cf4872512d {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:29.616118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7038ff63-6ed8-42d3-8413-eeaa279a0d08 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140249 Aug 29 10:50:29.616764 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1824/3643] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:50:29 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:29.623604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163e11-9eb7-4f06-bdfd-cd3719bc3007", "name": "network-vif-plugged", "status": "completed", "tag": "cbcf22cc-f226-4f61-82d3-5d1c1e426219"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:29.644811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.646907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.647918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.678873 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] Creating event network-vif-plugged:cbcf22cc-f226-4f61-82d3-5d1c1e426219 for instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 on n-h1-854121-10 Aug 29 10:50:29.687774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6bf56cfb-4fb3-4bb8-9766-eea2b696ca46 req-5e8b69ba-bdf9-495f-ad13-24370fabd027 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069474 Aug 29 10:50:29.688448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1825/3644] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:29.696193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:29.696919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:29.706323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.706323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.706939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.707422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.709030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.709450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.738670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.747960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7701321-dbb9-4282-ab42-e524deca25e6 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 200 len: 1310 microversion: 2.1 time: 0.300480 Aug 29 10:50:29.748547 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1820/3645] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:29 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 1310 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:29.764835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:29.766116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:29.777295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.778082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.780569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.781492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:29.783809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:29.784431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:29.976426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:29.988676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a4184d57-ab2b-4f3e-912e-2791a798350a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1272 microversion: 2.1 time: 0.235301 Aug 29 10:50:29.991173 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1821/3646] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:29 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:30.108168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:30.117069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dd22d551-3bfa-4365-bc52-6cccd0439ff8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.427313 Aug 29 10:50:30.117840 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1826/3647] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:29 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:30.287229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:30.287742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:30.296395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.296898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.297342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.298079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.298539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.298965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.612136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:30.628498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:30.630507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:30.631988 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-490e50c5-695c-46d4-a68b-aeb36375288c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.350039 Aug 29 10:50:30.632879 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1827/3648] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:30 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:50:30.681420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:30.682050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:30.693245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.696478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.696956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.697682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.698182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.698606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.769200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:30.770142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 38737e8b-b172-4bcc-9eb3-d4cf4872512d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:30.776318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.777225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.777864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.778968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.779597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.780191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.796167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] HTTP exception thrown: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Request method failure captured: Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d HTTP/1.1 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJmaa_ldYBZ8o6ncqF3urhI7cVNuNTadMNerMpxBtZqVj86k5x9xrK0shnkLwxhX2friJPPDA4Mb54TeYnT-nwPgvq3IrJ_Cmlli6Hn6elCtUofP33d9RJUuUaoIDsqUrLGdnu2A4EWCzvcSt8m4WHps17Nzyr9kcJzCFn4n2DVCUVw Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e0f169bfe1145e08502f830dfd8cb9b Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '38737e8b-b172-4bcc-9eb3-d4cf4872512d'} Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:30.798066 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. Aug 29 10:50:30.803119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:30.807015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Returning 404 to user: Instance 38737e8b-b172-4bcc-9eb3-d4cf4872512d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:50:30.808079 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac51a6a0-1c3d-4677-a887-c18f8c02a9d5 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d" status: 404 len: 111 microversion: 2.1 time: 0.042873 Aug 29 10:50:30.809337 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1828/3649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:30 2022] GET /compute/v2.1/servers/38737e8b-b172-4bcc-9eb3-d4cf4872512d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:50:30.817961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:30.818462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:30.825056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.825565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.826021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.826977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.827437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.828059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.859216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:50:30.961011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-682d3d43-6803-4e10-adde-d03af432404e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "DELETE /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 204 len: 0 microversion: 2.1 time: 0.146609 Aug 29 10:50:30.962177 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1829/3650] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:50:30 2022] DELETE /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:50:30.979579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:30.979579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:30.984275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.985102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.985635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:30.986393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:30.987076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:30.987510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.013193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:31.024571 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a02b9880-0bd4-4527-bdad-99180ea2ac7b tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.755355 Aug 29 10:50:31.025905 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1822/3651] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:30 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:31.033077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:31.033979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:31.041590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.042122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.042593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.043385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.044603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.045232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.274144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:31.292002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9468874e-ecaa-4677-a382-a5ce4791ea1a tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1518 microversion: 2.1 time: 0.325538 Aug 29 10:50:31.310527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1830/3652] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:30 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1518 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:31.310527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:31.310527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:31.313956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.314482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.315194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.316123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.318465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.318916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.363360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:31.371275 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01640f99-37f1-4c52-af8b-7641b36f981d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.344043 Aug 29 10:50:31.386344 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1823/3653] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:31 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:31.405135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097eb650-74d1-48f7-81b2-388095a08cbc", "tag": "1a14e8c5-d637-4c38-91cc-d5e066d53122"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:31.426003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.426484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.426914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.438015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] Creating event network-changed:1a14e8c5-d637-4c38-91cc-d5e066d53122 for instance 097eb650-74d1-48f7-81b2-388095a08cbc on n-h1-854121-10 Aug 29 10:50:31.442877 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a0128860-4740-4db3-a665-f5ce68b08425 req-c83ecf8a-6d8a-4b28-8297-a0101895bbe6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047958 Aug 29 10:50:31.443466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1824/3654] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:31.542356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:31.555389 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37fdc4e8-318e-4f24-b162-b0293f90cc13 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.252974 Aug 29 10:50:31.555746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a89248c-19fc-437e-a607-a698abe2b4e4", "tag": "fb0a127d-9de7-41ea-a71d-30c75533bc8f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:31.556602 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1831/3655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:31 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:31.569237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.570524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.571189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.584550 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] Creating event network-changed:fb0a127d-9de7-41ea-a71d-30c75533bc8f for instance 2a89248c-19fc-437e-a607-a698abe2b4e4 on n-h1-854121-10 Aug 29 10:50:31.589996 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2ba0b253-22eb-4894-86e4-19dc3a87ed98 req-377844e1-f764-48d8-909e-1729991763c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038871 Aug 29 10:50:31.592027 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1825/3656] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:50:31.660230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:31.660780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:31.666809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.667292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.667940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:31.668642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:31.669861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:31.670358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.051479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:32.052201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:32.059502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.061086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.061544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.062301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.062764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.063201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.241041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.252348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.254726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.256317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4643414f-c534-4e78-87ef-bd8c3230bc71 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.599999 Aug 29 10:50:32.257353 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1832/3657] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:31 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:32.281619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.290213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06f9102b-f77f-4fa3-87c1-0600c3de9c96 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1314 microversion: 2.1 time: 0.247118 Aug 29 10:50:32.290900 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1826/3658] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:32 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:32.327930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:32.328557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:32.335718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.336241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.336900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.337795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.338448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.338921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.393411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:32.398152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:32.405500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.406072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.406511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.407725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.408288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.408606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.592301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.605369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f02eb52f-ec4a-441d-a2f2-b2038eaddfe2 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1518 microversion: 2.1 time: 0.285800 Aug 29 10:50:32.606378 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1833/3659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:32 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1518 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:32.617256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.617985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:32.618845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:32.626078 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d41534d-be37-439d-bbe8-bb100930db26 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.236535 Aug 29 10:50:32.626643 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1827/3660] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:32 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:32.628078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.628571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.629008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.629769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:32.630413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:32.630850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:32.651749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:32.790503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:32.799977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf06198a-9c23-49db-b694-645fd4326f93 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.192285 Aug 29 10:50:32.800881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1834/3661] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:32 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:33.279731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:33.280992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:33.289594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.290355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.290947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.291815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.292428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.293022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.314160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:33.314879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:33.327163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.327669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.333651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.334474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.334993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.335441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.667008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=12 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:33.698619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:33.722905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:33.724728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:33.736704 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8d440c7-85f5-4b0d-a865-61ec75a88ca5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1500 microversion: 2.1 time: 0.428154 Aug 29 10:50:33.751383 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1835/3662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:33 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1500 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:33.751607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:33.751607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:33.751876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:33.751876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:33.752085 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3fa3aaca-b1e9-41c9-910b-b6563798de0b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.467799 Aug 29 10:50:33.752185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.752285 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1828/3663] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:33 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:33.752381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.752381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.753177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.753860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.754591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.762210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:33.772172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:33.778870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.779820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.780274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:33.780981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:33.781980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:33.782580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.159352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.169644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aeda3fcf-400c-48ff-b6f7-e12953d6a8be tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1518 microversion: 2.1 time: 0.430073 Aug 29 10:50:34.175668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.177977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1836/3664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:33 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1518 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:34.183918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06c689bc-9dc9-47bd-a487-b9dbb412f67d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.429533 Aug 29 10:50:34.185278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1829/3665] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:33 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:34.191397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:34.196952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:34.200868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:34.208728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.209220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.209657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.216911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.217442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.217863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.218575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.219019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.219650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.240617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:50:34.298750 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3c573f1-d665-4eb4-92df-21bb648247e5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007/action" status: 202 len: 0 microversion: 2.1 time: 0.111980 Aug 29 10:50:34.299507 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1837/3666] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:50:34 2022] POST /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:50:34.306391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f640f2-6165-4749-852b-342c549110cb", "name": "network-vif-deleted", "tag": "4258a877-52ad-4679-adc4-06ab9f9da3c6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:34.318240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.318886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.319634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.333519 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] Creating event network-vif-deleted:4258a877-52ad-4679-adc4-06ab9f9da3c6 for instance 90f640f2-6165-4749-852b-342c549110cb on n-h1-854121-10 Aug 29 10:50:34.340131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1884843e-9f0c-406a-8b8f-2d7a416b14c7 req-89101bc6-2d3c-4b41-8af0-21ecf4e2318b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038694 Aug 29 10:50:34.341500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1838/3667] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:34.349015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:34.350081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:34.358700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.359354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.359954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.360820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.361792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.362172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.579526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.588486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25857abd-20d4-4ad1-a52f-172d98bb46d5 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.245510 Aug 29 10:50:34.589078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1839/3668] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:34 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:34.630142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:34.635553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.645425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-94b6652a-0d9f-45f4-b536-788b6036de3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.452696 Aug 29 10:50:34.646188 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1830/3669] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:34 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:34.769343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:34.769975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:34.776043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.776539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.777019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.777753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:34.778302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:34.778943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:34.970301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.980003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.982157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:34.983592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c52ef54d-4d7c-4964-a47c-51430ebb7ba6 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.218185 Aug 29 10:50:34.985103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1840/3670] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:34 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:35.190754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:35.191379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:35.197806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.198382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.198711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.199396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.199852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.200316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.207160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:35.208497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:35.216439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.217175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.217866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.218813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.219494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.219999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.268927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:35.276957 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1337af73-6fc0-4f50-a9c0-bc75efb1623c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1476 microversion: 2.1 time: 0.090141 Aug 29 10:50:35.277542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1831/3671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:35 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1476 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:35.374122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:35.382404 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99a15971-fb57-4021-b18e-956db829d8c0 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.179506 Aug 29 10:50:35.382987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1841/3672] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:35 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:35.611224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:35.611948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:35.619260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.619407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.619944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.620650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.621286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.621734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.667174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:35.667881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:35.674449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.674935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.675373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.676135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:35.676591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:35.677014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:35.819219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:35.829499 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5949ce2b-6f87-4649-b1fa-fb88f069cdfb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.223423 Aug 29 10:50:35.830339 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1832/3673] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:35 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:35.850685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:35.859721 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee3d0e3b-109f-47cd-8df9-4a24ed1c7a3b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.196618 Aug 29 10:50:35.860320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1842/3674] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:35 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:36.007750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:36.008368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:36.015663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.016220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.016670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.017371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.017859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.018292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.221669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:36.231727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:36.233513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:36.235151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c98669da-2c9b-4253-9156-14fb9ecbcd29 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.231236 Aug 29 10:50:36.235780 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1833/3675] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:36 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:36.298718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:36.299345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:36.305368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.305903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.306347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.307469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.308097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.308683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.345793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.346282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.346997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.347166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lazy-loading 'fault' on Instance uuid 90f640f2-6165-4749-852b-342c549110cb {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:36.394640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:36.402574 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47bed94f-84c3-4c83-b3c4-6a5926be036e tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 200 len: 1310 microversion: 2.1 time: 0.107757 Aug 29 10:50:36.404005 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1843/3676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:36 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:36.404305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:36.405016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:36.411458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.412421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.413043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.413971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.414594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.415194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.563384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:36.565564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:36.572338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77b506c7-b234-4595-8ad9-51a8e3f98cf1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.172631 Aug 29 10:50:36.572994 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1834/3677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:36 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:36.851664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:36.852314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:36.859076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.859572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.860015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.860725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.861189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.861621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.880359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:36.881114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:36.887822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.888315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.888966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:36.889688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:36.890179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:36.890618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.067293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.079541 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a63108a4-c2c6-4906-9de2-caace25dedf2 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.231999 Aug 29 10:50:37.080445 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1844/3678] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:36 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:37.110476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.120333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-665503e0-0b42-4fbb-9320-d77b6167da58 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.244311 Aug 29 10:50:37.131548 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1835/3679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:36 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:37.258830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:37.259451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:37.265992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.266514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.267076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.267897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.268366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.268799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.424962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:37.426092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 90f640f2-6165-4749-852b-342c549110cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:37.439673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.442045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.443180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.445003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.446434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.447494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.472072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] HTTP exception thrown: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. Aug 29 10:50:37.473395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Request method failure captured: Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb HTTP/1.1 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJmaa_ldYBZ8o6ncqF3urhI7cVNuNTadMNerMpxBtZqVj86k5x9xrK0shnkLwxhX2friJPPDA4Mb54TeYnT-nwPgvq3IrJ_Cmlli6Hn6elCtUofP33d9RJUuUaoIDsqUrLGdnu2A4EWCzvcSt8m4WHps17Nzyr9kcJzCFn4n2DVCUVw Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5e0f169bfe1145e08502f830dfd8cb9b Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '90f640f2-6165-4749-852b-342c549110cb'} Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:37.474135 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Returning 404 to user: Instance 90f640f2-6165-4749-852b-342c549110cb could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15b369f2-e982-40ec-ae13-2fe8c4052d5f tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb" status: 404 len: 111 microversion: 2.1 time: 0.055106 Aug 29 10:50:37.485410 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1836/3680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:37 2022] GET /compute/v2.1/servers/90f640f2-6165-4749-852b-342c549110cb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:50:37.487006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:37.487006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:37.489652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.493876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.494333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.494529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.494776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.495514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.496665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5b7039d-a594-458a-9cb4-8370dc95a007 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.240930 Aug 29 10:50:37.496859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.496859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.500535 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1845/3681] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:37 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:37.542834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:50:37.593192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:37.593877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:37.600203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.600978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.601935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.603916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.605031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.605902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.654938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4aa65019-bce2-4ea7-af38-6aa2d326d31c tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 204 len: 0 microversion: 2.1 time: 0.171362 Aug 29 10:50:37.656231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1837/3682] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:50:37 2022] DELETE /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:50:37.670564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:37.672009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:37.681955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.682999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.683708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.685606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:37.686330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:37.686992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:37.810308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.818699 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46c06006-3913-4bb6-9d31-8980839dc855 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.230156 Aug 29 10:50:37.819561 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1846/3683] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:37 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:37.855180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:37.863531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b9fffdd-69dd-47a3-95b6-2da0972dfbb9 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1517 microversion: 2.1 time: 0.202638 Aug 29 10:50:37.865391 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1838/3684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:37 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:38.100388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:38.101071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:38.108086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.108591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.109026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.109755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.110218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.110650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.142188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:38.142912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:38.149376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.149908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.150346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.151040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.151493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.151918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.312396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:38.320987 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b469614-9e6f-4017-acb0-a09a46514270 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.224248 Aug 29 10:50:38.321580 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1847/3685] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:38 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:38.341174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:38.353922 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b1ff0ea-e952-4dad-9c92-959efc4345e1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.216027 Aug 29 10:50:38.354521 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1839/3686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:38 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:38.518355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:38.519001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:38.526086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.526574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.527013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.527708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.528804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.529254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.717792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:38.727225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:38.728671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:38.729869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e98d309-0123-485a-ba37-a54e757ae3ca tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.215429 Aug 29 10:50:38.730440 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1848/3687] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:38 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:38.841453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:38.842436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:38.849037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.849602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.850149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.850836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.851290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.851719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.887226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:38.888076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:38.894487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.895190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.895757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:38.896490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:38.897114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:38.897545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.049871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:39.062031 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-847c7dce-2347-41e2-bc41-f15f812b5b04 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.225206 Aug 29 10:50:39.062809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1840/3688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:38 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:39.086256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:39.094846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e44f78db-2cb1-46ee-bec6-a75bbb23c560 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1517 microversion: 2.1 time: 0.211776 Aug 29 10:50:39.109084 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1849/3689] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:38 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:39.343772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:39.344564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:39.351638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.352345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.353045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.353946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.355048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.355654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.377774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:39.378795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:39.392638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.393402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.393906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.394637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.395951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.401382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.427021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:39.601759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:39.614651 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1f26edc-47a4-448b-b137-396c411682a8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.275060 Aug 29 10:50:39.630009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1841/3690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:39 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:39.640323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097eb650-74d1-48f7-81b2-388095a08cbc", "name": "network-vif-plugged", "status": "completed", "tag": "1a14e8c5-d637-4c38-91cc-d5e066d53122"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:39.642205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:39.651793 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b446de7-2045-4e45-ad73-cbb6f07bd117 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.279699 Aug 29 10:50:39.652408 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1850/3691] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:39 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:39.653645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.654428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.654876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.666963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] Creating event network-vif-plugged:1a14e8c5-d637-4c38-91cc-d5e066d53122 for instance 097eb650-74d1-48f7-81b2-388095a08cbc on n-h1-854121-10 Aug 29 10:50:39.672713 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c01476ac-20f5-435e-922e-e03aa18dfa63 req-2b5e9e54-0b7a-4389-bdf1-637adc1a4ff1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040803 Aug 29 10:50:39.673308 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1842/3692] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:39.756523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:39.757446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:39.764714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.765209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.765891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:39.767856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:39.768811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:39.769545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.023795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.036618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.038268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.039711 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19312537-ed91-4c6a-a061-6793ff7c7a26 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.287507 Aug 29 10:50:40.040360 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1851/3693] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:39 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:40.084115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:40.084821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:40.092144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.092880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.093323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.094261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.094891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.095506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.117193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:40.118112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:40.131384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.135430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.136176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.136982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.138352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.138937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.229829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.246935 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-81223c59-49df-4983-be98-6382c4324b98 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1475 microversion: 2.1 time: 0.134056 Aug 29 10:50:40.248395 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1852/3694] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:40 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1475 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:40.270227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb40fd7-a6de-4171-84cd-dc3d59bcc184", "name": "network-vif-deleted", "tag": "57706e61-c403-49ff-adeb-f17279ff9329"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:40.282351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.283469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.284078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.313199 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] Creating event network-vif-deleted:57706e61-c403-49ff-adeb-f17279ff9329 for instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 on n-h1-854121-10 Aug 29 10:50:40.319150 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-52da41fb-2c0f-4202-bf80-4586c0be4114 req-b40dec44-dd73-4f9f-99fa-1823bd0f42e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068838 Aug 29 10:50:40.320450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1853/3695] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:40.354020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.366446 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3fd9795c-5a55-4b28-8475-6395ea807058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.287203 Aug 29 10:50:40.367707 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1843/3696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:40 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:40.645077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:40.645813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:40.652661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.653805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.654385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.655325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.655874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.656335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.674443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:40.675250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:40.690400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.691199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.691643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.692532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:40.693150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:40.693846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:40.876362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.884132 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adec8bf6-32b5-470b-aa66-579d7f5763a9 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.243859 Aug 29 10:50:40.884722 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1854/3697] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:40 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:40.897942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:40.897942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-859eb01d-77e6-4c72-a9aa-c508cfa214a3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.229393 Aug 29 10:50:40.907209 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1844/3698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:40 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:41.064394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:41.065008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:41.071131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.071615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.072259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.072957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.073413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.073871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.264756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:41.269079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:41.269719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:41.275726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:41.277512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.277685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:41.278041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.278574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.279225 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0ee706b0-4bd8-4777-9f8e-7e3af4de57ac tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.219541 Aug 29 10:50:41.279336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.279794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.280430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1855/3699] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:41 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:41.280539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.313686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.314332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.314784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.315244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lazy-loading 'fault' on Instance uuid 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:41.356902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:41.364918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0011203a-96c5-4f2c-9cfa-d1cc3c86e5fa tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1309 microversion: 2.1 time: 0.099619 Aug 29 10:50:41.365624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1845/3700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:41 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:41.388986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:41.389635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:41.395787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.396317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.396694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.397396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.398079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.398401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.541931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:41.551675 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5c0b411-a835-48e6-9f2b-0158a4448292 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1314 microversion: 2.1 time: 0.167493 Aug 29 10:50:41.552298 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1856/3701] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:41 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:41.908983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:41.908983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:41.914564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.915044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.915719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.916418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.916874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.917296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.921132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:41.921779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:41.928773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.929254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.929691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:41.930605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:41.931070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:41.931500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.126756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.128611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.136920 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7d6f321-c1c9-408a-b3ce-8729331da043 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.220534 Aug 29 10:50:42.137462 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1857/3702] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:41 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:42.139930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7982804-de26-460a-a189-535d22f6caf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.236958 Aug 29 10:50:42.140687 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1846/3703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:41 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:42.302879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:42.303495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:42.311003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.311500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.311952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.312662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.313125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.313558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.388629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:42.389488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:42.397266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.397924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.398456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.399357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.399936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.400442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.435465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.435958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.436569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.436959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lazy-loading 'fault' on Instance uuid 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:42.492163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0f169bfe1145e08502f830dfd8cb9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada15edf7104a898cf2bd66f8b16c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.499945 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a5febe66-e408-48ae-ab90-f9315b8e899b tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 200 len: 1309 microversion: 2.1 time: 0.116834 Aug 29 10:50:42.500844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1847/3704] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:42 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:42.543628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.553836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.555294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.556473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3f3a56f-b512-4d8c-88aa-1bf719c34078 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.257634 Aug 29 10:50:42.557043 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1858/3705] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:42 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:50:42.575628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:42.576284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:42.582589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.583081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.583632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.584371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.584831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.585301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.723474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:42.732349 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c776963-9a6c-4587-be72-4e0b39c9ddbe tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1501 microversion: 2.1 time: 0.160150 Aug 29 10:50:42.733326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1848/3706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:42 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:42.753151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:42.755709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:42.762575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.763333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.763817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.764560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.765032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.765575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.789534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lazy-loading 'flavor' on Instance uuid 097eb650-74d1-48f7-81b2-388095a08cbc {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:42.867791 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06686c45-0433-4f67-b26e-87d66cace4e4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "POST /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc/action" status: 200 len: 32 microversion: 2.1 time: 0.118579 Aug 29 10:50:42.868414 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1859/3707] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:50:42 2022] POST /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:50:42.878496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:42.879257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:42.885522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.886110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.886613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:42.887554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:42.888139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:42.888570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.059137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.068134 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18c2b7c1-f431-4503-b292-7b4bfc3c8dd9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.193576 Aug 29 10:50:43.069034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1849/3708] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:42 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:43.161293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.161974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:43.168827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.169314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.169655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:43.169845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.170279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.171301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.171937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.172543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.173122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:43.180816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.181403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.181948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.182787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.183315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.183815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.194843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:43.381905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.397255 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1150adc-b7f5-4198-b0af-afe611d8b7c4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.240400 Aug 29 10:50:43.409877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1850/3709] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:43.417603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.430993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.436446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.437284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Searching by: {'deleted': False, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:43.441741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f54c27f8-d9c5-4b1e-9668-9cbbc1dbae57 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.281636 Aug 29 10:50:43.443065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1860/3710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:43.457206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.457725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.458485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.458891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.459710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.459928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.500559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:43.521915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.522540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] [instance: 1bb40fd7-a6de-4171-84cd-dc3d59bcc184] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:43.534096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.534816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.535451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.536396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.537036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.537646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.555855 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] HTTP exception thrown: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Request method failure captured: Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 HTTP/1.1 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJmaa_ldYBZ8o6ncqF3urhI7cVNuNTadMNerMpxBtZqVj86k5x9xrK0shnkLwxhX2friJPPDA4Mb54TeYnT-nwPgvq3IrJ_Cmlli6Hn6elCtUofP33d9RJUuUaoIDsqUrLGdnu2A4EWCzvcSt8m4WHps17Nzyr9kcJzCFn4n2DVCUVw Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ada15edf7104a898cf2bd66f8b16c18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 6ada15edf7104a898cf2bd66f8b16c18 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1078023575 Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e0f169bfe1145e08502f830dfd8cb9b Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServerFiltersTestJSON-1078023575-project Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1bb40fd7-a6de-4171-84cd-dc3d59bcc184'} Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:43.558774 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. Aug 29 10:50:43.564366 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:50:43.564965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18d2527e-72ed-40d5-a2c9-2b9c654cc503 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.147659 Aug 29 10:50:43.564965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1851/3711] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers => generated 340 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:43.574109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] Returning 404 to user: Instance 1bb40fd7-a6de-4171-84cd-dc3d59bcc184 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:50:43.574109 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-13551a94-b3da-43a1-a909-9552449a5779 tempest-ListServerFiltersTestJSON-1078023575 tempest-ListServerFiltersTestJSON-1078023575-project] 10.222.0.47 "GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184" status: 404 len: 111 microversion: 2.1 time: 0.050770 Aug 29 10:50:43.574109 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1861/3712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers/1bb40fd7-a6de-4171-84cd-dc3d59bcc184 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:50:43.582172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.582449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:43.589612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.591356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:43.591522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.591522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.592481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.593043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.593575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.603059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.603840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Searching by: {'deleted': False, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:50:43.620429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.621106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.621867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.624784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.625620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.627417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.713995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:50:43.806501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.814139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:43.815326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:43.816107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:43.945139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.961806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.963723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:43.965110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb19ee17-f747-4a18-b0ee-59a8aa80b97c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.388096 Aug 29 10:50:43.967174 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1862/3713] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:44.063758 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e16ef42-00b3-4c82-bf4c-f58630f30596 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.486792 Aug 29 10:50:44.064587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1852/3714] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:50:43 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:44.098048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:44.098678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:44.102566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-28a7a971-bcbd-4785-ab4e-a4b19930c57a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:44.111782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.112271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.112710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.113417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.113899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.118863 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-28a7a971-bcbd-4785-ab4e-a4b19930c57a tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032245 Aug 29 10:50:44.119845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.122105 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1863/3715] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:50:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:44.379875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:44.392002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c9b591b-aedf-4965-ba8d-77ae17156a30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.304811 Aug 29 10:50:44.408907 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1853/3716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:44 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:44.424107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:44.424826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:44.443769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.444721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.445497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.447333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.449883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.450571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.464282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:44.465054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:44.482332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.483233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.483805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.484709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:44.485353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:44.485917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:44.768947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:44.778580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd81e68c-e7cd-4cf0-a7e4-96e59c742212 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.358763 Aug 29 10:50:44.796156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1864/3717] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:44 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:44.802421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:44.818496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2c791225-1714-4243-b61d-954e343b26a8 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.358378 Aug 29 10:50:44.820342 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1854/3718] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:44 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:44.996403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:44.997114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:45.006952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.008020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.010661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.011629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.012096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.012582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.292813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:45.302571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:45.304754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:45.306289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4044194a-28d3-4786-a176-0396fe7d35b5 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.314533 Aug 29 10:50:45.307482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1865/3719] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:44 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:45.415093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:45.415710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:45.448778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.449719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.450927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.453866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.454627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.457832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.520520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:45.524074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:45.546926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.549736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.550375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.553302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.553912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.554484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.607984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:50:45.654934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:45.724671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-88bc360f-e1ae-4c67-a6f6-d1927ee31152 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 204 len: 0 microversion: 2.1 time: 0.219573 Aug 29 10:50:45.726633 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1866/3720] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:50:45 2022] DELETE /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:50:45.748674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:45.749347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:45.758899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.759576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.760163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.761469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.762447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.763188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.774304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:45.789281 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-640c23cf-5e84-4b71-a80c-9d991d0a96da tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.377931 Aug 29 10:50:45.801925 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1855/3721] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:45 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:45.806356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:45.807086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:45.819245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.821601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.826114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:45.827270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:45.827860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:45.828575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.043489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.055117 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9268240c-78e7-456c-879e-dd065e84008e tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1712 microversion: 2.1 time: 0.323483 Aug 29 10:50:46.055704 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1867/3722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:45 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1712 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:46.065595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:46.066367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:46.084464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.085120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.085884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.086658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.087074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.087519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.090241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.099404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a0b947e9-f6d8-46b2-9cab-8adbfc25c298 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.300226 Aug 29 10:50:46.100258 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1856/3723] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:45 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:46.239961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.249648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f5eebb4-aded-4797-aabc-169db18520d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.192600 Aug 29 10:50:46.250483 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1868/3724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:46 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:46.330892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:46.332055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:46.339409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.339996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.340451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.342010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.342618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.343167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.555284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.566958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.568546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:46.569835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0772aa68-09b6-4eca-8b15-cc3c1783b4ef tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.242995 Aug 29 10:50:46.581879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1857/3725] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:46 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:46.815151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:46.815840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:46.822844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.823279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.823707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:46.824646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:46.825337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:46.825876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.024522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.033309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1b973e4-561d-450d-ab79-5a7ed37ebcc8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.221937 Aug 29 10:50:47.034704 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1869/3726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:46 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:47.079240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:47.080703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:47.089661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.089661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.089661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.089661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.091950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.091950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.120753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:47.121622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:47.130096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.134900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.135371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.136119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.136599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.137035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.426315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.436679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2bd27943-fba1-4538-8782-bc88d71cab2b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1712 microversion: 2.1 time: 0.361944 Aug 29 10:50:47.438362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1858/3727] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:47 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1712 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:47.444010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:47.444635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:47.451656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.452027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.452471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.453214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.454041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.454438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.469753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.480211 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bdc80455-ba34-4021-a001-729693a0cd57 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.363558 Aug 29 10:50:47.481305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1870/3728] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:47 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:47.600292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:47.601242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:47.611855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.613606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.614431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.615405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:47.616634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:47.617487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:47.677750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.690520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e35c2cb-7e2f-4bbc-ac59-53d2a631b1eb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.250554 Aug 29 10:50:47.691125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1859/3729] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:47 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:47.858104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.869459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.871014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:47.872326 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6d847e6-8147-4370-8bbb-26821924d5b8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.278823 Aug 29 10:50:47.873027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1871/3730] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:47 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:48.055733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:48.056646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:48.064903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.070855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.074063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.076793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.077548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.080651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.319528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:48.341280 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84c625d3-6d74-4ad3-ae05-20899285986d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.289030 Aug 29 10:50:48.342600 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1860/3731] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:48 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:48.460892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:48.462117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:48.472752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.473808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.474448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.475531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.476184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.476776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.506876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:48.508059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:48.516597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:48.525050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.533019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.533485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.534427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.534996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.535445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.787938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:48.801000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e5d46cd-1b80-4e27-80d8-d3f16817b919 tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1712 microversion: 2.1 time: 0.346179 Aug 29 10:50:48.818720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1872/3732] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:48 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1712 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:48.826232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:48.827253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:48.835809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.836687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.837370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.838664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.839379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:48.840340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:48.960266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:48.978578 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-19ad04ef-0138-497e-9c35-e5f19c6e3815 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.476831 Aug 29 10:50:48.979859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1861/3733] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:48 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:48.985846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:48.986783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:48.999294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:48.999804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.000253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.000966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.002388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.002844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.598526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:49.607881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-825020fd-5b8d-41a3-9eb3-f7da9f3cfbc0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.787895 Aug 29 10:50:49.617322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1873/3734] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:48 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:49.625556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:49.626231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:49.632995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.633483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.641040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.644640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.645138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.645587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.738119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:49.768403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:49.776098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:49.777225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0a0f50e-6b40-41ca-a3fe-b18942086bdf tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.796144 Aug 29 10:50:49.790706 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1862/3735] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:48 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:49.828821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb", "name": "network-vif-deleted", "tag": "8d7d3ffb-ab02-4a2f-b9be-75e17b836035"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:49.854940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.859382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.859847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.881451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] Creating event network-vif-deleted:8d7d3ffb-ab02-4a2f-b9be-75e17b836035 for instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb on n-h1-854121-10 Aug 29 10:50:49.898027 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2c8ead3e-25d2-4b9b-9e1c-d4db9c7fd75b req-c100f729-f884-4ef7-ace2-aebd7454dff7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074379 Aug 29 10:50:49.898659 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1863/3736] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:49.905674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:49.906446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:49.914344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.915089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.916185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.917116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:49.918084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:49.918748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:49.968841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:49.999723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7c8551f-6a16-494c-a5e0-813e5c72bc13 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.380866 Aug 29 10:50:50.016762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.016762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.016762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.021773 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1874/3737] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:49 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:50.034320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:50.035345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lazy-loading 'fault' on Instance uuid 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:50:50.035935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:50.042997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.043716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.044455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.053976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.054842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.068455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.149900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64edcaf463d45b0a104bf51c8cf1c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41f0fdba61433c99f4da0e93fd25e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:50.159864 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6e4cbdf-303d-4ecf-8c94-1d9c114772cb tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 200 len: 1367 microversion: 2.1 time: 0.259901 Aug 29 10:50:50.160876 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1864/3738] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:49 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:50.357776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:50.369191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc1ea115-eeb2-492d-814e-583a517fd843 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.346020 Aug 29 10:50:50.376281 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1875/3739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:50 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:50.581258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "990c889f-15bb-4bc8-8674-6d5ffc9fa781"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:50.607255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.607902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.610493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.632131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:50.632750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:50.665934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.667891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.677801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.681271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.683505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.685846 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] Creating event network-vif-plugged:990c889f-15bb-4bc8-8674-6d5ffc9fa781 for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:50.686598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.712967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6c7cbc4e-2f6e-4fb2-b6f6-f4874b5b0d7b req-5deaf3a9-fc5f-4458-b5ec-29454b68f8cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135511 Aug 29 10:50:50.713957 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1865/3740] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:50:50.818107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:50.819067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:50.830877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.836851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.837322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:50.838191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:50.838662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:50.839102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.142765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.159094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b748bda4-2788-4e46-9cb1-9bc2b44fe282 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.532082 Aug 29 10:50:51.160168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1876/3741] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:50 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:51.174902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:51.176266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:51.186613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.189659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.190331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.191295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.192928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.193572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.199562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.211824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.213764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.215623 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6077c5e5-5f82-4ce4-b71e-e15f240e560a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.403280 Aug 29 10:50:51.216709 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1866/3742] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:50 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:50:51.221898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:51.223842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] [instance: 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:51.232323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.233174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.233891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.235658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.236476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.237115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.269671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:51.271113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] HTTP exception thrown: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Request method failure captured: Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb HTTP/1.1 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJm1iCHj8dar5zMaszYL7Mn3giAPccTY6sNfBU2W-wBn6YygKnqzmzVyVWRc52Gb9TvOXwh9JyIoUuzHJvT74OndwWoETOiExE0iqNIICfUqzcZFZC7PzfdcFFBWKIVfDRFO4XZ6ZZJqop7R-oavE7yincsQksjegn93ByVkC1yZQsw Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4b41f0fdba61433c99f4da0e93fd25e0 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestManualDisk-1914122507 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b41f0fdba61433c99f4da0e93fd25e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4b41f0fdba61433c99f4da0e93fd25e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4b41f0fdba61433c99f4da0e93fd25e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b41f0fdba61433c99f4da0e93fd25e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestManualDisk-1914122507 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4b41f0fdba61433c99f4da0e93fd25e0 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestManualDisk-1914122507 Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestManualDisk-1914122507-project Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e64edcaf463d45b0a104bf51c8cf1c6b Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestManualDisk-1914122507-project Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb'} Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:50:51.275500 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:50:51.281216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Returning 404 to user: Instance 96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:50:51.283032 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a59a3d59-5151-46c7-b8db-340960fa7eba tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb" status: 404 len: 111 microversion: 2.1 time: 0.064039 Aug 29 10:50:51.284808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1867/3743] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:51 2022] GET /compute/v2.1/servers/96f1db9f-2bd2-4a2c-9f2f-6b9e3b135ddb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:50:51.298284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a99d302-5664-4b41-82b2-d2dddc0b631b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] Calling method '.version_select at 0x7f66c5ecf4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:51.328538 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a99d302-5664-4b41-82b2-d2dddc0b631b tempest-ServersTestManualDisk-1914122507 tempest-ServersTestManualDisk-1914122507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738459067" status: 202 len: 0 microversion: 2.1 time: 0.040674 Aug 29 10:50:51.329808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1868/3744] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738459067 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:50:51.395892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:51.397671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:51.400633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.407359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.408058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.409075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.410042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:51.410513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:51.410950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:51.412505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce313619-9d4d-4d9d-a268-c66709753d0c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.250941 Aug 29 10:50:51.413755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1877/3745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:51 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:51.705134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:51.728497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d9445b3-c99c-461b-a703-ff8052d9dc14 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.338992 Aug 29 10:50:51.733426 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1869/3746] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:51 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:50:52.181260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:52.182651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:52.201600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.201907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.202595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.205688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.207166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.210037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.243993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:52.245967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:52.266952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.267492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.267949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.275615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.276436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.276904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.702956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:52.718399 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80574759-bdbd-4af7-b5f7-ef433ddf4375 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.541242 Aug 29 10:50:52.733887 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1878/3747] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:52 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:52.740141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:52.741009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:52.750130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.750881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.751534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.752423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.754146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.754944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.764548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:52.779442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:52.788521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:52.794809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1271a0e7-929f-45a9-828d-0f9ccce31b2b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.555728 Aug 29 10:50:52.805487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1870/3748] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:52 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:50:52.810386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:52.810997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:52.834236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.837823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.849060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:52.849778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:52.850262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:52.850698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:53.275271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:53.287724 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49ca4834-b956-4ee1-a9c2-5cf256567477 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.551915 Aug 29 10:50:53.310413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:53.317034 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1879/3749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:52 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:53.329261 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-212e7d6b-c75e-4ed3-a019-41973d1303d4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.522435 Aug 29 10:50:53.332403 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1871/3750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:52 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:53.334540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "95f22f43-ba65-4323-8dc1-b3d94b0cd93d"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "2e0c26f5-0c19-4878-8c92-671fdcd5dc9d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:53.355270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:53.356757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:53.357882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:53.373983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Creating event network-vif-plugged:95f22f43-ba65-4323-8dc1-b3d94b0cd93d for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:53.374515 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] Creating event network-vif-plugged:2e0c26f5-0c19-4878-8c92-671fdcd5dc9d for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:53.382587 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-904d40e9-6b43-405e-acd1-5831da61209c req-c7e74b23-1019-4ba5-92fc-931619967518 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058275 Aug 29 10:50:53.383886 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1880/3751] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:53.739834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:53.740450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:53.743946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:53.753435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:53.753964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:53.754411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:53.759291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:53.764380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:53.765091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:53.802557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:53.828612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:53.829495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:53.843194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:53.843841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:53.844779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:53.845993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:53.846678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:53.847327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:54.320423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.337335 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99e017ed-bb61-4f39-bf68-5457c90d2e62 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.601298 Aug 29 10:50:54.343253 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1872/3752] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:53 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:54.360228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:54.365660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:54.373623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.374934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:54.375613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:54.376477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:54.380292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:54.381497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:54.384779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:54.402017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.406941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.409537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f912d9f4-f3d2-445d-924e-9f142ebf5202 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.586595 Aug 29 10:50:54.412458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1881/3753] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:53 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:50:54.425049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:54.426415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:54.442686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:54.443467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:54.446264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:54.447456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:54.450055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:54.450715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:54.873479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.887393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ea8b663-9b73-41c1-8135-e3c1c4144fc2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.541450 Aug 29 10:50:54.888785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1873/3754] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:54 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:54.899811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:54.924874 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bd2d8b7-b42e-48b7-a722-741207d35793 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.496093 Aug 29 10:50:54.937284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1882/3755] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:54 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:55.363370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:55.364563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:55.371547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.373103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.373755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.374648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.375393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.377488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.440554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:55.442018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:55.455398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.459217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.459858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.461075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.463091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.468754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.476265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:50:55.642806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:55.661035 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80df7f86-0f4a-47b1-89d3-34ccdc055e8e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.301608 Aug 29 10:50:55.664194 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1874/3756] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:55 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:55.676285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "fac7f7da-8cf8-4406-ae02-640005dca23c"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "61eeaaae-4621-43d9-aad2-3e22a010a9da"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "274fa1af-4d11-424e-b9a9-d946b476348f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:55.708568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.709447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.710689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.736830 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Creating event network-vif-plugged:fac7f7da-8cf8-4406-ae02-640005dca23c for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:55.739964 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Creating event network-vif-plugged:61eeaaae-4621-43d9-aad2-3e22a010a9da for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:55.741197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] Creating event network-vif-plugged:274fa1af-4d11-424e-b9a9-d946b476348f for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:55.748263 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-55f4496e-57ca-4bd4-902a-b386bd9b6a72 req-b4988fd7-e1a9-4e57-befe-cc40f453504b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081414 Aug 29 10:50:55.755663 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1875/3757] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:55.890294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:55.906878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:55.911273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:55.914633 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bee43d47-d148-4da3-8909-6aff28d98601 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.478334 Aug 29 10:50:55.917956 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1883/3758] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:55 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:55.926661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:55.927536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:55.935910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.936411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.936852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.937556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:55.938675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:55.939274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:55.952407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2059380359", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "6b6925bb-c6ea-4e56-81b3-bcbbdc752302"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:56.051664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] validate_networks() for [('6b6925bb-c6ea-4e56-81b3-bcbbdc752302', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:50:56.242516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:56.254784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aea9ec1d-88b5-4234-aa0d-1984e46f7b5e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.332796 Aug 29 10:50:56.257155 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1884/3759] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:55 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:56.263351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:56.264682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:56.287091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:56.287923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:56.290153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:56.299365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:56.300801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:56.302786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:56.636444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:56.646960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-070e2556-c92a-45ca-a584-586ebe2dc9e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.388477 Aug 29 10:50:56.647569 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1885/3760] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:56 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:56.684999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:56.686018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:56.696783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:56.699172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:56.700699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:56.702471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:56.703319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:56.705157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.048756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:57.062098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11768c7a-b35a-4bf5-ad1e-7a16ad5514d7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.381393 Aug 29 10:50:57.069375 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1886/3761] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:56 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:57.086086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:57.092946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:57.104102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.104889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.105547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.108596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.109296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.109990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.819918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:57.831460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:57.833677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:57.834908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:50:57.835393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:50:57.835941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94655e0c-beca-4a1a-8886-2f4bf3d35835 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.764695 Aug 29 10:50:57.836078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:50:57.836520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:50:57.837002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:50:57.837161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1887/3762] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:57 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:57.844501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:57.845386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:57.853752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.854718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.859882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.860906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.861620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.862917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.866467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.868884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.869371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.872764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:57.873238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:57.873682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:57.936538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Getting quotas for project 3bed652d38c841b3a2f9b5858ff1d42b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:50:57.952867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Getting quotas for user 433d1ee7aade46048f6d8d3436c72cd7 and project 3bed652d38c841b3a2f9b5858ff1d42b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:50:57.987806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:50:57.990420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:50:58.093208 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c0e19c9-1065-4179-b7aa-eccf2bfbf72e tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328407 Aug 29 10:50:58.093942 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1876/3763] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:50:58.101025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:58.101566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:58.117844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.118361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.118816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.119590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.120058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.120498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.193431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:58.202911 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a7b9934-8121-4523-8e9c-10ed9053f6c8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.364521 Aug 29 10:50:58.204245 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1888/3764] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:57 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:58.209049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-plugged", "status": "completed", "tag": "c33d5932-5453-449b-9e0f-2a24c345b9bc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:50:58.246170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.247193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.247837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.285476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] Creating event network-vif-plugged:c33d5932-5453-449b-9e0f-2a24c345b9bc for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:50:58.296022 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-61066976-ac59-4694-8127-0f7d2f14e845 req-2bbcffd3-3492-4118-8aa0-17cfd42fc587 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090231 Aug 29 10:50:58.296357 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1889/3765] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:50:58.304810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:58.305894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:58.316202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.317051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.318498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.319417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.320058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.320671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.601671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:58.612512 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-908fe73d-3346-498a-aa34-81f731227838 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.517477 Aug 29 10:50:58.613906 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1877/3766] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:58 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:58.622890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-828fc737-d29e-4f5a-b473-c94e4417c484 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:58.623921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-828fc737-d29e-4f5a-b473-c94e4417c484 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:58.692457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:58.712172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ad6ae82f-b622-48d6-b8fc-17d8687bf409 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1514 microversion: 2.1 time: 0.414372 Aug 29 10:50:58.718064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1890/3767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:58 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:58.733377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-828fc737-d29e-4f5a-b473-c94e4417c484 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:58.741180 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-828fc737-d29e-4f5a-b473-c94e4417c484 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1225 microversion: 2.1 time: 0.125652 Aug 29 10:50:58.742555 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1878/3768] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:58 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:58.867344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:58.868757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:58.876566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.877081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.877527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:58.878550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:58.879232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:58.879906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.229928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:59.231307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:59.247586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.248635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.249718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.251820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.252468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.253093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.513992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:59.534788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:59.550402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:59.557415 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2450bc0c-0ed6-4bcf-a361-009d2f33ca99 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.692564 Aug 29 10:50:59.584782 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1891/3769] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:50:58 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:50:59.603433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:59.619163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a0911c9-6e0c-40fc-b14a-1e1828d0e7f8 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.393559 Aug 29 10:50:59.620307 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1879/3770] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:59 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:59.638151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:59.639844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:59.651200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.651911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.653177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.654924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.655626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.656259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.735949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:59.738481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:59.748333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.748840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.749431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.750192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.750657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.751097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.950619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:50:59.964851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47e9278f-f109-47c2-8728-11cbaca453c6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.334800 Aug 29 10:50:59.977726 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1892/3771] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:59 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:50:59.977726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:50:59.977726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:50:59.989803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.991387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.991842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:50:59.992578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:50:59.993050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:50:59.993479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:00.011020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.023988 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5981bc75-65b7-43f6-9659-7d767b33c872 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1520 microversion: 2.1 time: 0.294414 Aug 29 10:51:00.024874 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1880/3772] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:59 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:00.096518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.104882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4cb810cf-3333-46f7-97a1-7e46921baba8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1277 microversion: 2.1 time: 0.137325 Aug 29 10:51:00.106654 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1893/3773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:50:59 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:00.591076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:00.591708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:00.601155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:00.601591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:00.602074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:00.602890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:00.603367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:00.603896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:00.644059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:00.644956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:00.661621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:00.662497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:00.663207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:00.664851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:00.665723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:00.666338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:00.900406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.910860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.912519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.913913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18113a5c-474d-4f06-b876-c01f823b865e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1869 microversion: 2.32 time: 0.329143 Aug 29 10:51:00.926859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1881/3774] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:51:00 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1869 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:51:00.943628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:00.957525 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8df7c9d1-d77a-40f1-ad05-ce6a79688f5a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.316890 Aug 29 10:51:00.959168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1894/3775] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:00 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:00.989228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:00.990560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:01.004902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.005410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.005897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.006605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.007064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.007492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.049583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:01.050320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:01.057104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.057758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.058475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.060394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.066317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.066930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.343631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:01.355663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-528a25d2-7605-4d40-97b3-fa2f31a58b6c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.370029 Aug 29 10:51:01.356483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1882/3776] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:00 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:01.364210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:01.365266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:01.382472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:01.386578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.387079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.387686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.388844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.393924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.395263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83678aff-3a6d-4518-8962-2fcad5afa66e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1520 microversion: 2.1 time: 0.350526 Aug 29 10:51:01.395802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.398142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1895/3777] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:01 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:01.477534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:01.487496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba6972b6-51c4-4788-9529-05410225feb3 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1277 microversion: 2.1 time: 0.127994 Aug 29 10:51:01.488157 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1883/3778] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:01 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:01.939742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:01.940631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:01.950213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.951517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.952237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.953872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.954593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.955342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.981728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:01.982449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:01.993343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:01.994148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:01.995105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:01.996103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:02.003500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:02.004422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:02.499528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.500360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.515179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.520444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.525989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-199bc790-e512-4c98-b864-0adc8830985a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2821 microversion: 2.32 time: 0.586431 Aug 29 10:51:02.527249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1896/3779] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:51:01 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2821 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:51:02.535062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-428cf321-e431-4299-8fed-9e706a114520 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.559071 Aug 29 10:51:02.547567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:02.548203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:02.553719 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1884/3780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:01 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:02.554446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:02.554947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:02.555394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:02.556231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:02.556701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:02.557135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:02.560164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:02.561079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:02.573350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:02.576468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:02.578578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:02.579592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:02.582876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:02.584647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:02.934827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.947909 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32e37052-2086-45db-b873-429281f86231 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.418721 Aug 29 10:51:02.948415 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1897/3781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:02 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:02.954788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:02.961289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6b9b48-aa63-4815-a256-635a41937148", "name": "network-vif-unplugged", "status": "completed", "tag": "7e0e2002-c768-4018-afdd-a62a955e41bf"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:02.963700 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-477a6179-6099-4c1e-a64d-41d1f2616184 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1520 microversion: 2.1 time: 0.408454 Aug 29 10:51:02.985854 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1885/3782] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:02 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:02.993864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:03.000158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:03.010870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.011478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.012065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.018487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.020116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.022145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.022959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.026012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.026920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.042871 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] Creating event network-vif-unplugged:7e0e2002-c768-4018-afdd-a62a955e41bf for instance ef6b9b48-aa63-4815-a256-635a41937148 on n-h1-854121-10 Aug 29 10:51:03.050033 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f50a89fb-b8d6-4e93-af73-17da466ee704 req-d2e96cd7-9631-402f-bc3b-efd0b5d4ad16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099744 Aug 29 10:51:03.051717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1898/3783] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:03.069146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:03.069776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:03.092681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.093194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.093642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.094510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.095035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.095545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.173409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:03.190886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d49de43-3abd-4484-97d1-745d77fe3726 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1283 microversion: 2.1 time: 0.199168 Aug 29 10:51:03.192385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1886/3784] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:02 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:03.353611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7bfb64ba-d185-43b9-950f-8131e82a185c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.297838 Aug 29 10:51:03.354310 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1899/3785] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:51:03 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372/os-interface => generated 1830 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:51:03.561012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:03.561558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:03.571969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.573954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.574689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.576149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:03.578102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:03.588477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:03.906847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:03.910021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:03.920002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7f84992-b491-463e-91b3-edea6558285c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.362171 Aug 29 10:51:03.923281 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1887/3786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:03 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:03.976636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:03.997166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:03.998316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:04.002104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:04.020437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.023721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.024193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.025671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.025858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.026611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.027034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.027191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.027913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.028872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.029550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.030215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.508229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:04.513130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:04.545018 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b620e01b-fb4e-4f13-9a59-882061b79c99 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.572592 Aug 29 10:51:04.559549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29381059-3a95-40f8-8c34-d4519e2f208f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1520 microversion: 2.1 time: 0.570195 Aug 29 10:51:04.564865 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1900/3787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:03 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:04.566799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1888/3788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:03 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:04.589494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:04.592977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:04.627479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.628297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.631527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.632586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.633294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.634346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.684688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:04.925885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:04.945033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:04.946094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:04.950274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f9edb5e-1641-4705-9b01-a6edc0fda674 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.383986 Aug 29 10:51:04.955984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.956843 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1901/3789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:04 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:04.957579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.958326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:04.959391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:04.960084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:04.961137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.099755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6b9b48-aa63-4815-a256-635a41937148", "name": "network-vif-plugged", "status": "completed", "tag": "7e0e2002-c768-4018-afdd-a62a955e41bf"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:05.116677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.119481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.120116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.166118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] Creating event network-vif-plugged:7e0e2002-c768-4018-afdd-a62a955e41bf for instance ef6b9b48-aa63-4815-a256-635a41937148 on n-h1-854121-10 Aug 29 10:51:05.175370 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e9ed61f1-0119-421a-a8b2-f27169fec16d req-d8970614-2632-4a11-b0e7-71566b9f7bb4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079189 Aug 29 10:51:05.175995 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1902/3790] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:05.296063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:05.311832 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-719aa3d7-318b-46fc-b4b1-8a529d82f8a9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.371238 Aug 29 10:51:05.313041 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1889/3791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:04 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:05.515719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "tag": "c33d5932-5453-449b-9e0f-2a24c345b9bc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:05.537188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.538946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.539781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.571043 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] Creating event network-changed:c33d5932-5453-449b-9e0f-2a24c345b9bc for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:51:05.578378 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9bbc2b7d-2c58-4a2b-89d5-458491e2e626 req-89aff997-cf24-420e-b30e-32681fa3d38b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068580 Aug 29 10:51:05.579594 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1903/3792] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:05.600416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:05.601043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:05.609493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.611399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.611866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.612582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.618629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.620689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.626295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:05.627191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:05.655385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.661817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.662657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:05.663966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:05.666250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:05.666912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.208660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:06.234594 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dbc3eadd-af16-4942-8d2a-11fd7f0f9abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.634236 Aug 29 10:51:06.235369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1890/3793] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:05 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:06.268122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:06.270385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:06.271744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:06.278893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:06.279802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:06.280430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.281315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:06.281977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:06.282730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.288434 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66c5ace3-09cb-4135-8ca4-f92f570908bb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1520 microversion: 2.1 time: 0.673419 Aug 29 10:51:06.302755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1904/3794] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:05 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1520 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:06.309334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17226f1-2fa6-484b-af0f-025d70c612cb", "tag": "242b41dc-866f-4863-a96b-9a19584dfe7b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:06.349620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:06.349899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:06.350337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.395738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] Creating event network-changed:242b41dc-866f-4863-a96b-9a19584dfe7b for instance e17226f1-2fa6-484b-af0f-025d70c612cb on n-h1-854121-10 Aug 29 10:51:06.411861 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1c738a4b-c906-42f1-b7c9-bdb2e90a1b0a req-0f5829af-2e04-4852-9d84-1cf898e94d92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117433 Aug 29 10:51:06.421208 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1905/3795] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:06.431690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:06.432401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:06.453932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:06.454445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:06.455051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.458204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:06.462387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:06.463261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:06.946476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:06.957761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e23f74f-e09b-4542-ae37-4fae3bd30421 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.702508 Aug 29 10:51:06.959144 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1891/3796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:06 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:07.258033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:07.259219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:07.283799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.284316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.285234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.286024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.286878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.290661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.572811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:07.588605 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c548a81a-66db-422c-ac64-afcbb25d2373 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 1.165867 Aug 29 10:51:07.594333 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1906/3797] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:06 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:07.599454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:07.604945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:07.616811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:07.618386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.619137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.620830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.621726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.625072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.625633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.882164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:07.901476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:07.911251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9963e583-7423-4929-a65d-a64728488045 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1510 microversion: 2.1 time: 0.658447 Aug 29 10:51:07.917807 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1892/3798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:07 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1510 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:07.946817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:07.958091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d923ff6-840e-49c8-b732-8d996abf42fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1505 microversion: 2.1 time: 0.362142 Aug 29 10:51:07.960606 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1907/3799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:07 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:07.979035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:07.979730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:07.987480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.988262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.988902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.989886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:07.990544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:07.994336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:07.998467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:08.001920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:08.011715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.013994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.014870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.015973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.016619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.017574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.302640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:08.311334 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3580f9a7-0776-4427-b953-3b416af820ce tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 200 len: 1505 microversion: 2.1 time: 0.326173 Aug 29 10:51:08.312231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1908/3800] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:07 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:08.317971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:08.328211 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6de280ea-dc56-44a1-9c12-3f122344d448 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.353131 Aug 29 10:51:08.332218 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1893/3801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:07 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:08.339936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:08.341289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:08.349927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.350704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.351337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.352070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.352686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.353690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.390184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:08.475882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1d7f018-6cbc-4d0c-873d-a7661f2f137e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 204 len: 0 microversion: 2.1 time: 0.147329 Aug 29 10:51:08.476674 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1909/3802] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:08 2022] DELETE /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:51:08.583161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-639817326", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bb98c5d8-8227-42c4-8629-d940b6e4d115"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:08.612370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:08.614249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:08.622473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.623110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.623803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.624675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:08.625239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:08.625859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:08.646024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] validate_networks() for [('bb98c5d8-8227-42c4-8629-d940b6e4d115', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:51:08.737665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:09.047396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:09.075139 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31605903-0539-4bb8-b76e-82ca29d02050 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.466937 Aug 29 10:51:09.088750 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1910/3803] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:08 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:09.088750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:09.088750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:09.098151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.098653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.099098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.099816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.100270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.100704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.332734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:09.341692 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ccab5e2f-b506-41a8-b994-bf4db4359d30 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1487 microversion: 2.1 time: 0.263817 Aug 29 10:51:09.342359 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1911/3804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:09 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1487 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:09.349717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:09.350276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:09.350625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:09.351071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:09.351390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:09.352266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:09.352672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:09.361427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.361679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.361944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.362386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.362755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.363106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.363251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.363580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.363930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.364061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.364718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.364859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.381257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:09.388171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for user 4874da72fc8d49748fe5ade5c4942f04 and project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:09.409729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:51:09.412332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:51:09.442746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:09.472722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4fd48dda-c22b-4bfc-b6d6-753113045022 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893559 Aug 29 10:51:09.474318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1894/3805] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:51:09.482545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:09.484699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:09.500549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.501676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.502295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.503123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.504302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.504875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.538846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:09.539804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:09.549505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c0f3eae-5d1d-4a74-92b3-0b0bb256b370 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.203790 Aug 29 10:51:09.550852 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1912/3806] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:09 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:09.567485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fe810d2a-83a5-4117-93f4-55ea4871a606 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:09.568129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fe810d2a-83a5-4117-93f4-55ea4871a606 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:09.720380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fe810d2a-83a5-4117-93f4-55ea4871a606 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:09.732556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-09affbc5-a812-4785-b339-6b1f6e3a6969 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 204 len: 0 microversion: 2.1 time: 0.256746 Aug 29 10:51:09.733475 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1895/3807] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:09 2022] DELETE /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:51:09.734096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fe810d2a-83a5-4117-93f4-55ea4871a606 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1217 microversion: 2.1 time: 0.178879 Aug 29 10:51:09.735279 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1913/3808] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:09 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:09.742872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:09.743700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:09.751563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.752325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.752864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.754230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:09.754983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:09.755552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:09.927395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:09.942636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4dc5691-f6f1-464d-953d-989fa417ccc6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1493 microversion: 2.1 time: 0.204331 Aug 29 10:51:09.943257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1896/3809] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:09 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1493 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:10.097053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:10.097782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:10.106022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.106511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.106951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.107658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.108112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.108733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.338693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:10.350738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee37cfae-dae0-4abd-91fd-f307a4d3a321 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.257554 Aug 29 10:51:10.351335 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1914/3810] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:10 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:10.660190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:10.661437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:10.672654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.673439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.675107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.685447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.686213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.686823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.756523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:10.757532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:10.772010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.772626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.773072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.773806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:10.774477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:10.775374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:10.932635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:10.955926 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32d65a4c-3a63-4272-ad01-79116b4e2abd tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1221 microversion: 2.1 time: 0.195624 Aug 29 10:51:10.962264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1915/3811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:10 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:10.996152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:10.997063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:11.014769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:11.017820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:11.018389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:11.019505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:11.020173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:11.021681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:11.032105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:11.045103 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9de167e-f1ac-4e49-a65f-bb7329f6fd7a tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.388187 Aug 29 10:51:11.061734 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1897/3812] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:10 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:11.362297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:11.372771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:11.375274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:11.383284 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37c5f2fc-ab86-459c-b1ae-a8418c34dd42 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1493 microversion: 2.1 time: 0.419129 Aug 29 10:51:11.394424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1916/3813] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:10 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1493 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:11.402052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:11.404517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:11.405182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:11.406419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:11.407034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:11.407612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:11.461324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-808955458", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "0c721509-612e-435b-a026-ebc327f9d698"}, {"uuid": "a18a1900-abd8-4623-8247-c0ca488077fe"}, {"uuid": "0c721509-612e-435b-a026-ebc327f9d698"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:11.561939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] validate_networks() for [('0c721509-612e-435b-a026-ebc327f9d698', None, None, None, None, None), ('a18a1900-abd8-4623-8247-c0ca488077fe', None, None, None, None, None), ('0c721509-612e-435b-a026-ebc327f9d698', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:51:11.726808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:11.741532 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7963f474-b998-4319-803d-63007d341020 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1507 microversion: 2.1 time: 0.370377 Aug 29 10:51:11.744632 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1898/3814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:11 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:11.983513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:11.984389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:11.999830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:12.002594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:12.004752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:12.007106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:12.007998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:12.011816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:12.197252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:12.226720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed884c0d-ee24-4070-82c9-941c148f3f60 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1221 microversion: 2.1 time: 0.244633 Aug 29 10:51:12.227596 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1899/3815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:11 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:12.261461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:12.263478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:12.305405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:12.306807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:12.310036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:12.311509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:12.312162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:12.312850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:13.358062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:13.372075 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-367bd7ed-039d-44c2-829c-d94e531fb937 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 1.141160 Aug 29 10:51:13.385081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1900/3816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:12 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:13.401322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:13.402241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:13.422785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:13.423590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:13.424245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:13.425190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:13.427301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:13.427979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:14.604491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:14.605056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:14.606346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:14.607048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:14.607886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:14.612538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:14.625052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d96b396c-4b79-4246-825c-a6f27139f845 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1493 microversion: 2.1 time: 1.238298 Aug 29 10:51:14.626530 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1901/3817] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:13 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1493 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:14.633664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:14.638597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:14.646098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:14.646451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:14.647454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:14.649853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:14.652340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:14.656179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:14.663267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:14.669490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:14.670582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:14.671524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:14.672183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:14.674405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:14.749931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Getting quotas for project 1518e676de64458995ffaed9b3331908. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:14.786498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Getting quotas for user 4c8f757924d14388b749d5ec9e9ace58 and project 1518e676de64458995ffaed9b3331908. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:14.820917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:51:14.833003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:51:15.020233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3422042b-c506-485c-a15a-0e9a2398b176 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.562589 Aug 29 10:51:15.022021 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1917/3818] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:51:15.034473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:15.042773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:15.044030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:15.062507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.063330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.064005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.064940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.065625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e69a984a-0639-48eb-a271-19f92b97de5b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1487 microversion: 2.1 time: 0.435705 Aug 29 10:51:15.066350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.067015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.070066 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1902/3819] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:14 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1487 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:15.087551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6b9b48-aa63-4815-a256-635a41937148", "name": "network-vif-deleted", "tag": "7e0e2002-c768-4018-afdd-a62a955e41bf"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:15.140503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.147056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.149642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.197375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] Creating event network-vif-deleted:7e0e2002-c768-4018-afdd-a62a955e41bf for instance ef6b9b48-aa63-4815-a256-635a41937148 on n-h1-854121-10 Aug 29 10:51:15.225194 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-85626593-b295-4e83-a65d-df0dbe772a62 req-059a08f7-f305-4c7a-917a-a7b3ef61fcd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150540 Aug 29 10:51:15.231867 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1903/3820] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:15.258286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:15.261188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:15.283032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.284927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.285352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.286654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.287944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.288834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.302244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:15.368142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:15.383648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-faf6f236-9757-46ad-83e7-5cd82b794c70 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1275 microversion: 2.1 time: 0.359659 Aug 29 10:51:15.388550 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1918/3821] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:15 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:15.398543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2415d9cd-73d5-43e5-a5f9-a307e9364eb7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:15.407304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2415d9cd-73d5-43e5-a5f9-a307e9364eb7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:15.700421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2415d9cd-73d5-43e5-a5f9-a307e9364eb7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:15.717594 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2415d9cd-73d5-43e5-a5f9-a307e9364eb7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1212 microversion: 2.1 time: 0.325675 Aug 29 10:51:15.727500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1919/3822] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:15 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1212 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:15.752839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-635306322", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:15.815258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:15.833500 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9138c257-a159-4de1-afac-927ae65b91d8 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.595716 Aug 29 10:51:15.835651 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1904/3823] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:15 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:15.854937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:15.856793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:15.889237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.889858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.892233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.893025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:15.894455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:15.897459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:15.943818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] validate_networks() for [('36449cf8-e9e0-41e6-b0ca-629e7e377241', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:51:16.819307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:16.830998 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65b83973-72b5-4771-8a80-891e83686117 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 200 len: 1451 microversion: 2.1 time: 0.993246 Aug 29 10:51:16.839995 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1905/3824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:15 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 1451 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:16.856846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163e11-9eb7-4f06-bdfd-cd3719bc3007", "name": "network-vif-deleted", "tag": "cbcf22cc-f226-4f61-82d3-5d1c1e426219"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:16.897032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:16.903466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:16.905992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:16.931482 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] Creating event network-vif-deleted:cbcf22cc-f226-4f61-82d3-5d1c1e426219 for instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 on n-h1-854121-10 Aug 29 10:51:16.959725 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-134d6ce1-52d0-49a6-95fe-c3e56ec962f2 req-30df903e-b3e0-4f0a-889f-fbf1bc1eb4a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118045 Aug 29 10:51:16.962417 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1906/3825] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:16.995317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17226f1-2fa6-484b-af0f-025d70c612cb", "name": "network-vif-plugged", "status": "completed", "tag": "242b41dc-866f-4863-a96b-9a19584dfe7b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:17.010361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.011419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.011866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.044173 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] Creating event network-vif-plugged:242b41dc-866f-4863-a96b-9a19584dfe7b for instance e17226f1-2fa6-484b-af0f-025d70c612cb on n-h1-854121-10 Aug 29 10:51:17.059482 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-18ab9b66-8c96-4d6d-931b-e16c49a19628 req-809b1119-839e-45e0-9f7d-71043ea04d85 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095398 Aug 29 10:51:17.061068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1907/3826] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:17.083042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:17.088068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:17.112524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.113554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.114470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.115397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.116161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.117852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.747437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:17.761292 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23307dd7-163d-46a6-ad46-762e553a0f76 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.698622 Aug 29 10:51:17.765839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1908/3827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:17 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:17.775486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:17.776285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:17.794251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.795067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.795683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.797593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.799106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.799860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.951142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:17.961994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6eff689-9a47-487c-b235-2718c2c6018c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1282 microversion: 2.1 time: 0.194656 Aug 29 10:51:17.962905 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1909/3828] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:17 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:17.974934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:17.975939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:17.989046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:17.990062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:17.991310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:17.993440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.000884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.001351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.204342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:18.204930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:18.205266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:18.205686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:18.206130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:18.217385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.224562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.225133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.226019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.226496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.226917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.270686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Getting quotas for project 5b1a273d9e8143ff9f1d7c79e1d81f92. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:18.279117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Getting quotas for user da810a1262894dd2add4e5ccddd7957a and project 5b1a273d9e8143ff9f1d7c79e1d81f92. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:18.294394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:51:18.298009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:51:18.323830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:18.336230 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a98e8aa3-7557-44b1-b02c-924ab398a1ca tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1325 microversion: 2.1 time: 0.371160 Aug 29 10:51:18.336833 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1910/3829] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:17 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1325 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:18.344938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:18.354354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:18.368077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.368668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.369303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.370502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.371394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.372516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.385650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-030b6b4b-7aac-4434-b8b9-4d1f171ac058 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.650413 Aug 29 10:51:18.390779 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1920/3830] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:51:18.405783 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 HTTP/1.1 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '45163e11-9eb7-4f06-bdfd-cd3719bc3007'} Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:18.409511 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:18.415525 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:18.418955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:18.419684 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d3667a8-788a-42ca-abd1-d853a7b3effb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 404 len: 111 microversion: 2.1 time: 0.079384 Aug 29 10:51:18.420725 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1911/3831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:18 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:18.427273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-321b460d-8c44-43dd-a3a7-cb999c105dce tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:18.428155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-321b460d-8c44-43dd-a3a7-cb999c105dce tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:18.622405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-321b460d-8c44-43dd-a3a7-cb999c105dce tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:18.633301 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-321b460d-8c44-43dd-a3a7-cb999c105dce tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1213 microversion: 2.1 time: 0.210671 Aug 29 10:51:18.646681 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1912/3832] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:18 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:18.654738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-617170075", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "82bb97ef-6916-4c25-a530-6fffe7e4147c"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:18.738010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] validate_networks() for [('82bb97ef-6916-4c25-a530-6fffe7e4147c', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:51:18.840949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:18.841619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:18.851025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.855415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.857941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.873090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:18.877456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:18.878707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:18.964577 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9672ca7-e375-4d71-94f6-665f44158127 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/ips" status: 200 len: 149 microversion: 2.1 time: 0.572328 Aug 29 10:51:18.968721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1921/3833] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:51:18 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/ips => generated 149 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:18.977655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:18.978695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:19.002536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.003302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.003982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:19.005104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.005880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.006556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:19.028302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:19.372008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:19.549173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:19.567853 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-26f768ae-e4a9-4ee9-94e9-334b1abbf60c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.595066 Aug 29 10:51:19.569854 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1922/3834] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:18 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:19.587585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:19.591003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:19.604945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.605952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.606843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:19.607888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.609030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.610044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:19.818545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:19.833368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ddbe77e-09ab-4e58-9d35-1d27f2dcc4e2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1270 microversion: 2.1 time: 0.260954 Aug 29 10:51:19.847568 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1923/3835] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:19 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:19.852764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:19.854237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:19.870139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.870712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.871267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:19.876072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:19.876683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:19.877166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.054858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:20.055722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:20.056380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:20.058234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:20.058933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:20.071383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.072209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.072839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.074057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.074732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.075509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.104033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:20.118859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Getting quotas for user e040bfd57ec449f0a6985eeefab30bca and project ade90ea17e1c4e649a48ea6f851598c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:20.149240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:51:20.152209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:51:20.252307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28148ec8-5104-4729-a4df-96b468b5e060 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604223 Aug 29 10:51:20.257419 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1913/3836] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:51:20.270929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:20.272611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:20.285813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.286315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.286752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.287458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.287913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.288341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.424695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:20.433610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20484794-3ac4-4c49-8107-537a8c665897 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1522 microversion: 2.1 time: 0.594309 Aug 29 10:51:20.437235 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1924/3837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:19 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:20.457338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8811b68-5d2d-45e2-86bb-edeaa4792c43", "tag": "c210db94-ca4e-43dc-a6fa-67cc8ca1c37b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:20.473011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.473662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.474669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.494665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] Creating event network-changed:c210db94-ca4e-43dc-a6fa-67cc8ca1c37b for instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 on n-h1-854121-10 Aug 29 10:51:20.514121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-39b7903a-f08f-499e-8023-f1baaf55d0a2 req-7d9cd447-d482-4799-935e-25f105a75ba8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065541 Aug 29 10:51:20.515500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1925/3838] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:20.523869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:20.525800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2cb2c2b8-a72d-4309-b8f5-fae81a15518c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:20.527470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2cb2c2b8-a72d-4309-b8f5-fae81a15518c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:20.545041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c29b8cb-ef40-4c5e-93fe-33c2a121f412 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1265 microversion: 2.1 time: 0.286223 Aug 29 10:51:20.552563 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1914/3839] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:20 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:20.571753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:20.572754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:20.604239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.608846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.613303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.615184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.618533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.622018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.711248 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] HTTP exception thrown: Instance is not a member of specified network Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Request method failure captured: Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb/ips/invalid HTTP/1.1 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJoPB3eo2TrH5EIgfkPwG8oWlxmgsEQWd2rJZp-uSM_1wIpEQoYZx3g6J7SmNDIh4UwsckXMDIchY2rd4iFcvge3vjnJayZhuKuXxOkp4t73XxmY6y3nOLtjllXYAjjuY8OD-tzu8wC7JaGqBls1uGDH7uz0UrjnW9Y_q3J6_uo6oxQ Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 433d1ee7aade46048f6d8d3436c72cd7 Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance is not a member of specified network Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': 'e17226f1-2fa6-484b-af0f-025d70c612cb', 'id': 'invalid'} Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 29 10:51:20.716412 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:20.721190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:20.721357 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e55318c-5df7-442f-b944-2928a924af61 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.166909 Aug 29 10:51:20.722515 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1915/3840] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 10:51:20 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb/ips/invalid => generated 91 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:51:20.733945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:20.737850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:20.759038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.759887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.760562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.761456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:20.763125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:20.763751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:20.969456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2cb2c2b8-a72d-4309-b8f5-fae81a15518c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:20.979486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2cb2c2b8-a72d-4309-b8f5-fae81a15518c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1214 microversion: 2.1 time: 0.461961 Aug 29 10:51:20.984360 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1926/3841] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:20 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1214 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:20.995267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:20.998355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Failed to fetch instance by id 999 {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 10:51:21.001892 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] HTTP exception thrown: Instance 999 could not be found. Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Request method failure captured: Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJoPB3eo2TrH5EIgfkPwG8oWlxmgsEQWd2rJZp-uSM_1wIpEQoYZx3g6J7SmNDIh4UwsckXMDIchY2rd4iFcvge3vjnJayZhuKuXxOkp4t73XxmY6y3nOLtjllXYAjjuY8OD-tzu8wC7JaGqBls1uGDH7uz0UrjnW9Y_q3J6_uo6oxQ Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 433d1ee7aade46048f6d8d3436c72cd7 Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 999 could not be found. Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '999'} Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 10:51:21.007013 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:21.018677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:21.019843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fb1e33d-3024-4d92-81de-ac97808d2b57 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.034245 Aug 29 10:51:21.023674 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1927/3842] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:51:20 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 10:51:21.033638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:21.034552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:21.049627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.051079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.052883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.055994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.056726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.058080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.817804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:21.836412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed0de8c3-5bab-4c15-b92f-65a862d7656e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 1.112377 Aug 29 10:51:21.837299 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1916/3843] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:20 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:21.850146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:21.851748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:21.853021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:21.866659 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8ef2dc1-b305-4500-977b-a0dd53911625 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1312 microversion: 2.1 time: 0.836724 Aug 29 10:51:21.867876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1928/3844] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:21 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1312 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:21.870992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.873730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.874939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.875659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:21.876401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.876631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:21.877579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.878148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.887482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.888273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.888726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.889442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:21.889961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:21.890719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:21.930205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:21.997812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:22.007775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09609d45-1ef5-457d-91a8-3c1b5ad44fdf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1271 microversion: 2.1 time: 0.138449 Aug 29 10:51:22.008660 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1929/3845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:21 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:22.014241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4417de5e-abc1-4871-9f20-e1219e1f03b4"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:22.018869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:22.026688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.027514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.028190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.028967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.029788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.030313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.054757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2eae045-9305-490a-ae93-aff0120257bb tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 204 len: 0 microversion: 2.1 time: 0.211817 Aug 29 10:51:22.058602 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1917/3846] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:21 2022] DELETE /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:51:22.064748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:22.065535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:22.071969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.072744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.073297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.074270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.074752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.075279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.178114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:22.188966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9eff7ae6-7e9e-4262-8e84-9ce804171f18 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1266 microversion: 2.1 time: 0.128382 Aug 29 10:51:22.189948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1918/3847] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:22 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:22.195279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:22.196168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:22.202873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.203602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.204053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.204800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.205501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.205971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.576929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:22.590634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-de01bfcf-f955-4e8d-a8e2-7ceb1728a42f tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1528 microversion: 2.1 time: 0.398800 Aug 29 10:51:22.591498 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1919/3848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:22 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:22.867900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:22.868605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:22.875755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.876245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.876681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:22.877375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:22.877861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:22.878299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.110321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:23.118307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9434cbfd-061a-4746-8608-de5bdffae6ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.254436 Aug 29 10:51:23.118809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1920/3849] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:22 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:23.126624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:23.127547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:23.136151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.136640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.137689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.138485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.138965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.139374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.400007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:23.413124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb6d682e-9659-4143-b423-333ce836625a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1333 microversion: 2.1 time: 0.293237 Aug 29 10:51:23.415423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1921/3850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:23 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1333 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:23.421687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:23.422740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:23.431785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.432277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.432755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.433460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.435161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.435335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.632846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:23.643626 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-530333dc-2afe-4f87-928c-f39909580037 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.226754 Aug 29 10:51:23.644457 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1922/3851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:23 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:23.650426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:23.651346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:23.663875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.665627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.667379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.669058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.670270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.670869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.678543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:23.786059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:23.795754 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10530727-dc9f-472e-984d-f0891c6a4a00 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1274 microversion: 2.1 time: 0.150080 Aug 29 10:51:23.796656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1923/3852] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:23 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:23.803478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:23.804091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:23.810350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.811063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.811500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:23.812198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:23.812832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:23.813254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.087698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:24.101981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4168f14f-1aee-4ef0-89ab-33a1884f19b1 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1528 microversion: 2.1 time: 0.303915 Aug 29 10:51:24.102713 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1924/3853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:23 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1528 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:24.140027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:24.140800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:24.147483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.147974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.148479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.149120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.149576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.150109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.628021 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f74cd72c-4025-4ce1-a3bc-d49e5952c412 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.616098 Aug 29 10:51:24.631015 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1930/3854] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:51:22 2022] POST /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 194 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:24.639794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:24.641490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:24.650801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.651577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.652416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.654264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.654910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.655786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.671447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:24.694668 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97b4f249-7f40-48d9-8e57-9315c9797518 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.547862 Aug 29 10:51:24.706187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1925/3855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:24 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:24.706187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b258c9a-cb6e-47e5-b803-58bdc8885feb", "tag": "99529685-fe55-44b0-82dd-215c7c27c4fb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:24.742060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.745995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.748393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.778851 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] Creating event network-changed:99529685-fe55-44b0-82dd-215c7c27c4fb for instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb on n-h1-854121-10 Aug 29 10:51:24.784233 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-79fe0451-efb5-44bc-8eae-cb378a9802ee req-c58fb696-b090-4261-a16d-bdad17269950 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087692 Aug 29 10:51:24.785527 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1926/3856] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:24.791903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:24.793197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:24.802362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.803272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.803964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:24.804954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:24.805675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:24.806431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.543990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:25.556696 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1d8a0c1-0a9b-456d-aff5-fbbfe536d1bc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.769920 Aug 29 10:51:25.557935 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1927/3857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:24 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:25.562700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:25.567779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:25.569446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:25.578294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.578741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3871381f-beec-44a9-9a35-ac8536654eaf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.944432 Aug 29 10:51:25.579022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.579565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.580407 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1931/3858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:24 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:25.587502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:25.588402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:25.591789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.594270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.595361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.599367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.601404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.601404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.604049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.604049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.610168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.813859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:25.843795 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8b17747-b57e-4970-b46b-529949b38e43 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1272 microversion: 2.1 time: 0.284116 Aug 29 10:51:25.846237 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1928/3859] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:25 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:25.862678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:25.863364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:25.873619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.874219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.874742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:25.876306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:25.880380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:25.881272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:26.142551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:26.166014 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff1dc7db-1761-4fca-9a80-f62746d50735 tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1528 microversion: 2.1 time: 0.584030 Aug 29 10:51:26.169435 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1932/3860] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:25 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1528 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:26.585380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:26.586221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:26.598192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:26.607369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:26.609418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:26.610721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:26.610721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:26.611147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:26.784045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:26.802270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0e34fb3-394d-40f5-acd3-37d0459c898b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.936599 Aug 29 10:51:26.813802 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1929/3861] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:25 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:26.819365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:26.820548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:26.826186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:26.847417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:26.848046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:26.848537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:26.849296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:26.853964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:26.854480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.395207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:27.407537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d6c7b7b-5a73-4e88-9436-db2d8f6571e9 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.830529 Aug 29 10:51:27.411804 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1933/3862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:26 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:27.440376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:27.447299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:27.448391 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7053958-3647-45e9-81e1-a5aadecdf0dd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.632980 Aug 29 10:51:27.448998 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1930/3863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:26 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:27.460906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17226f1-2fa6-484b-af0f-025d70c612cb", "name": "network-vif-deleted", "tag": "242b41dc-866f-4863-a96b-9a19584dfe7b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:27.462092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:27.485518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:27.486045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:27.489024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:27.489837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:27.493442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.497838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.502990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:27.504701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:27.505317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.516630 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] Creating event network-vif-deleted:242b41dc-866f-4863-a96b-9a19584dfe7b for instance e17226f1-2fa6-484b-af0f-025d70c612cb on n-h1-854121-10 Aug 29 10:51:27.526699 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2f07a9a3-1f2c-4348-81b9-39cdff449361 req-37014ae7-3e09-4871-8850-aea015bce9b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075227 Aug 29 10:51:27.528421 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1931/3864] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:27.535946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:27.539063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:27.548546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:27.549245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:27.549810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.550600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:27.551260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:27.552858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:27.924752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:27.967727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deb9d862-d1d7-4077-a4e6-105249d4af4b tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1486 microversion: 2.1 time: 0.433589 Aug 29 10:51:27.992408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1932/3865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:27 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1486 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:28.015411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:28.020085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:28.033856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.037200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.037846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.038701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.040440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.042726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.113967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:28.127260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06442b85-4d8a-4238-84bb-593eeb870465 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.688534 Aug 29 10:51:28.128675 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1934/3866] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:27 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:28.410986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:28.421352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b4eb48d-0db5-43aa-9ceb-704c7873cd39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.425726 Aug 29 10:51:28.423047 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1933/3867] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:27 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:28.448564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:28.450769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:28.457010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:28.459287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.459988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.460776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.461687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.462402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.463010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.472164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:28.473102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:28.492075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.492869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.493499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.495447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:28.496784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:28.497489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:28.894864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:28.912347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca4c37b7-f425-4af8-ae62-0375619cf510 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.444109 Aug 29 10:51:28.913120 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1934/3868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:28 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:28.994227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:28.994853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:29.014568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.014985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.015494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.016217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.016681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.017177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.081437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:29.098591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4f34f7c-e49a-4d38-b444-f7a1ac92ce91 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.650866 Aug 29 10:51:29.106360 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1935/3869] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:28 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:29.134627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.135125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.135805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.136168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lazy-loading 'fault' on Instance uuid e17226f1-2fa6-484b-af0f-025d70c612cb {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:29.154672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:29.155531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:29.170602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.171901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.172383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.175408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.175959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.176405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.294248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433d1ee7aade46048f6d8d3436c72cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed652d38c841b3a2f9b5858ff1d42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:29.314393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a385575-4c07-4215-90c8-ad8a90b2e45c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 200 len: 1315 microversion: 2.1 time: 0.315045 Aug 29 10:51:29.315065 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1935/3870] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:28 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:29.429423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8811b68-5d2d-45e2-86bb-edeaa4792c43", "name": "network-vif-plugged", "status": "completed", "tag": "c210db94-ca4e-43dc-a6fa-67cc8ca1c37b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:29.454972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.459804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.461907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.482911 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] Creating event network-vif-plugged:c210db94-ca4e-43dc-a6fa-67cc8ca1c37b for instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 on n-h1-854121-10 Aug 29 10:51:29.489262 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dc112040-ffb5-46b8-a23a-15bf68fd6fc2 req-1c67b9c3-cf21-489f-81d2-f12edc820766 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078555 Aug 29 10:51:29.491154 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1936/3871] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:51:29.502384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:29.503468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:29.517948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.519284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.520052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.521606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.522373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.523353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.578970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:29.591989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-effb2a8c-3358-4e4c-8cdb-0e9cd04d2abb tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.445083 Aug 29 10:51:29.593215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1936/3872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:29 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:29.618265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "tag": "66816c5a-41a1-475b-9c8f-1a8fcb69ee7c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:29.651764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.654678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.655844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.705897 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] Creating event network-changed:66816c5a-41a1-475b-9c8f-1a8fcb69ee7c for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:29.726251 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-36a3f349-a495-409b-aac2-37b76d1e27b1 req-b5e8469d-2a5e-4142-bd7b-3139f8a260af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114640 Aug 29 10:51:29.729953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1937/3873] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:29.784972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d4db1b-5505-43de-9206-0748457c60fd", "tag": "f93dfec1-15a3-4989-9d95-5487f827879b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:29.796703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:29.806355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:29.807206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:29.807929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:29.824006 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] Creating event network-changed:f93dfec1-15a3-4989-9d95-5487f827879b for instance f5d4db1b-5505-43de-9206-0748457c60fd on n-h1-854121-10 Aug 29 10:51:29.832685 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-30a7dc0c-fb82-4eb2-a65b-77ef5ce2d4b2 req-b4cac9c0-9b03-41fd-a2b0-6320c38fe70b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056248 Aug 29 10:51:29.833678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1938/3874] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:51:29.946251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:29.964010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:29.966614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:29.993868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0c43fc8-3589-4c6c-b345-0695406e2200 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.500917 Aug 29 10:51:29.997682 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1937/3875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:29 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:30.005111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.006168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.006787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.007738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.008380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.011495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.119170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:30.125850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:30.126768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:30.133648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.134736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.135431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.136412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.137656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.138371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.139970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:30.544173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:30.553037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:30.561139 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-172202de-6647-492a-aad3-d240c91c86f0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.620012 Aug 29 10:51:30.562433 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7f9872a-2c19-425e-a983-82685cda549d tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.443660 Aug 29 10:51:30.563932 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1939/3876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:29 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:30.571498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:30.572540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] [instance: e17226f1-2fa6-484b-af0f-025d70c612cb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:30.574331 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1938/3877] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:30 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:30.586183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.587957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.588401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.589125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.589585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.590976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.610208 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] HTTP exception thrown: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Request method failure captured: Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb HTTP/1.1 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJoPB3eo2TrH5EIgfkPwG8oWlxmgsEQWd2rJZp-uSM_1wIpEQoYZx3g6J7SmNDIh4UwsckXMDIchY2rd4iFcvge3vjnJayZhuKuXxOkp4t73XxmY6y3nOLtjllXYAjjuY8OD-tzu8wC7JaGqBls1uGDH7uz0UrjnW9Y_q3J6_uo6oxQ Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3bed652d38c841b3a2f9b5858ff1d42b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3bed652d38c841b3a2f9b5858ff1d42b Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-261702477 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 433d1ee7aade46048f6d8d3436c72cd7 Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-261702477-project Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e17226f1-2fa6-484b-af0f-025d70c612cb'} Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:30.612283 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. Aug 29 10:51:30.617714 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:30.618559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:30.618559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:30.620447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] Returning 404 to user: Instance e17226f1-2fa6-484b-af0f-025d70c612cb could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:30.621990 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9425962-9471-4b29-9042-5aaf7bdcf55c tempest-ServerAddressesNegativeTestJSON-261702477 tempest-ServerAddressesNegativeTestJSON-261702477-project] 10.222.0.47 "GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb" status: 404 len: 111 microversion: 2.1 time: 0.056504 Aug 29 10:51:30.623059 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1940/3878] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:30 2022] GET /compute/v2.1/servers/e17226f1-2fa6-484b-af0f-025d70c612cb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:30.643854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.645565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.646244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:30.649173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:30.650283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:30.653411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.021687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:31.024310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:31.034771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:31.037925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.040083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.041940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.047831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.048817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.050285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.141056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:31.159540 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15d98d8b-2870-4af9-a698-5e3e5297c757 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.550110 Aug 29 10:51:31.160326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1939/3879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:30 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:31.344275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:31.355222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7946d19d-c9b0-4353-8a47-2a098473c3f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1317 microversion: 2.1 time: 0.337383 Aug 29 10:51:31.359119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1941/3880] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:31 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:31.512821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b258c9a-cb6e-47e5-b803-58bdc8885feb", "name": "network-vif-plugged", "status": "completed", "tag": "99529685-fe55-44b0-82dd-215c7c27c4fb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:31.533385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.534348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.536110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.565250 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] Creating event network-vif-plugged:99529685-fe55-44b0-82dd-215c7c27c4fb for instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb on n-h1-854121-10 Aug 29 10:51:31.578555 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4e326ba5-490d-481a-b668-9c2539b80cc7 req-3916c0fc-d149-4146-ad69-7d3b452778f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070932 Aug 29 10:51:31.580047 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1940/3881] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:31.586295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:31.587506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:31.601576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:31.602468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:31.603250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.603977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.604648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.605908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.606722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.607437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.616466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.617675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.618800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:31.620697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:31.623492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:31.624194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:31.624940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.002654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:32.013030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e9aa5d39-7531-45bb-95cb-20acb3db697c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.432178 Aug 29 10:51:32.014194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:32.015208 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1942/3882] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:31 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:32.021229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "tag": "267f4d38-bc2d-4c2c-98c4-78609ab4f749"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:32.023659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43a151eb-bf75-4e5b-bd3e-792c99f17ecb tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.431070 Aug 29 10:51:32.024568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1941/3883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:31 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:32.033331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.034092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.034739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.048854 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] Creating event network-changed:267f4d38-bc2d-4c2c-98c4-78609ab4f749 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:32.054114 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-50ea2a01-c2af-412a-99ef-75c70449d30e req-8726b55b-cfa4-4b6e-b23a-adfdceacb038 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037263 Aug 29 10:51:32.054879 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1943/3884] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:32.181086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:32.182598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:32.190615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.191216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.191888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.192730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.193429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.194192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.197632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:32.388264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:32.390075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:32.403749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.404657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.405329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.406554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.407444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.408168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.527242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:32.537810 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32206ebe-c249-4b49-8e03-e64371a37947 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.360102 Aug 29 10:51:32.546562 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1942/3885] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:32 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:32.708901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:32.720889 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a01fab22-f8a8-416f-8baf-c5bcea1bb2f5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1507 microversion: 2.1 time: 0.340562 Aug 29 10:51:32.721858 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1944/3886] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:32 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:32.757641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:32.760686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:32.776015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.776915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.778646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:32.779897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:32.780662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:32.781314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.025476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:33.036453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:33.037075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.037342 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3e14737-d6f5-45c0-a9da-e6a5814beb77 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1507 microversion: 2.1 time: 0.294854 Aug 29 10:51:33.037692 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1943/3887] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:32 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:33.049068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.050712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.051356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.057250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:33.058131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.059235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.059868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.060315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.073219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.075613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.076835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.077858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.078654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.079322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.404178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:33.412201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-405784c0-8921-49bf-bfbe-e0cbb4011656 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1313 microversion: 2.1 time: 0.366638 Aug 29 10:51:33.426326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1944/3888] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:33 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:33.431855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:33.435234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.441875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.442585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.443212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.444130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.444765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.446023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.458733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:33.476020 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08dcbb62-4047-49d9-ace6-9de0a8870923 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.443445 Aug 29 10:51:33.480014 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1945/3889] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:33 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:33.551818 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d73e5cd5-2d14-4a0d-aa84-4beb2b170f4e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "PUT /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1079 microversion: 2.1 time: 0.124022 Aug 29 10:51:33.552478 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1945/3890] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:51:33 2022] PUT /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1079 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:33.561319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:33.562058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.576041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:33.578368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.579318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.581793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.582354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.583351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.584560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.585251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.596865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.596865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.597943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.603078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.603803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.604438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.820946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:33.832456 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e3dbd1d-65e4-4419-8350-e51a7c245aa8 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.275979 Aug 29 10:51:33.833323 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1946/3891] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:33 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:33.874769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:33.888441 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e1640f3-94d3-415f-a39c-97b111a04fa3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1505 microversion: 2.1 time: 0.318774 Aug 29 10:51:33.889963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1946/3892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:33 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:33.911774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:33.912669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:33.919840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.920741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.921424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:33.922438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:33.923155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:33.923794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.190911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:34.201679 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-05181c04-2d7a-41ce-a6ed-0aed4ed94df7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1505 microversion: 2.1 time: 0.293803 Aug 29 10:51:34.204052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1947/3893] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:33 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:34.224079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:34.227491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:34.236338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.238762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.239477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.240389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.241024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.241637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.349723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:34.350252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:34.351035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:34.351603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:34.352106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:34.384194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "tag": "03a695b3-a133-4a2b-a282-a4377c6df3d2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:34.408341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.409780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.411694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.434527 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] Creating event network-changed:03a695b3-a133-4a2b-a282-a4377c6df3d2 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:34.445777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-049446b1-cc48-42cb-bae5-ede911613edf req-aa118a72-6e05-46c1-8c8d-ddc0574f449a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066063 Aug 29 10:51:34.447450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1948/3894] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:34.458087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:34.459827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:34.475370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.476265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.477044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.478149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.479017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.479765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.488125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:34.501688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.502281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.502746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.503912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.504039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.504374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.541792 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6f20bcc-53eb-4337-8135-f00416a98e9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "POST /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43/action" status: 202 len: 1111 microversion: 2.1 time: 0.321892 Aug 29 10:51:34.542449 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1947/3895] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:51:34 2022] POST /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43/action => generated 1111 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 10:51:34.548455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:34.549578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:34.557570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.558214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.559508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:34.560434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:34.561010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:34.561389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.232092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:35.241872 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-977143d0-9d08-43d9-904f-02c6ac021685 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1500 microversion: 2.1 time: 0.790428 Aug 29 10:51:35.242605 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1949/3896] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:34 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1500 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:35.248156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:35.249108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:35.255449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.256243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.256775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.257761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.259039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.259708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.285181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:35.304192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6a39743-ab3b-4ba3-88e4-92b9fdde5926 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.758227 Aug 29 10:51:35.318198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1948/3897] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:34 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:35.318198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:35.318198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:35.320212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.320951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.321709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.322916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.323630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.325022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.638396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:35.655536 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49cc9bb9-4277-4c3a-8ecb-02f50d2c6d7d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.411060 Aug 29 10:51:35.656800 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1950/3898] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:35 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:35.662176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:35.664786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:35.672056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.672548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.673000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.673831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.674498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.675134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.703049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lazy-loading 'flavor' on Instance uuid 7b258c9a-cb6e-47e5-b803-58bdc8885feb {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:35.714197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:35.726834 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6513056c-b1ec-446e-b2cb-712ebf6a672a tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.418693 Aug 29 10:51:35.727483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1949/3899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:35 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:35.821179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be4e0280-3332-4b03-922b-d7c96d71b49a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "POST /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb/action" status: 200 len: 32 microversion: 2.1 time: 0.162691 Aug 29 10:51:35.822202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1951/3900] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:51:35 2022] POST /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:51:35.836119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:35.836782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:35.846737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.847651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.848759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:35.849895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:35.850292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:35.851150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.146771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:36.161636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a82e3120-bbc2-4293-b7cc-76e4f6829c83 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.332865 Aug 29 10:51:36.174912 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1950/3901] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:35 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:36.347274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:36.352088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:36.363226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.363827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.364645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.365977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.367210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.367884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.681408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:36.682063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:36.690011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:36.693919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.694724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.695400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.698687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.700019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.700721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.709655 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e09eb85-d8ca-4f14-a9a3-54f6221dfb80 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.370284 Aug 29 10:51:36.709655 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1952/3902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:36 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:36.750366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:36.750975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:36.762575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.774470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.774932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:36.775692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:36.776157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:36.776587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.138484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:37.142276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:37.148920 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1987f236-df07-4e5d-ad7f-4a911ba46948 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.472118 Aug 29 10:51:37.149775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1951/3903] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:36 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:37.163069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca68647c-2459-4b39-9b1a-f4c222286b6e tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.405722 Aug 29 10:51:37.163069 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1953/3904] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:36 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:37.163069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d4db1b-5505-43de-9206-0748457c60fd", "name": "network-vif-plugged", "status": "completed", "tag": "f93dfec1-15a3-4989-9d95-5487f827879b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:37.166787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:37.167468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:37.168079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.180167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] Creating event network-vif-plugged:f93dfec1-15a3-4989-9d95-5487f827879b for instance f5d4db1b-5505-43de-9206-0748457c60fd on n-h1-854121-10 Aug 29 10:51:37.186125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e267ae2b-c615-43ee-b159-db2bf1e4fa91 req-48faa824-7aaf-47d3-9bc9-f893c2844971 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Aug 29 10:51:37.187144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1954/3905] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:37.190404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:37.191067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:37.200681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:37.201286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:37.201853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.202685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:37.203237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:37.204012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.405453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:37.414426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70cbc90a-d0fa-436b-9235-a669fe775324 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.233600 Aug 29 10:51:37.414993 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1952/3906] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:37 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:37.731508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:37.733463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:37.749042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:37.749959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:37.750599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.751523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:37.752199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:37.753004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:37.928439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:37.938426 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a14f3fc6-d101-40af-942c-d8ec4208632b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.214185 Aug 29 10:51:37.939864 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1955/3907] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:37 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:38.171160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:38.171772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:38.173122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:38.173870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:38.180245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.180754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.181394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.182390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.182792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.183236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.183389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.184704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.184854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.185714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.186321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.186762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.402905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:38.412604 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f2cb8f2-929c-4b3e-bf13-025e2af92996 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1314 microversion: 2.1 time: 0.243496 Aug 29 10:51:38.413185 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1956/3908] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:38 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:38.436040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:38.436261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:38.437163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:38.444410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.445261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.446172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.448745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.449639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97e028da-97bf-442c-b1d7-5f327f1d9db1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.282600 Aug 29 10:51:38.451467 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1953/3909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:38 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:38.462213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.463069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.685451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:38.694190 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ead2a20-0e82-47b8-9683-b0b4d1d1f718 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.262428 Aug 29 10:51:38.694974 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1957/3910] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:38 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:38.961719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:38.962191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:38.972053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.972540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.972985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:38.974291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:38.975090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:38.986592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.347990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:39.357417 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6f5b2068-2713-44f2-9abe-f30ab06b2a72 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.400474 Aug 29 10:51:39.358080 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1954/3911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:38 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:39.436256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:39.437065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:39.444354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.445473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.445858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.446980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.447607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.448542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.474566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:39.474815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:39.485294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.485603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.486085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.486804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.487270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.487810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.773148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:39.782730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:39.790692 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c82eae78-6056-4474-a1db-579d13f66ecd tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1501 microversion: 2.1 time: 0.359670 Aug 29 10:51:39.792749 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1958/3912] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:39 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:39.799829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:39.800821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:39.801647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:39.809546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.810160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.810826 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d3ffa1e-aacc-4834-984c-aad1a2526395 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.339036 Aug 29 10:51:39.810973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.811569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.812036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.812658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.825560 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1955/3913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:39 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:39.832043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:39.832899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:39.840622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.841516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.842199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.843140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:39.843810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:39.844467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:39.870223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:39.876938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'flavor' on Instance uuid f5d4db1b-5505-43de-9206-0748457c60fd {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:39.978301 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c7f810a-089c-4dfc-a0fd-fe1a6c67b705 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "POST /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd/action" status: 202 len: 0 microversion: 2.1 time: 0.151216 Aug 29 10:51:39.984166 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1956/3914] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:51:39 2022] POST /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:51:39.994112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:39.998941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.010395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.012342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.013304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.014974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.016375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.017085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.075882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:40.087637 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a08a463b-0df0-4b76-828f-9431bfa52c6c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.293464 Aug 29 10:51:40.088477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1959/3915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:39 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:40.245231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4417de5e-abc1-4871-9f20-e1219e1f03b4"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:40.248439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.254884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.255465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.255911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.256731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.257187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.257643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.348336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:40.360192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments HTTP/1.1 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 74 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: {"volumeAttachment": {"volumeId": "4417de5e-abc1-4871-9f20-e1219e1f03b4"}} Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '2a89248c-19fc-437e-a607-a698abe2b4e4', 'body': {'volumeAttachment': {'volumeId': '4417de5e-abc1-4871-9f20-e1219e1f03b4'}}} Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:51:40.362548 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 400 to user: Invalid volume: volume 4417de5e-abc1-4871-9f20-e1219e1f03b4 is already attached to instances: 2a89248c-19fc-437e-a607-a698abe2b4e4 {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:40.386440 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4d05ec3-0f8a-44a2-9ad4-4d5b29d03172 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122511 Aug 29 10:51:40.390019 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-de234006-6de2-40f4-9f2e-9914954b49d6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1509 microversion: 2.1 time: 0.381614 Aug 29 10:51:40.390847 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1960/3916] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:51:40 2022] POST /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:51:40.391024 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1957/3917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:39 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:40.391190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:40.391190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.399268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.399765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.400206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.400924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.401385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.402339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.478250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:40.478779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.487125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.487629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.488162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.488878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.489424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.490882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.616505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'services' on Instance uuid 2a89248c-19fc-437e-a607-a698abe2b4e4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:40.758571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:40.767982 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-662734ae-31fe-4584-97fd-b6e9f925d6ea tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.381942 Aug 29 10:51:40.778140 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1961/3918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:40 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:40.796430 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5182fe28-d622-4317-9dba-1c710231c93d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments/4417de5e-abc1-4871-9f20-e1219e1f03b4" status: 202 len: 0 microversion: 2.1 time: 0.321897 Aug 29 10:51:40.800783 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1958/3919] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:51:40 2022] DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments/4417de5e-abc1-4871-9f20-e1219e1f03b4 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:51:40.806185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:40.813536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.821452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.822183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.822925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.823928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.825271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.825898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.839228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:40.840680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:40.856412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.856994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.858570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.862686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:40.863185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:40.863632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:40.891462 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b388d0f-3e5b-4663-8a78-5e18bc8f7b74 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089547 Aug 29 10:51:40.893376 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1962/3920] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:40 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:51:41.101021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:41.111365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:41.111612 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1db502dd-7e70-4111-8f1f-6ae0fd0b491f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.276621 Aug 29 10:51:41.112050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:41.112187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1959/3921] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:40 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:41.118406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.118897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.119340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:41.120301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.121549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.122263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:41.394294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:41.395689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:41.404628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.405582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.406456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:41.407449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.408176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.408837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:41.435172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:41.451761 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa6bc31b-8656-4ee0-abe8-d415d869449e tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.344121 Aug 29 10:51:41.452753 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1963/3922] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:41 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:41.790158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:41.791633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:41.801505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.802509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.803297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:41.804433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:41.805442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:41.806252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.190780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:42.203113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df506c74-0cdd-40d4-8912-8eae7cec3c4c tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1509 microversion: 2.1 time: 0.813618 Aug 29 10:51:42.203642 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1960/3923] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:41 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1509 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:42.226325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:42.229395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:42.236342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.237097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.237759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.238647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.239277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.239886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.275107 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83f3664a-5ad0-46a2-8b11-b29f558bb779 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053087 Aug 29 10:51:42.276324 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1961/3924] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:42 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:42.282857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:42.283726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:42.290184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.290997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.292264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.293224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.293886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.294508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.468047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:42.478890 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ba1c47e-c44a-40c8-87b8-77675fca55e9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.693053 Aug 29 10:51:42.479781 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1964/3925] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:41 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:42.494993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:42.495697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:42.519148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.519657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.520109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.523231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:42.523812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:42.526290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:42.627288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:42.635962 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3793ea0b-9f1e-4111-93a5-847b0d057d84 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.358120 Aug 29 10:51:42.639087 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1962/3926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:42 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:42.923090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:42.934402 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65100487-084f-4e38-8383-7489b3360915 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.452181 Aug 29 10:51:42.939330 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1965/3927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:42 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:43.227288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:43.227841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:43.236609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.237443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.238115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.239360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.240002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.240692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.287793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:43.290411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:43.315900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.318138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.319035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.322062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.327976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.331260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.376349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb3b53a0-81c4-4c47-b2f4-b43350c40a14 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092615 Aug 29 10:51:43.377652 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1966/3928] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:43 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:43.504602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:43.505466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:43.541974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.544182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.546322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.547309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.550327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.551819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.611941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:43.621278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81c6dccc-ad89-443d-8159-75bf66ea1953 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1492 microversion: 2.1 time: 0.398788 Aug 29 10:51:43.622034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1963/3929] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:43 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1492 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:43.656372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:43.658879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:43.675527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.682561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.684458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.690764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:43.695031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:43.698287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:43.802483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:43.947795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:43.967072 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ffd4fd1b-dd35-4519-a3a8-bd9e450cb3ed tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.470521 Aug 29 10:51:43.968343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1967/3930] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:43 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:43.988657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:43.989840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:44.001257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-336fd7aa-4567-443b-81a5-61958c487328 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 204 len: 0 microversion: 2.1 time: 0.361122 Aug 29 10:51:44.002423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1964/3931] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:43 2022] DELETE /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:51:44.007721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.008486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.008667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:44.009246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.009962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:44.010501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.011239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.012949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.024646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.028971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.029514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.030372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.030844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.031283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.383876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:44.394495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fbda209e-699a-47ca-b793-4141db0fec81 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.424765 Aug 29 10:51:44.406304 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1968/3932] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:43 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:44.411860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:44.412114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:44.420682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:44.424978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad6b77d9-7e4d-40cd-ae7a-2962cb323bb7 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.419977 Aug 29 10:51:44.426488 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1965/3933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:44 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:44.436004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:44.436852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.437464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.438077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.439070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:44.440525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.445604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.446320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.446489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.446773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.447000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.447487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:44.447964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:44.448391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:44.493588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b77f6c6e-cf12-4855-a427-42f9d58c6149 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065972 Aug 29 10:51:44.499871 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1966/3934] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:44 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:44.659817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:44.670543 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb2f1ba3-ee4e-44d3-916c-51aabba8c303 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1498 microversion: 2.1 time: 0.262967 Aug 29 10:51:44.671492 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1969/3935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:44 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:44.988635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:44.989370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:45.002837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.006831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.011268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.019395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.020068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.020634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.368177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:45.382492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca5364b7-bcdc-45c0-b2d5-5684b8991bb9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.397786 Aug 29 10:51:45.408203 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1967/3936] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:44 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:45.429583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:45.430338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:45.446894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:45.448283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:45.454527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.458416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.462139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.462815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.463710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.464308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.465723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.469101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.469573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.470371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.470843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.471281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.711874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:45.720882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef6bed1e-014d-4d91-8b62-122eb426baf6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.295046 Aug 29 10:51:45.721741 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1970/3937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:45 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:45.727400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:45.730738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:45.748677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.753036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.753951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.754975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.756259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.757964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.835119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-214addb7-8e29-42d0-a321-56aae6ebfa16 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111808 Aug 29 10:51:45.841346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1971/3938] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:45 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:45.852036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:45.852714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:45.860290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.861200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.861958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.862939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:45.863663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:45.864336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:45.914829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:45.922587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:45.925409 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-800f324d-2d7d-4dae-a096-fbcfe229614c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.482366 Aug 29 10:51:45.926430 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1968/3939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:45 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:46.042395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:46.053780 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61c0ec8a-2934-4f7e-a567-fa127b1c8ec6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1498 microversion: 2.1 time: 0.211037 Aug 29 10:51:46.054355 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1972/3940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:45 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:46.412022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:46.417652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:46.427223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.428012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.428643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.429527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.430177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.430775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.599075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:46.607890 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a658b7c5-a1b9-465f-b1cc-01ec13f47f7d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.206753 Aug 29 10:51:46.608713 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1969/3941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:46 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:46.742149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:46.742723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:46.757894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.758406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.758858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.759601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.760076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.760508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.853168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:46.856511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:46.874498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.875081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.875546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.876288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.876755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.877197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.950220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:46.960151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63f5d75c-c53e-4038-8758-8b72921824ac tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.222044 Aug 29 10:51:46.966633 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81a8a537-0e8e-4844-b7e4-d941cc142a95 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117398 Aug 29 10:51:46.967853 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1970/3942] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:46 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:46.973434 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1973/3943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:46 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:46.974987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:46.975810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:46.991303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.991814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.992263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:46.993063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:46.993537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:46.994004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.076996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:47.078001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:47.087434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.090428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.091164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.094332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.095017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.095658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.208407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:47.222394 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f357376-372a-4a3e-818e-93fe69901d56 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1456 microversion: 2.1 time: 0.150348 Aug 29 10:51:47.222988 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1974/3944] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:47 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1456 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:47.231415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:47.242404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-000e0327-a8ea-4132-9148-a37ff70dbc62 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.273197 Aug 29 10:51:47.243625 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1971/3945] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:46 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:47.397017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d4db1b-5505-43de-9206-0748457c60fd", "name": "network-vif-deleted", "tag": "f93dfec1-15a3-4989-9d95-5487f827879b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:47.421892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.422446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.422956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.475140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] Creating event network-vif-deleted:f93dfec1-15a3-4989-9d95-5487f827879b for instance f5d4db1b-5505-43de-9206-0748457c60fd on n-h1-854121-10 Aug 29 10:51:47.484772 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7b7f046c-92d9-41ca-8c62-8d19fe745a8f req-e2222207-abb7-4ed2-b8d2-997afac0805b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091700 Aug 29 10:51:47.492111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1975/3946] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:47.630081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:47.631297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:47.641026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.641613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.642466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.643340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.644792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.645525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.891187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:47.901032 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9bf91ee4-69d4-4742-b575-c114bc6e62b5 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.275198 Aug 29 10:51:47.903167 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1972/3947] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:47 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:47.983458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:47.986035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:47.986869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:47.987765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:47.998011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.998522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.998896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:47.999018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.999384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:47.999820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:47.999935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.000392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.000515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.000896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.001035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.001377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.024960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:48.072196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7266bf21-a092-4edf-a01b-7e4b3b01b664 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094888 Aug 29 10:51:48.075819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1976/3948] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:47 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:48.210547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:48.223241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-883a3239-c354-4fae-bc24-e0cb4b7cd547 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.242333 Aug 29 10:51:48.224987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1973/3949] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:47 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:48.244592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:48.245502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:48.253041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.264707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:48.265607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:48.267753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:48.270251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.271062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.272733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.275839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.278111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.280092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.291469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.292128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.293325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.298022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.300115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.376059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.376964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.377667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.379093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lazy-loading 'fault' on Instance uuid f5d4db1b-5505-43de-9206-0748457c60fd {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:48.474516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e040bfd57ec449f0a6985eeefab30bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade90ea17e1c4e649a48ea6f851598c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:48.485118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0663b5f-1ef4-4a16-8706-993b6dd876e6 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 200 len: 1304 microversion: 2.1 time: 0.244620 Aug 29 10:51:48.488073 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1977/3950] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:48 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:48.618695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:48.632667 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6e6685e-722f-46ec-ac3d-d562653eb2fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.372506 Aug 29 10:51:48.659098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-961785443", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:48.663536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1974/3951] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:48 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:48.742842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:51:48.924922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:48.926516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:48.934987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.935844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.936343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:48.937348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:48.938152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:48.938581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.332500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:49.342731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be118114-0015-4158-91fe-711d67239341 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.422391 Aug 29 10:51:49.343554 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1975/3952] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:48 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:49.348931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:49.351823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:49.360739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.361571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.362255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.363357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.363493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.363919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.403751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee8eacdb-3edd-49e1-a836-e2d0853f58fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057582 Aug 29 10:51:49.409619 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1976/3953] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:51:49 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:51:49.409907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:49.410465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:49.416888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.417383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.419968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.420698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.421219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.423181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.693994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:51:49.694588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:51:49.695183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:51:49.696042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:51:49.696825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:51:49.708773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.709341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.710155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.765036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.765036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.765036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.768254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:49.768254 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-940a33bf-91e5-48be-9650-0178977392de tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.355448 Aug 29 10:51:49.768254 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1977/3954] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:49 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:49.772672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-plugged", "status": "completed", "tag": "267f4d38-bc2d-4c2c-98c4-78609ab4f749"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:49.778885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:49.785794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:49.801571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.802084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.803477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:51:49.806171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:51:49.806426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.830188 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] Creating event network-vif-plugged:267f4d38-bc2d-4c2c-98c4-78609ab4f749 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:49.837124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e46aae20-f032-45d5-a98a-9f5f7a3826c2 req-9efd9fbd-3553-4cc4-85fc-47054ea29eb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072321 Aug 29 10:51:49.837796 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1978/3955] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:49.844078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:49.845085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:49.853172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.853722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.854178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.854997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.856219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.856830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.892057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:49.901368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-441b983b-48c6-4b24-b6a5-11892ed38ddb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412350 Aug 29 10:51:49.906278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1978/3956] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:51:49.930830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:49.931476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:49.943521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.945658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.945658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.945989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:49.946631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:49.947222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:49.969029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd HTTP/1.1 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f5d4db1b-5505-43de-9206-0748457c60fd'} Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:49.971777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:49.976091 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:49.977297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:49.979203 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee32d1b1-ff6c-4735-a7ed-11a8ca968cf0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 404 len: 111 microversion: 2.1 time: 0.070323 Aug 29 10:51:49.987854 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1979/3957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:49 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:49.993106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:49.995542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.008795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:50.016174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.017028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.019109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.022134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.022988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.023649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.046193 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ec0cd926-a086-4d7e-93e3-0e864ab29728 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 204 len: 0 microversion: 2.1 time: 0.206465 Aug 29 10:51:50.049961 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1979/3958] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:49 2022] DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:51:50.057136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b0c24ca-409c-4134-be6e-ce02e9b3f545 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.059197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b0c24ca-409c-4134-be6e-ce02e9b3f545 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.183046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b0c24ca-409c-4134-be6e-ce02e9b3f545 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:50.196841 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b0c24ca-409c-4134-be6e-ce02e9b3f545 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1192 microversion: 2.1 time: 0.145374 Aug 29 10:51:50.197466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1980/3959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:50.226017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.226166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.235438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.236116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.236703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.237632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.238086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.238535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.268835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd HTTP/1.1 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f5d4db1b-5505-43de-9206-0748457c60fd'} Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:50.270570 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87bdb157-0717-4cc8-a138-6b8d01e81e62 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 404 len: 111 microversion: 2.1 time: 0.061200 Aug 29 10:51:50.275339 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1981/3960] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:50 2022] DELETE /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:50.291098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.291724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.303283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.307132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.307599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.308931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.309478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.318427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.320103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:50.330505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fe80510-88e0-458c-8375-1a51b0f2af9a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.341315 Aug 29 10:51:50.331373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1980/3961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:49 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:50.336742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.337923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: f5d4db1b-5505-43de-9206-0748457c60fd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.344591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.345273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.345975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.346875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.347482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.348333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.371811 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd HTTP/1.1 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f5d4db1b-5505-43de-9206-0748457c60fd'} Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.373967 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. Aug 29 10:51:50.377202 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.378729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance f5d4db1b-5505-43de-9206-0748457c60fd could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:50.379850 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46e83845-1a77-4055-8115-762f6f6a0388 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd" status: 404 len: 111 microversion: 2.1 time: 0.046972 Aug 29 10:51:50.380937 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1981/3962] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/f5d4db1b-5505-43de-9206-0748457c60fd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:50.387117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.387883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.394957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.395689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.396296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.397232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.398018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.398776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.740068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:50.756047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c02560c3-a68c-4fc2-bdbe-73d8f00035a5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1682 microversion: 2.1 time: 0.473801 Aug 29 10:51:50.761221 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1982/3963] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1682 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:50.766238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:50.768113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.768938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.798566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a74aaf4b-25d0-4b65-a4a5-975af4fdf09b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.411772 Aug 29 10:51:50.800900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.801013 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1982/3964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:50.802931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.805281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.807217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.809287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.811830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.812320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.814414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.832146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.840459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.841647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.844307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.845335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.845944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.847344 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 HTTP/1.1 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '45163e11-9eb7-4f06-bdfd-cd3719bc3007'} Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:50.852300 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.857458 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.858139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:50.859033 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-66e2c98b-4b21-46bc-9b65-ac9b533f4449 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 404 len: 111 microversion: 2.1 time: 0.096263 Aug 29 10:51:50.864788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1983/3965] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:50 2022] DELETE /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:50.872872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.873775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 45163e11-9eb7-4f06-bdfd-cd3719bc3007] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.890322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.890828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.891349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.892260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.892821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.893307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.919069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 HTTP/1.1 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '45163e11-9eb7-4f06-bdfd-cd3719bc3007'} Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.921574 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 45163e11-9eb7-4f06-bdfd-cd3719bc3007 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3ccfb96d-ad87-4730-92d2-ecb43d365839 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007" status: 404 len: 111 microversion: 2.1 time: 0.055266 Aug 29 10:51:50.928021 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1984/3966] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/45163e11-9eb7-4f06-bdfd-cd3719bc3007 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:51:50.939863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:50.940528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:50.958582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.959366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.960068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.961246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:50.961755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:50.962284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:50.985819 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c HTTP/1.1 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c'} Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:50.987958 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:50.991706 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:50.994264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:50.995407 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-218808a5-c14b-416d-ba41-9828c068bebf tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 404 len: 111 microversion: 2.1 time: 0.060965 Aug 29 10:51:50.996725 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1985/3967] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:50 2022] DELETE /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:51.005283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.005943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.013264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.013809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.014262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.014996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.015468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.015910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.046497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c HTTP/1.1 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c'} Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.048690 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. Aug 29 10:51:51.052130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.054982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:51.056134 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-921d9019-3ced-4790-8f90-de610b0ffb41 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c" status: 404 len: 111 microversion: 2.1 time: 0.055048 Aug 29 10:51:51.057342 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1986/3968] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/0ac2292f-ebd3-46bc-a061-b28fb3ac4c5c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:51:51.088134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.089594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.100430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.101589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.102200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.103800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.104630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.105066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.121838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a HTTP/1.1 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '051c2ddf-6c5a-49ef-a763-3e1476dfc01a'} Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:51.123326 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:51.126835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b66ea70-7a34-4e6e-908c-481b463f11c0 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 404 len: 111 microversion: 2.1 time: 0.055777 Aug 29 10:51:51.128657 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1987/3969] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:51 2022] DELETE /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:51.134075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.134737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 051c2ddf-6c5a-49ef-a763-3e1476dfc01a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.142084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.142574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.143017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.143870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.144270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.144909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.163929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a HTTP/1.1 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '051c2ddf-6c5a-49ef-a763-3e1476dfc01a'} Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.166008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 051c2ddf-6c5a-49ef-a763-3e1476dfc01a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0afa98e0-34ae-4841-86fd-3b2eb19d282d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a" status: 404 len: 111 microversion: 2.1 time: 0.038533 Aug 29 10:51:51.173769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1988/3970] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/051c2ddf-6c5a-49ef-a763-3e1476dfc01a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:51.178639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.179169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.185651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:51.187860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.188366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.189468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.190754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.191370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.192296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.197276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db6f097f-a93e-415e-af56-fac702d0380b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.394951 Aug 29 10:51:51.207493 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1983/3971] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:50 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:51.213217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.222266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e HTTP/1.1 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '16e452a5-5a22-4912-8315-ff67917f3d4e'} Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:51.223624 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.232601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.233479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.233561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:51.233561 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b8eec25-2784-4ff3-94bf-89f284495775 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 404 len: 111 microversion: 2.1 time: 0.051832 Aug 29 10:51:51.233561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1989/3972] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:51 2022] DELETE /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:51.235473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.236152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 16e452a5-5a22-4912-8315-ff67917f3d4e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.238514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.239206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.239788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.240609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.241205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.241753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.243412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.244192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.244649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.245404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.245959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.246400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.265195 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e HTTP/1.1 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '16e452a5-5a22-4912-8315-ff67917f3d4e'} Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:51.267587 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 16e452a5-5a22-4912-8315-ff67917f3d4e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:51.272435 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-61871372-9f9c-48a6-9659-68c5715cb3f4 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e" status: 404 len: 111 microversion: 2.1 time: 0.039615 Aug 29 10:51:51.274444 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1990/3973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/16e452a5-5a22-4912-8315-ff67917f3d4e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:51:51.353966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.354713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.379973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.380589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.382720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.383861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.386308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.389096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.417195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:51.517300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:51.549537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6687d098-8309-4292-b3f4-b6826a95bdf2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1196 microversion: 2.1 time: 0.331425 Aug 29 10:51:51.550290 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1984/3974] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1196 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:51.781517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.782220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.799977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.800717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.801553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.802455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.803065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.803760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.863752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:51.893337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-acde9d19-eab1-4afc-8e3d-dda6b11239f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.544006 Aug 29 10:51:51.894963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1991/3975] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:51.914646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:51.915979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:51.927996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.928780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.930627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:51.932268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:51.933032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:51.934471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.252724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:52.261126 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7728e872-8208-4f63-9310-90fe86c3d96d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1682 microversion: 2.1 time: 0.484275 Aug 29 10:51:52.262362 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1985/3976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1682 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:52.275054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-plugged", "status": "completed", "tag": "66816c5a-41a1-475b-9c8f-1a8fcb69ee7c"}, {"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-plugged", "status": "completed", "tag": "03a695b3-a133-4a2b-a282-a4377c6df3d2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:52.297972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.302254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.303798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.337000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Creating event network-vif-plugged:66816c5a-41a1-475b-9c8f-1a8fcb69ee7c for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:52.338881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] Creating event network-vif-plugged:03a695b3-a133-4a2b-a282-a4377c6df3d2 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:51:52.359648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-56aaf28e-886e-4e05-9b9b-5ad3b90252a6 req-4f56a506-da0d-4c15-96fe-cf1673b5760b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095757 Aug 29 10:51:52.365842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1986/3977] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:52.376818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:52.378043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:52.392407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.393259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.394071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.395059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.395666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.396413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.417672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:52.427234 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-821578e0-ecc2-4e20-bfcf-7fad2a7ab738 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.530973 Aug 29 10:51:52.431614 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1992/3978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:51 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:52.584883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:52.588601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:52.610725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.612434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.614175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.618021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.620231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.623141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.698749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:52.721408 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01aa6626-0887-47d0-ae16-a02739136018 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.350933 Aug 29 10:51:52.724586 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1987/3979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:52 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:52.752623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:52.766157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f22d30b-9f47-46f5-808c-6f65f59963a3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1244 microversion: 2.1 time: 0.197394 Aug 29 10:51:52.779011 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1993/3980] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:52 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1244 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:52.923363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:52.926282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:52.944244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.945052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.945637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:52.946563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:52.947163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:52.948277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.212446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:53.235691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b1537e0c-195d-4a5c-bdc4-e495a9036b65 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.322294 Aug 29 10:51:53.237070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1988/3981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:52 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:53.284782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:53.286511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:53.295008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.295690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.296314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.297133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.297665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.298169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.453514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:53.454454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:53.456831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:53.462101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.462938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.463590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.465326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.466062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.466701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.470126 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c06585e7-ef7f-42f8-ab37-973547d4a83d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1682 microversion: 2.1 time: 0.189536 Aug 29 10:51:53.471996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1994/3982] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:53 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:53.649749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:53.662298 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0de79fdf-1195-4dce-87df-fed40e3b50db tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.213060 Aug 29 10:51:53.663782 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1989/3983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:53 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:53.751862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:53.752987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:53.762768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.763738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.764389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.765641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.766363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.766996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.788494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:53.789364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:53.798716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.800791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.801256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.805098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:53.805639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:53.806121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:53.948591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:53.959365 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff0adac0-6790-479f-a0f8-18e755fca026 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1250 microversion: 2.1 time: 0.174850 Aug 29 10:51:53.961006 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1990/3984] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:53 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1250 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:54.007291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:54.016448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0685322d-ad20-49f1-a6bc-efc5553285a7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.270799 Aug 29 10:51:54.019359 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1995/3985] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:53 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:54.262241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:54.263167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:54.275570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.276489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.279659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.280664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.284872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.285814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.344215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a89248c-19fc-437e-a607-a698abe2b4e4", "name": "network-vif-deleted", "tag": "fb0a127d-9de7-41ea-a71d-30c75533bc8f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:54.392997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.393814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.394630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.413392 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] Creating event network-vif-deleted:fb0a127d-9de7-41ea-a71d-30c75533bc8f for instance 2a89248c-19fc-437e-a607-a698abe2b4e4 on n-h1-854121-10 Aug 29 10:51:54.436206 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-20488d9a-800e-446f-984a-933e51e0d6d5 req-bd0c2b8f-1020-4c29-bbd5-dba1ae3edd8f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116757 Aug 29 10:51:54.437390 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1996/3986] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:51:54.496328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:54.497206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:54.522761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.523545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.526397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.528282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.530689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.532341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.555404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:54.567689 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2960ff9f-5c31-4d27-9ed9-3ec8f8a7df30 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.312421 Aug 29 10:51:54.574371 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1991/3987] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:54 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:54.611319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.612084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.612641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.613186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'fault' on Instance uuid 2a89248c-19fc-437e-a607-a698abe2b4e4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:51:54.685404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:54.686070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:54.697796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:54.704527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.705053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.705929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.712397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:54.713051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:54.714248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:54.716258 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb055e9e-5fd7-40e6-94b1-cd653b5d94b5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 200 len: 1332 microversion: 2.1 time: 0.224136 Aug 29 10:51:54.729727 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1997/3988] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:54 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:54.984543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:54.985628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:55.011039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.015688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.016437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:55.017360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.021972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.022437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:55.195242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:55.212750 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c2fec41-c577-4da0-bd0d-662e161037b9 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1354 microversion: 2.1 time: 0.531989 Aug 29 10:51:55.213368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1992/3989] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:54 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1354 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:55.226873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:55.229110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:55.244574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.247259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.247982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:55.248721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.249184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.249617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:55.502407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:55.511426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b38078b-acd9-4abe-85e9-88e878a34709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.533357 Aug 29 10:51:55.514218 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1998/3990] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:54 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:55.597460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:55.600477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:55.609323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.610172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.610838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:55.611885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:55.612571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:55.613202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.137462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:56.164741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cab65816-3370-4c9e-85df-047efb797e5a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.947387 Aug 29 10:51:56.167271 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1993/3991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:55 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:56.172279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.173182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.190181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.191015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.191890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.192824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.194329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.194993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.212897 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 HTTP/1.1 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '2a89248c-19fc-437e-a607-a698abe2b4e4'} Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.215617 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:51:56.218816 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.220819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:56.221955 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c2e608b-f260-497a-84cd-9065664a75d3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 404 len: 111 microversion: 2.1 time: 0.055045 Aug 29 10:51:56.223138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1994/3992] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:56.228553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.229314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.238059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.238890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.239540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.240879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.241574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.242307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.243174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:56.254657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3689b25e-05d8-492b-8739-0668edda34a3 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.661150 Aug 29 10:51:56.255255 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 1999/3993] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:55 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:56.264746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.270102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8255784-72fc-475e-914c-5c36e2d4cff9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '.version_select at 0x7f66c6ed0c10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 HTTP/1.1 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '98f67395-9c30-472c-86be-3c5eb7b82574'} Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:56.272643 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.275815 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.278813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:56.279869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03368327-7b30-484b-a80d-9a37e83d9dbe tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 404 len: 111 microversion: 2.1 time: 0.055333 Aug 29 10:51:56.281652 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1995/3994] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:56 2022] DELETE /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:56.293364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.295399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.306480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.307291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.308092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.309258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.309947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.310728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.320404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8255784-72fc-475e-914c-5c36e2d4cff9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215548223" status: 202 len: 0 microversion: 2.1 time: 0.054025 Aug 29 10:51:56.321308 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2000/3995] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215548223 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:51:56.331113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.334629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 98f67395-9c30-472c-86be-3c5eb7b82574] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.351031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.352438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.354040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.354816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.356886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.359427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.395591 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 HTTP/1.1 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '98f67395-9c30-472c-86be-3c5eb7b82574'} Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.401642 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 98f67395-9c30-472c-86be-3c5eb7b82574 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:56.406197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee3ae9dc-a8e2-4e26-bbff-3dce10967116 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574" status: 404 len: 111 microversion: 2.1 time: 0.082587 Aug 29 10:51:56.408698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2001/3996] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/98f67395-9c30-472c-86be-3c5eb7b82574 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:56.418920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.421909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.422417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:56.433021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.437046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.437921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.440967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.441830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.445538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.469245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d HTTP/1.1 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6e94d3df-82d8-4c9b-be9b-1d8a8f06118d'} Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:56.472607 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:56.475785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c66a773-28d9-471d-921e-a8a84e96a950 tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 404 len: 111 microversion: 2.1 time: 0.061248 Aug 29 10:51:56.476447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2002/3997] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:56 2022] DELETE /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:56.486917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.487649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] [instance: 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.498193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.499330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.500287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.501040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.501511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.502152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.527005 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] HTTP exception thrown: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Request method failure captured: Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d HTTP/1.1 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjJHFGyP0NwRl0-SLrXFC1XRXxE_MGfLZDaUErG2X7pcLYve88Ye5oeaHYzZoXtP_3dUUUEFG1hqnbCjt1Q_ftifML91iOMNrCqQo1nolO7mpgXRXKGvn_z_1EgvLwzz6dDew-yqy4UBp7S5z5-8iPMU4eGjgA4SsWw-CCUsHf9_k8 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ade90ea17e1c4e649a48ea6f851598c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ade90ea17e1c4e649a48ea6f851598c6 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-173123503 Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e040bfd57ec449f0a6985eeefab30bca Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-173123503-project Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6e94d3df-82d8-4c9b-be9b-1d8a8f06118d'} Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:51:56.532739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. Aug 29 10:51:56.536358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:51:56.537289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] Returning 404 to user: Instance 6e94d3df-82d8-4c9b-be9b-1d8a8f06118d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:51:56.538390 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-923f85c7-a657-4005-a281-6b7e9036098d tempest-DeleteServersTestJSON-173123503 tempest-DeleteServersTestJSON-173123503-project] 10.222.0.47 "GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d" status: 404 len: 111 microversion: 2.1 time: 0.057617 Aug 29 10:51:56.539255 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2003/3998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/6e94d3df-82d8-4c9b-be9b-1d8a8f06118d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:51:56.548766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.549632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.556154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.556657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.557100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.557883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.558378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.558811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.778349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:56.790401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c7a1a7b-c765-436a-8acb-a4f55874bbca tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1801 microversion: 2.1 time: 0.505681 Aug 29 10:51:56.791217 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1996/3999] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1801 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:56.811790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b175d3a-6e83-4647-a628-99269c76a55a", "tag": "0ea13926-7cd9-4fa3-b068-d0438caecf4b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:56.836718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.837517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.839352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.874596 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] Creating event network-changed:0ea13926-7cd9-4fa3-b068-d0438caecf4b for instance 4b175d3a-6e83-4647-a628-99269c76a55a on n-h1-854121-10 Aug 29 10:51:56.887846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6fa67af6-4937-41d9-96f3-abbaa824f26a req-8b91dafb-bedb-4c2f-acaf-dd8366464a37 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093115 Aug 29 10:51:56.890570 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1997/4000] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:56.904652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:56.908516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:56.921141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:56.926712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.928743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.929083 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-094cd6e6-72f6-41a9-aaeb-a770970590b4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.384294 Aug 29 10:51:56.929671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2004/4001] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:56.931981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.932939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:56.933646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:56.934124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:56.987064 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1920c5ea-182b-49c7-9036-434f4a76439d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59/ips" status: 200 len: 215 microversion: 2.1 time: 0.093093 Aug 29 10:51:56.989055 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1998/4002] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:51:56 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59/ips => generated 215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:57.000716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:57.001223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:57.008663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.009148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.015627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.016538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.017152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.017748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.069998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:51:57.187842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:57.188716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:57.191088 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd96c90f-cd3a-4824-99b1-5ce90a40faa7 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 204 len: 0 microversion: 2.1 time: 0.193798 Aug 29 10:51:57.192790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2005/4003] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:51:56 2022] DELETE /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:51:57.201888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.204325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.207023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.208328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.209510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.210605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.211971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:57.214152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:57.229914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.232494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.233352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.235937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.237544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.241730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.663642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:57.675656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:57.689326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8abe0297-3a9f-4d0d-9ebc-0f25d8fed030 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1807 microversion: 2.1 time: 0.491997 Aug 29 10:51:57.689974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd7be83b-60c3-494d-9518-95ea6026b01a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.491683 Aug 29 10:51:57.691088 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 1999/4005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:57 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:57.697985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:57.699593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:57.703113 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2006/4004] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:57 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1807 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:57.710442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-883c53f1-0de5-4c80-bc9a-142ad12e5fe9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: .version_select at 0x7f66c6e364c0>, body: {"keypair": {"name": "tempest-keypair-1974528955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHlmtZoBeG7FjxSod9hZ1/m6lrijAaFaNsow4n2ukGcPRZ/xkV41heWIgwCbPgMeBfJ/1FRqBJTf2IhOSWHOS5EAIv5N7zdrIkhprvh/u6HHfqRcGBmzDtXzxb6UDtvdg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:57.720258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.722028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.723440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.724650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.726257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.727723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.733286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-883c53f1-0de5-4c80-bc9a-142ad12e5fe9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:51:57.742864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-883c53f1-0de5-4c80-bc9a-142ad12e5fe9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:51:57.779025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-883c53f1-0de5-4c80-bc9a-142ad12e5fe9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073777 Aug 29 10:51:57.780240 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2007/4006] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:51:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:51:57.951561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:57.952492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:57.959102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.959711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.960223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:57.961173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:57.961873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:57.962544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:58.091189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:58.100341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acf5cb32-baba-4c10-b971-e953da8948ed tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.407823 Aug 29 10:51:58.101129 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2000/4007] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:57 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:58.273033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:58.282270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1afeadb3-3ac5-45e0-8e92-dedb77d5f11f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.335459 Aug 29 10:51:58.282865 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2008/4008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:57 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:58.713112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:58.713801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:58.717079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:58.718347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:58.727658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:58.728499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:58.729214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:58.733586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:58.734368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:58.735926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:58.736227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:58.736331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:58.736843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:58.737550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:58.738034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:58.738456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:59.184596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:59.194923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b6efaa0-0001-42e3-a46b-b988b19a1232 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.483691 Aug 29 10:51:59.196673 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2009/4009] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:58 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:59.204402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:59.205497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:59.209545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:59.213777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:59.214606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:59.215566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:59.216517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:59.217330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:59.218096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:59.236044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:59.244895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-513c6ce9-cb95-439f-9f7a-21cf39692fc0 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1807 microversion: 2.1 time: 0.537003 Aug 29 10:51:59.245496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2001/4010] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:58 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1807 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:59.305644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:51:59.306924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:51:59.322923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:59.323426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:59.325171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:59.325576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:51:59.326079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:51:59.326527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:51:59.569954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:59.572559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:51:59.584509 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7c42d41-4972-418c-8f62-21148247dc41 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.386394 Aug 29 10:51:59.588723 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2010/4011] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:59 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:51:59.623275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:51:59.631646 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2372c7f1-cf24-407b-ba75-556e650080b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.331100 Aug 29 10:51:59.632846 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2002/4012] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:51:59 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:51:59.690400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975858454", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db70ecf5-8fd1-4a4e-acd4-79d8294a110e"}], "security_groups": [{"name": "tempest-securitygroup--960520759"}], "key_name": "tempest-keypair-1974528955", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:51:59.852481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] validate_networks() for [('db70ecf5-8fd1-4a4e-acd4-79d8294a110e', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:00.217113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:00.218490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:00.222538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:00.226709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:00.234074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.234671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.235018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.238695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.239445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.239964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.918927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:00.931925 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb45c2d7-8a9a-4052-b8af-8ed53a731ff3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.719293 Aug 29 10:52:00.933000 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2003/4013] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:00 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:00.938556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:00.939108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:00.939464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:00.940041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:00.940620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:00.943185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:00.944061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:00.953316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.954832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.955365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.955960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.956211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.957004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.957311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.957548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.958134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.959061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:00.959724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:00.960339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:00.981586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:00.990720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Getting quotas for user c90c88821f014e85937cb469aa95e365 and project 3b2b0b8926be4968a170dcbd81ce371f. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:01.008229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:01.010948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:01.068520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7599e9ef-09ac-4929-b731-306735f236fa tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.383667 Aug 29 10:52:01.069905 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2011/4014] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:51:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:01.076495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:01.077334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:01.084944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.085437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.085912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.086626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.087087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.087521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.136998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:01.148676 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37fc4a50-c1e4-4f5d-87c3-b1c8b3ebb8a4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1807 microversion: 2.1 time: 0.213331 Aug 29 10:52:01.149812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2004/4015] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:00 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:01.155144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:01.155991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:01.165607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.166403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.167007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.168900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.169593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.170227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.416057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:01.424726 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b39c28d-7398-43eb-8c19-bcbdd8bfcdca tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.353225 Aug 29 10:52:01.430275 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2012/4016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:01 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:01.436875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:01.450843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be37e2c0-cfa1-4a4a-bcfc-9095f07157a4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.299669 Aug 29 10:52:01.451630 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2005/4017] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:01 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:01.457288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ada8cd0d-a86d-42dd-a067-e8babb91b29c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:01.457942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ada8cd0d-a86d-42dd-a067-e8babb91b29c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:01.538459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ada8cd0d-a86d-42dd-a067-e8babb91b29c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:01.550008 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ada8cd0d-a86d-42dd-a067-e8babb91b29c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1241 microversion: 2.1 time: 0.095871 Aug 29 10:52:01.550834 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2006/4018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:01 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:01.669466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-deleted", "tag": "66816c5a-41a1-475b-9c8f-1a8fcb69ee7c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:01.682536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.683942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.686023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.690160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Calling method '.version_select at 0x7f66c7002430>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:01.691967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.692456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.692895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.707939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] Creating event network-vif-deleted:66816c5a-41a1-475b-9c8f-1a8fcb69ee7c for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:52:01.715374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-65f48416-7909-45ad-904e-769282736220 req-71b01aff-4d72-4299-add5-04b2e8330b75 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050784 Aug 29 10:52:01.716199 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2007/4019] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:01.736380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.736909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.737354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.766693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.767427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.768629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.789959 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f57dd3b6-5426-4d10-ba29-515f313f9d21 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1013532378-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.358102 Aug 29 10:52:01.791102 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2013/4020] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:52:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:01.955731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:01.956967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:01.964109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.965938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.966580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:01.967496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:01.968140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:01.968758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.179497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:02.180317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:02.196145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.196844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.197726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.199892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.200566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.201012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.545689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:02.555254 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-096582b1-b4a7-4cc4-8c06-af02a565452f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.603928 Aug 29 10:52:02.556613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2008/4021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:01 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:02.563103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:02.564053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:02.572880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.574288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.575035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.576901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.577586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.579252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.647810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:02.658616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51167ef4-8add-4fe7-a32d-029473452416 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1651 microversion: 2.1 time: 0.482129 Aug 29 10:52:02.671064 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2014/4022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:02 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1651 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:02.676653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:02.677404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:02.684589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.685353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.685886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:02.686658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:02.687177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:02.687668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.070894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:03.086182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f5e084c-078b-41f5-a4ca-c18d5073e3fc tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.528004 Aug 29 10:52:03.087394 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2009/4023] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:02 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:03.100848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:03.102432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:03.114889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.120113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.120438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.121245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.121730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.122182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.173334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:03.185646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdafc042-84c4-4b0b-bc84-f8eb41ddb402 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.511604 Aug 29 10:52:03.189627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2015/4024] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:02 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:03.207659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b175d3a-6e83-4647-a628-99269c76a55a", "name": "network-vif-plugged", "status": "completed", "tag": "0ea13926-7cd9-4fa3-b068-d0438caecf4b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:03.246064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.247128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.247903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.267026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] Creating event network-vif-plugged:0ea13926-7cd9-4fa3-b068-d0438caecf4b for instance 4b175d3a-6e83-4647-a628-99269c76a55a on n-h1-854121-10 Aug 29 10:52:03.275359 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fa7a34cb-0795-4c83-b85d-a9445b3cf002 req-8cda668a-b8a9-4646-a607-d777ebd910d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084028 Aug 29 10:52:03.276682 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2016/4025] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:03.334233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:03.349827 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2f9b72c-c6b9-4134-89f5-b2c2428159d8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1311 microversion: 2.1 time: 0.261127 Aug 29 10:52:03.353483 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2010/4026] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:03 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:03.582686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:03.585909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:03.594781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.595645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.596296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.597823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.598544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.599330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.696109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:03.697406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:03.704752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.705595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.706296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.707495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.708199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.708838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.747832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.748681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.749334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.750050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lazy-loading 'fault' on Instance uuid 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:03.854222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:03.866452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-da56ed64-c27f-4630-9dbe-a7d62b2e130e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 200 len: 1302 microversion: 2.1 time: 0.174145 Aug 29 10:52:03.867669 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2011/4027] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:03 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:03.887649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-deleted", "tag": "03a695b3-a133-4a2b-a282-a4377c6df3d2"}, {"server_uuid": "7c3313ba-d1ce-4503-9526-ee9a28a5ba59", "name": "network-vif-deleted", "tag": "267f4d38-bc2d-4c2c-98c4-78609ab4f749"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:03.900155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:03.902912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:03.904335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:03.939007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Creating event network-vif-deleted:03a695b3-a133-4a2b-a282-a4377c6df3d2 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:52:03.939806 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] Creating event network-vif-deleted:267f4d38-bc2d-4c2c-98c4-78609ab4f749 for instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 on n-h1-854121-10 Aug 29 10:52:03.940178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:03.947357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-dc6793f8-833a-42c2-bbcf-af7530278402 req-05d367f9-fa8e-46f2-a97a-30f4a457c39d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077816 Aug 29 10:52:03.948057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2012/4028] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:03.957787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2aff5af5-4f67-4d67-90b5-14efc3480536 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.380418 Aug 29 10:52:03.971606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2017/4029] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:03 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:04.114041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:04.114937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:04.124292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.124790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.125238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.125980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.126443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.126874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.217266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:04.217907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:04.224945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.225739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.226153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.226867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.227324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.228007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.317220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:04.326572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-022935ef-1f11-4928-b3b7-8c16cd1f7d87 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.219266 Aug 29 10:52:04.327265 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2013/4030] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:04 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:04.374468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:04.375399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:04.381647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.382455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.382967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.383754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.384319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.384940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.393768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:04.405014 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7cf20c3-4c39-4c9a-9c21-b883c6ba0703 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.191804 Aug 29 10:52:04.406214 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2018/4031] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:04 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:04.455080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:04.463705 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2452cb25-82cd-4631-91f4-ebf7730a168e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1299 microversion: 2.1 time: 0.094468 Aug 29 10:52:04.464355 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2014/4032] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:04 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:04.896883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:04.897669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:04.906413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.907941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.908872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.910119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.910925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.911838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:04.936390 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 HTTP/1.1 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7c3313ba-d1ce-4503-9526-ee9a28a5ba59'} Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:04.938290 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41e69e47-eedc-485e-992e-b0f12dda240a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 404 len: 111 microversion: 2.1 time: 0.053120 Aug 29 10:52:04.942606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2019/4033] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:04 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:04.985885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:04.986678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:04.998079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:04.999259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:04.999865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.001190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.001851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.002840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.271140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:05.281846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c490746d-9571-4771-bc20-5d4f6c519044 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.306631 Aug 29 10:52:05.283131 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2015/4034] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:04 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:05.349693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:05.351034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:05.359337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.360070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.360702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.361661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.362327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.362941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.430470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:05.431844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:05.441449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.442570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.443181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.445622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.458979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.461971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.515415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:05.810096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:05.826316 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d81f86e9-8d48-4d4e-81c0-1422b33d43e6 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.478594 Aug 29 10:52:05.829166 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2020/4035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:05 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:05.850666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:05.852447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:05.860883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:05.867070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.867885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.871838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:05.872747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3030eaa-e6ee-47d2-8219-5ff712a21937 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1292 microversion: 2.1 time: 0.449793 Aug 29 10:52:05.873694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:05.874249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2016/4036] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:05 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1292 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:05.874620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:05.876514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.143356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:06.154094 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-270c065c-50fb-45a1-8720-78ab0c0f8933 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.320852 Aug 29 10:52:06.156231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2021/4037] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:05 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:06.303138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:06.303837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:06.311606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.312280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.312860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.313767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.314358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.314927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.682460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:06.701471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-789d68f3-f782-4d59-a4f0-882ae99bd27d tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1516 microversion: 2.1 time: 0.401680 Aug 29 10:52:06.702253 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2017/4038] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:06 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:06.851411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:06.852069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:06.859818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.860301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.860737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.861433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.861917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.862343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.897652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:06.898672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:06.915383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.916085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.916696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:06.917527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:06.918087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:06.918588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:07.153603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:07.163008 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b55c2902-6b38-4e19-9a28-c6716b752e5c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.315374 Aug 29 10:52:07.164236 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2022/4039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:06 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:07.169209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a048117-3050-4f21-b0ac-1dc689a5f63f", "tag": "3979b77b-0754-46e8-9833-253cfe5e2b9a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:07.179488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:07.180421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:07.180655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:07.187283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:07.194063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] Creating event network-changed:3979b77b-0754-46e8-9833-253cfe5e2b9a for instance 6a048117-3050-4f21-b0ac-1dc689a5f63f on n-h1-854121-10 Aug 29 10:52:07.196256 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0c96f9b-2ca3-44f2-b151-7809593bba1c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1474 microversion: 2.1 time: 0.305594 Aug 29 10:52:07.197158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2018/4040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:06 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1474 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:07.202874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:07.203702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:07.204169 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dba1e609-0521-4001-bf9d-b7e0ed5ecee2 req-a10a9de0-a960-4974-a285-2c71263ef89b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038334 Aug 29 10:52:07.204913 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2023/4041] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:07.210444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:07.211269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:07.211840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:07.212885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:07.213487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:07.214468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:07.363107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-786944756", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:07.458488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:07.475630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:07.490047 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-af95afee-8988-4dbf-87d4-39c2a5b45b1f tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.291379 Aug 29 10:52:07.504953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2019/4042] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:07 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:07.729221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:07.731295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:07.743876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:07.744660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:07.746361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:07.747380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:07.748442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:07.750394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.083189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:08.098303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9d09121-2815-4718-b0dd-49f4cc7063e9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1522 microversion: 2.1 time: 0.378336 Aug 29 10:52:08.098986 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2020/4043] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:07 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:08.187138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:08.188180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:08.195798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.196840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.197731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.199306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.200122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.200743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.212777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:08.213357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:08.214080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:08.215150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:08.215734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:08.231523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.232023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.233332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.234153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.234856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.235301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.263353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:08.270458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:08.287839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:08.290996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:08.353745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-397e9b27-3111-434d-b0d3-215c109b935b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994056 Aug 29 10:52:08.361097 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2024/4044] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:08.367956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a45eb596-1547-403c-9e74-94a0fda82add tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:08.368634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a45eb596-1547-403c-9e74-94a0fda82add tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:08.396303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a45eb596-1547-403c-9e74-94a0fda82add tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:08.403201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:08.413107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d77d2dfe-3cd2-4a7f-a189-3d119416907a tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.232083 Aug 29 10:52:08.424509 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2021/4045] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:08 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:08.519088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:08.519775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:08.534732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.535317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.535759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.537186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:08.537898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:08.538478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:08.755220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:08.771843 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.scheduler.client.report [None req-a45eb596-1547-403c-9e74-94a0fda82add tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Deleted allocations for instance a202234f-0dc0-4bcc-a9b8-202746e680a2 Aug 29 10:52:08.794452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40cf679a-c884-4d6f-b24b-bc7eae973b12 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.283973 Aug 29 10:52:08.800879 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a45eb596-1547-403c-9e74-94a0fda82add tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2" status: 204 len: 0 microversion: 2.1 time: 0.436863 Aug 29 10:52:08.804276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2025/4046] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:08 2022] DELETE /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:52:08.811199 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2022/4047] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:08 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:08.814217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:08.814924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:08.835155 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 HTTP/1.1 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a202234f-0dc0-4bcc-a9b8-202746e680a2'} Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance a202234f-0dc0-4bcc-a9b8-202746e680a2 Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:08.840981 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:08.844835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65c013e2-30d8-44f4-a630-b925fad5b61c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2" status: 404 len: 111 microversion: 2.1 time: 0.033741 Aug 29 10:52:08.856125 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2026/4048] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:08 2022] GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:52:08.925091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1538744731", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:09.028625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:09.122968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:09.123791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:09.134644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:09.136880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:09.137894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:09.139380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:09.140098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:09.140672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:09.800691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:09.808776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6b34cde-ef7c-4342-b6d1-70694faa4346 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1522 microversion: 2.1 time: 0.691409 Aug 29 10:52:09.822481 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2027/4049] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:09 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1522 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:09.829020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:09.829945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:09.837169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:09.837966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:09.838577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:09.840543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:09.841194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:09.841796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.209550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:10.217823 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f9b9f732-61ab-4b53-8056-e731a90ba4a1 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.393911 Aug 29 10:52:10.218394 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2028/4050] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:09 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:10.239821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:10.240954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:10.250988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.251727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.252737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.254087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.254782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.255481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.350611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:10.352716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:10.353807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:10.356062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:10.356819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:10.374295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.375308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.377021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.379331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.380728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.381755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.406611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:10.413649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:10.428425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:10.430470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:10.435069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:10.491481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-079f8b22-51c9-46af-aea8-a92202718e63 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571638 Aug 29 10:52:10.492611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2023/4051] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:10.504266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86874e05-d1ec-4ec0-b11d-8e882d1cecba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:10.505132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-86874e05-d1ec-4ec0-b11d-8e882d1cecba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:10.615707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86874e05-d1ec-4ec0-b11d-8e882d1cecba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:10.624314 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-86874e05-d1ec-4ec0-b11d-8e882d1cecba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1221 microversion: 2.1 time: 0.124140 Aug 29 10:52:10.639712 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2024/4052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:10 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:10.687435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:10.696746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4683f637-4f0f-4e53-bdbc-ce437ff7863b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.469711 Aug 29 10:52:10.697329 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2029/4053] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:10 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:10.829611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:10.830268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:10.849922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.850709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.851300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:10.852191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:10.854736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:10.856618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.088116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8811b68-5d2d-45e2-86bb-edeaa4792c43", "name": "network-vif-plugged", "status": "completed", "tag": "c210db94-ca4e-43dc-a6fa-67cc8ca1c37b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:11.113232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.124880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.125633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.139239 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] Creating event network-vif-plugged:c210db94-ca4e-43dc-a6fa-67cc8ca1c37b for instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 on n-h1-854121-10 Aug 29 10:52:11.145413 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7cb2a81e-a893-4f4e-ac43-dedd600edfcf req-177f9f97-5835-42b6-af92-d7c553ba6068 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060846 Aug 29 10:52:11.146895 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2030/4054] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:11.243361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:11.244852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:11.258315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.259234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.262002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.262928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.263508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.264009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.495918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:11.551921 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7b79d25e-af55-47fe-bf6d-be8b82a3670f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1522 microversion: 2.1 time: 0.712599 Aug 29 10:52:11.561771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2025/4055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:10 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1522 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:11.599800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:11.608062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:11.644430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.648487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:11.649187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.650625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.655530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.661076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.662171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-445ea8c3-291c-4fdc-8048-8b5ef1147b7f tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.423098 Aug 29 10:52:11.663943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.666419 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2031/4056] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:11 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:11.677408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:11.680928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:11.708851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.712124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.714986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:11.716418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:11.721226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:11.725434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.170979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:12.182514 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cec4abd5-8dfd-4c7d-b3f8-ff8996dbfef7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1225 microversion: 2.1 time: 0.511652 Aug 29 10:52:12.199615 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2032/4057] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:11 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1225 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:12.210514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:12.211342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:12.229817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.234872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.235522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.236430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.237049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.238899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.269839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:12.388992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:12.399455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:12.401286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:12.403602 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19075ce5-ba74-4fad-b4ed-df6e52174edc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2940 microversion: 2.32 time: 0.840185 Aug 29 10:52:12.419047 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2026/4058] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:11 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2940 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:12.431609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:12.432413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:12.443052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.444075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.444704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.445617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.446429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.447252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.665082 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f55b29f0-dd1c-48a4-b5ad-21605104bc20 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.228979 Aug 29 10:52:12.670977 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2027/4059] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:52:12 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372/os-interface => generated 1830 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:52:12.684235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:12.688676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:12.706294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.707070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.707518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.708502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.708976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.709411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.889967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:12.904229 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-48876263-fd9d-45f2-87a4-4e8672b76f44 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.703292 Aug 29 10:52:12.905674 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2033/4060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:12 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:12.919294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:12.919294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:12.926277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.927045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.927684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:12.928629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:12.929308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:12.930260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.395411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:13.411717 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b2d1812-06cc-424e-b06e-da70f90210d9 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1522 microversion: 2.1 time: 0.738268 Aug 29 10:52:13.412574 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2028/4061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:12 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:13.434301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:13.434921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:13.441396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.441682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:13.442721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.443324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.444476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.445100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.445665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.449944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ac9bf87-6f6c-47a4-9b66-bcd71438f403 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1486 microversion: 2.1 time: 0.538520 Aug 29 10:52:13.450553 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2034/4062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:12 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1486 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:13.484858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:13.485781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:13.489273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:13.494150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.499470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.500141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.501649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.502358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.503086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.612423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:13.627605 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9312f38e-8376-414c-809e-ec861a09112b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1281 microversion: 2.1 time: 0.212871 Aug 29 10:52:13.628231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2029/4063] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:13 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:13.652877 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd9c61ed-268d-40f0-b595-4d0a8edd6778 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "POST /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb/action" status: 202 len: 0 microversion: 2.1 time: 0.169576 Aug 29 10:52:13.667155 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2035/4064] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:52:13 2022] POST /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:52:13.673487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:13.675527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:13.691918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.692414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.698130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.699819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:13.700492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:13.702686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:13.895803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-825960231", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "d223578a-d82c-497e-9243-a999db661665"}, {"uuid": "648428e1-833d-4743-abbe-03036f34471d"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:14.022851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] validate_networks() for [('d223578a-d82c-497e-9243-a999db661665', None, None, None, None, None), ('648428e1-833d-4743-abbe-03036f34471d', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:14.452286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:14.467226 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d3372ca-5f36-4c28-9645-01595004c4a4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1494 microversion: 2.1 time: 0.799311 Aug 29 10:52:14.472701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2030/4065] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:13 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1494 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:14.491537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:14.492334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:14.509327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:14.510278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:14.510895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:14.522877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:14.523359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:14.523811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.013912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:15.041106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bcd1d0d4-9fb7-491c-8916-384c80844290 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.566863 Aug 29 10:52:15.041741 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2031/4066] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:14 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:15.064261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:15.066248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:15.081057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.082894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.084318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.085964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.087155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.088408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.523040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:15.533398 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d69b78b-973b-49ab-83e5-707b32934cbb tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1507 microversion: 2.1 time: 0.489186 Aug 29 10:52:15.542827 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2032/4067] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:15 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:15.550293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:15.552784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:15.568847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.570269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.572372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.576072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.576780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.577454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.822339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:15.833384 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-586d4ff8-b91d-437b-9e66-df5a690ed382 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1279 microversion: 2.1 time: 0.288677 Aug 29 10:52:15.838533 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2033/4068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:15 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:15.856727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:15.857627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:15.877513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.878043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.878043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:15.878043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:15.887159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:15.887873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.166148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:16.171306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:16.183500 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-36a4ab52-018c-4534-b598-2b668464cd06 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1494 microversion: 2.1 time: 0.342982 Aug 29 10:52:16.198365 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2034/4069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:15 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1494 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:16.198365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:16.200830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:16.232265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.236602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.237365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.240822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.242336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.242780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.542973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:16.543487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:16.543971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:16.544427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:16.544818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:16.553672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:16.567358 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-28e2bace-4802-406d-a1b7-9a27e54a633e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 200 len: 1507 microversion: 2.1 time: 0.378056 Aug 29 10:52:16.567930 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2035/4070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:16 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:16.595811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=21 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:16.607169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.607730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.608214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.608943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.609399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.609881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.611095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:16.611768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:16.627293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.627773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.628215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.628925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.636485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.636934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.680544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Getting quotas for project 1518e676de64458995ffaed9b3331908. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:16.707124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Getting quotas for user 4c8f757924d14388b749d5ec9e9ace58 and project 1518e676de64458995ffaed9b3331908. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:16.759107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:16.763433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:16.923732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-945d2170-afdf-4e0c-ba75-9a48e6918a35 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.033217 Aug 29 10:52:16.927570 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2036/4071] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:16.937657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:16.939718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:16.953285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.957310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.957915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:16.958902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:16.962323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:16.963016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:17.018341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:17.035635 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-994506d1-df0d-49a7-8398-afc64982bb7e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.448564 Aug 29 10:52:17.041679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:17.052275 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2036/4072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:16 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:17.064034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:17.064651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:17.078147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:17.078652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:17.079084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:17.079784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:17.080242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:17.081733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:17.234393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c25ab810-7b5c-4f64-80ef-89b11d1ab661 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 204 len: 0 microversion: 2.1 time: 0.304132 Aug 29 10:52:17.236808 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2037/4073] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:16 2022] DELETE /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:17.252773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7414b5a9-ebcb-453d-aa08-4be8006c1f18 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:17.254928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7414b5a9-ebcb-453d-aa08-4be8006c1f18 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:17.459995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7414b5a9-ebcb-453d-aa08-4be8006c1f18 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:17.478678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7414b5a9-ebcb-453d-aa08-4be8006c1f18 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1212 microversion: 2.1 time: 0.237240 Aug 29 10:52:17.482124 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2038/4074] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:17 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:17.501235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:17.502713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:17.524804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:17.528092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:17.531004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:17.534478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:17.536062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:17.538131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:17.643256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:17.655425 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35f09b5a-4369-4901-99ec-0a49a9ebb85a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.601671 Aug 29 10:52:17.656011 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2037/4075] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:17 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:17.691952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1698647518", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bb98c5d8-8227-42c4-8629-d940b6e4d115"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:17.826136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] validate_networks() for [('bb98c5d8-8227-42c4-8629-d940b6e4d115', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:18.788990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:18.812412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1c70f0c-2310-4160-b8e4-058f80baf71b tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1494 microversion: 2.1 time: 1.322533 Aug 29 10:52:18.826721 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2039/4076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:17 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1494 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:18.828725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a048117-3050-4f21-b0ac-1dc689a5f63f", "name": "network-vif-plugged", "status": "completed", "tag": "3979b77b-0754-46e8-9833-253cfe5e2b9a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:18.897147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:18.897636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:18.904624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:18.946776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] Creating event network-vif-plugged:3979b77b-0754-46e8-9833-253cfe5e2b9a for instance 6a048117-3050-4f21-b0ac-1dc689a5f63f on n-h1-854121-10 Aug 29 10:52:18.958654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-949a92a0-4e27-4f41-a26b-874ab98208b2 req-d83c238a-0542-4669-b76c-200506ff3b45 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141386 Aug 29 10:52:18.959276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2040/4077] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:18.970191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:18.971693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:18.990585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:18.991763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:18.992426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:18.994292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:18.995968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:18.996702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.411212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:19.432162 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d9bd755-b588-4f15-9214-0c9aa0a93d61 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.471298 Aug 29 10:52:19.436970 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2041/4078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:18 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:19.444583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:19.445190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:19.494338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.497400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.498473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.499519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.500330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.501935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.643596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:19.652700 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67c96bd4-caea-43f2-b236-84ac7ad5d160 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1216 microversion: 2.1 time: 0.214382 Aug 29 10:52:19.653617 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2042/4079] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:19 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:19.659551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:19.663407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:19.679940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.681476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.682293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.684449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.686577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.687437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.709740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:19.710188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:19.711373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:19.711525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:19.712078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:19.727532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.729977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.730586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.734541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:19.735919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:19.738048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:19.784084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:19.798753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Getting quotas for user 4874da72fc8d49748fe5ade5c4942f04 and project c0d95d6a0fc242b6b8a01668e1f2bb32. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:19.846086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:19.858156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:19.997895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9c79de9-cc20-4b8c-a44b-cc3a4df28759 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.319161 Aug 29 10:52:19.999216 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2038/4080] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:20.008462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.009367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.017401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.018816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.019681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.020872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.022184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.022844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.092083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:20.111339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e81402b-286f-4a5c-9a00-4f533f75c65d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.456404 Aug 29 10:52:20.111966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2043/4081] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:19 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:20.125566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.126411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.210064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:20.218883 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1218 microversion: 2.1 time: 0.105862 Aug 29 10:52:20.235058 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2044/4082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:20 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:20.236440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.238586 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95ba5150-9513-4557-a663-6ead77a2a1f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002441 Aug 29 10:52:20.241613 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2045/4083] 10.222.0.47 () {56 vars in 886 bytes} [Mon Aug 29 10:52:20 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 10:52:20.378796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:20.390553 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d9c7854-04b9-44ed-ba4f-6121fbef2370 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1500 microversion: 2.1 time: 0.389688 Aug 29 10:52:20.391451 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2039/4084] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:19 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1500 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:20.422165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.425797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.459452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.460820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.474154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.474631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.477446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.480319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.481108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.482303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.483233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.484733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.486976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.488312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.490613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.494227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.561811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:20.764590 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2aa1991-dc03-4d6f-9177-a200258d30f4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 204 len: 0 microversion: 2.1 time: 0.347904 Aug 29 10:52:20.765604 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2046/4085] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:20 2022] DELETE /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:20.775179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.777729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.793047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.793521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.794310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.796078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.796560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.796999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.831162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:20.858317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00156747-2a64-4e5c-ad29-a2d3d124eea1 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.403395 Aug 29 10:52:20.862918 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2040/4086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:20 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:20.880440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:20.883334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:20.896482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.898152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:20.898833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.899421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.902728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:20.904445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:20.905890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:20.907289 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2da8ab9-2f4b-4cb5-aeea-a565acc57e3e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1208 microversion: 2.1 time: 0.140177 Aug 29 10:52:20.907875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2047/4087] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:20 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1208 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:21.131222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:21.131848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:21.138344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:21.147380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.147728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83311cbc-5d52-42a8-990d-6ab3480b76af tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.283002 Aug 29 10:52:21.147840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.148244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.148350 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2041/4088] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:20 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:21.164184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.164184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.164184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.241742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bdab55f-0645-4780-b5a9-b3a0e7ab8e66 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:21.242373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1bdab55f-0645-4780-b5a9-b3a0e7ab8e66 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:21.336941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1bdab55f-0645-4780-b5a9-b3a0e7ab8e66 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:21.350442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1bdab55f-0645-4780-b5a9-b3a0e7ab8e66 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1218 microversion: 2.1 time: 0.112683 Aug 29 10:52:21.366614 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2042/4089] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:21 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:21.465617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:21.475617 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8603f803-034b-40be-8441-41552f06c669 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.348125 Aug 29 10:52:21.477356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2048/4090] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:21 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:21.630505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8811b68-5d2d-45e2-86bb-edeaa4792c43", "name": "network-vif-deleted", "tag": "c210db94-ca4e-43dc-a6fa-67cc8ca1c37b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:21.651107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.652344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.652854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.676525 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] Creating event network-vif-deleted:c210db94-ca4e-43dc-a6fa-67cc8ca1c37b for instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 on n-h1-854121-10 Aug 29 10:52:21.693611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f3c5d32f-77e0-4629-bf39-4594b37d10be req-8ff98f07-af31-4377-b994-d5706b50ef14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068322 Aug 29 10:52:21.694715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2043/4091] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:21.884567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:21.885654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:21.894880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.895910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.896581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.897863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.899243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.899910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.933972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:21.934526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:21.951033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.951635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.952273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:21.953031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:21.953495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:21.953965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.070912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:22.085687 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d68e0725-19fb-4182-b343-65a9f7915083 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1208 microversion: 2.1 time: 0.159185 Aug 29 10:52:22.086985 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2044/4092] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:21 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1208 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:22.096928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:22.108294 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f1ed82df-688c-42e1-87b1-035134a1eb69 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.228221 Aug 29 10:52:22.108882 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2049/4093] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:21 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:22.170011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:22.170129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:22.178223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.178899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.179357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.180079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.180548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.181719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.365088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:22.373185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:22.374613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:22.376140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b3218ee-79bd-43d4-976e-2479bb2c86b2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.210746 Aug 29 10:52:22.382008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.382776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.383423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.384634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.384919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.385389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.389816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:22.391196 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2045/4094] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:22 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:22.466340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:22.476004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-defe69e5-a325-4985-908c-a70e80244a39 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1222 microversion: 2.1 time: 0.107391 Aug 29 10:52:22.476764 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2050/4095] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:22 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:22.498943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:22.499842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:22.506657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.507504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.508197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.509122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:22.509818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:22.510540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:22.658828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:22.667720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbb8e1dc-1cce-437e-b088-6595d4881c96 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.172516 Aug 29 10:52:22.668627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2046/4096] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:22 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:23.112563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.114143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:23.125313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.132258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.132887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:23.135072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.135550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.136296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.136770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.137214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.143363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.144117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.144573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.145305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.145807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.148676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.241771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:23.251703 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2fa12864-b44f-49a8-a635-1f88c7041acf tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1208 microversion: 2.1 time: 0.146896 Aug 29 10:52:23.252977 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2051/4097] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1208 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:23.357863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:23.366239 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9890cef-3654-43e8-bf81-caf36dac9d0a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.238592 Aug 29 10:52:23.367009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2047/4098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:23.397984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.402553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:23.410184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.410857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.411372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.412168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.412869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.413308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.504371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.505054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:23.537888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.538628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.539329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.540577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.541422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.542347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.610916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:23.619656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76585f2b-6ab4-4abe-9084-4d1907bfd38c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.226294 Aug 29 10:52:23.634460 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2052/4099] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:23.711599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:23.731633 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19ceb766-e1a6-4fc3-9e0c-c6f0d28d967a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1222 microversion: 2.1 time: 0.230942 Aug 29 10:52:23.734807 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2048/4100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:23.752189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.752906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:23.762791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.764954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.766848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.768043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.768828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.770870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:23.991802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Calling method '.version_select at 0x7f66c648e310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:23.994302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:23.995162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:23.995521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:23.996413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.008964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e8f207a-9fb0-4d66-9e2d-ec6602bc3616 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.272877 Aug 29 10:52:24.009906 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2049/4101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:24.014782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a415ef80-fef1-40d7-a4a0-da875e7b0c35", "tag": "2ea89e97-19c1-44f5-928d-3eb7ad48e8f0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:24.024903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.025482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.026007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.034585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.035092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.035533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.043026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] Creating event network-changed:2ea89e97-19c1-44f5-928d-3eb7ad48e8f0 for instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 on n-h1-854121-10 Aug 29 10:52:24.048201 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-02307770-8bd1-43db-a726-8ed5e2035dfd req-91db1a95-1d23-40b0-9b99-f0be27227a70 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036990 Aug 29 10:52:24.049237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2050/4102] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:24.049476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.050180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.050825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.059244 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d0c002e-14c4-42ce-a2cc-926956644bd1 tempest-PortsAdminExtendedAttrsTestJSON-973613278 tempest-PortsAdminExtendedAttrsTestJSON-973613278-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.384497 Aug 29 10:52:24.061744 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2053/4103] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:52:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:24.273461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:24.274198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:24.289384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.290377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.290995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.291876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.293109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.293915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.383479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:24.388434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:24.389069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:24.393792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-631b232f-14ae-4ec8-9d36-7ff78cbbd7bd tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1208 microversion: 2.1 time: 0.123933 Aug 29 10:52:24.395949 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2051/4104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:24 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1208 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:24.399346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.399841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.402781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.407135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.407863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.408546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.644651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:24.645242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:24.652509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.653495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.654179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.655108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.655791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.656417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.671650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:24.688225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7851fc3-81eb-4654-973f-14aadf46aa1e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1366 microversion: 2.1 time: 0.304245 Aug 29 10:52:24.689343 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2054/4105] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:24 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:24.754865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:24.757099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:24.767012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.769593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.770273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.771523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:24.772250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:24.775172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:24.891068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:24.905271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0343ac5-a783-4d86-b525-747180a56f54 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1214 microversion: 2.1 time: 0.154896 Aug 29 10:52:24.937979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:24.939276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2055/4106] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:24 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:24.948609 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23c6fd7c-1901-4feb-b15a-fc86e6786c19 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1506 microversion: 2.1 time: 0.307831 Aug 29 10:52:24.958268 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2052/4107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:24 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:25.034198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:25.035511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:25.057337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.058494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.062017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.063079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.063893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.064663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.389338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:25.403721 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41b947f3-46c4-46d5-87cd-6f9f6adc5c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.371439 Aug 29 10:52:25.407459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2056/4108] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:25 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:25.430740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:25.431359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:25.447580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.448158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.452676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.456671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.462835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.466206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.697610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:25.708443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a1f21b18-9c46-4c70-937e-a1f78a405d69 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1264 microversion: 2.1 time: 0.285148 Aug 29 10:52:25.708959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:25.709567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:25.710052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2053/4109] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:25 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:25.726445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.727216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.727660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.728397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.728915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.729338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.929325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:25.938476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d5fa265-62da-4729-9e94-7e6e3f8ec690 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1556 microversion: 2.1 time: 0.233534 Aug 29 10:52:25.939068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2057/4110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:25 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1556 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:25.955203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:25.955814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:25.962393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.963170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.964342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.964579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:25.965462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:25.965578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.966461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.967282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.975424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.975920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.976356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:25.977065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:25.977972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:25.978531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.004708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:26.085951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:26.097744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adcebb2a-439b-47da-a012-e7a4c2c6281f tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1214 microversion: 2.1 time: 0.145799 Aug 29 10:52:26.099026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2054/4111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:25 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:26.104055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:26.106039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:26.112905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.114024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.114214 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1fbb5777-80b6-4598-8ea7-ee55a95ae03a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154021 Aug 29 10:52:26.114814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.115151 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2058/4112] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:52:25 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:26.119910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b258c9a-cb6e-47e5-b803-58bdc8885feb", "name": "network-vif-deleted", "tag": "99529685-fe55-44b0-82dd-215c7c27c4fb"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:26.124079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.125082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.126032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.129772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.130421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.131020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.143554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] Creating event network-vif-deleted:99529685-fe55-44b0-82dd-215c7c27c4fb for instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb on n-h1-854121-10 Aug 29 10:52:26.149465 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-42589b73-3de5-42ff-8ab2-ab99a6940cb5 req-a8d50b4d-e655-4861-b1a7-53633c32faed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Aug 29 10:52:26.150671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2059/4113] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:26.198214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.198721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.199471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.199950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lazy-loading 'fault' on Instance uuid 7b258c9a-cb6e-47e5-b803-58bdc8885feb {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:26.304699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:26.314557 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37eb9301-0fa3-40d3-bc32-cca3abea67bf tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1303 microversion: 2.1 time: 0.214205 Aug 29 10:52:26.315385 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2055/4114] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:26 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1303 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:26.434665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:26.436551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:26.450054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.451305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.452058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.453345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.454255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.455060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.656713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:26.731299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:26.732489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:26.740381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.740833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.741273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.742008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:26.743054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:26.743630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:26.750842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:26.762295 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03f192f0-d612-4565-b1ac-4016206c72e7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.331903 Aug 29 10:52:26.770309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2060/4115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:26 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:26.841838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:26.853106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46f67614-cc23-4169-9827-049ca0d4f693 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1264 microversion: 2.1 time: 0.126239 Aug 29 10:52:26.854787 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2056/4116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:26 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:27.133543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:27.134873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:27.154256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.155649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.156734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.158562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.160272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.162926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.337105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:27.338014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:27.348044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.349654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.350654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:27.351199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.353916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.355507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.357287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.381978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ca68810-8093-49aa-af8b-3bb59e1281a6 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1214 microversion: 2.1 time: 0.262481 Aug 29 10:52:27.384007 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2061/4117] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:27 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:27.449864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.450595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.451214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.451813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lazy-loading 'fault' on Instance uuid 7b258c9a-cb6e-47e5-b803-58bdc8885feb {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:27.598130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:27.610598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbcc354b-0829-4454-9385-028db2430138 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 200 len: 1303 microversion: 2.1 time: 0.278035 Aug 29 10:52:27.611386 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2057/4118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:27 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:27.785884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:27.787494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:27.804867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.807029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.808045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.809514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.810588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.811348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.875121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:27.875661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:27.883877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.884371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.884804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:27.885498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:27.886509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:27.887038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.440594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:28.450140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a1e62b6-1a70-4196-b799-ef652175dae8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1270 microversion: 2.1 time: 0.578809 Aug 29 10:52:28.451068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2058/4119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:27 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1270 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:28.471263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:28.472876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:28.485468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.487873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.494663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.495530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.496024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.497369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.553546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:28.575322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6efd642b-cd3e-4620-842e-bbde8af0fb23 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.794872 Aug 29 10:52:28.577754 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2062/4120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:27 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:28.596259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:28.612339 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-208bf705-9783-485b-8bf2-013a39765311 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1270 microversion: 2.1 time: 0.150476 Aug 29 10:52:28.623379 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2059/4121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:28 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:28.633901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:28.634535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 7b258c9a-cb6e-47e5-b803-58bdc8885feb] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:28.646304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a048117-3050-4f21-b0ac-1dc689a5f63f", "tag": "3979b77b-0754-46e8-9833-253cfe5e2b9a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:28.657241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.657772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.660679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.661419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.661897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:28.663538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.666438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.674265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.674753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.677529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.687060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] HTTP exception thrown: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Request method failure captured: Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb HTTP/1.1 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJntqL3S8BWFgPNsHfGNPQngEJFLvC-3q4hP8n1mRK6GttBju4yrDrV6WkkvLjqh6nqvqGGkbLLrXbmvR-rO7fWq_iZ3SxNVKKc8b_-3RtbY33uua-ybnWaFc6NnIbX8svhq2CroOiq1jAVzB6GkdXE05Y49X5-6EOCPyUQkywK1RRQ Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 5b1a273d9e8143ff9f1d7c79e1d81f92 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 5b1a273d9e8143ff9f1d7c79e1d81f92 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerRescueTestJSON-598613302-project Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: da810a1262894dd2add4e5ccddd7957a Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerRescueTestJSON-598613302-project Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7b258c9a-cb6e-47e5-b803-58bdc8885feb'} Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:28.691127 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. Aug 29 10:52:28.696804 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:28.699938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Returning 404 to user: Instance 7b258c9a-cb6e-47e5-b803-58bdc8885feb could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:28.701068 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d48478a-1d6e-48d5-9c11-031b2c28d360 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb" status: 404 len: 111 microversion: 2.1 time: 0.072449 Aug 29 10:52:28.701840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2063/4122] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:28 2022] GET /compute/v2.1/servers/7b258c9a-cb6e-47e5-b803-58bdc8885feb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:28.710157 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] Creating event network-changed:3979b77b-0754-46e8-9833-253cfe5e2b9a for instance 6a048117-3050-4f21-b0ac-1dc689a5f63f on n-h1-854121-10 Aug 29 10:52:28.714918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:28.715822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:28.724200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ae9fb697-09fc-4798-a7e6-eab68dbfaa89 req-91f3d26f-8674-4cfb-aea7-c6e1b9fb812e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083010 Aug 29 10:52:28.724801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2060/4123] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:52:28.726946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.727632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.732351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.735108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:28.735759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:28.736416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:28.783702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:28.984331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e30c00a-4606-40b9-8a9d-377a036ef92c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "DELETE /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 204 len: 0 microversion: 2.1 time: 0.277451 Aug 29 10:52:28.988764 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2064/4124] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:28 2022] DELETE /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:28.996260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:28.997690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:29.022656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.025024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.025681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.027527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.028303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.033275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.332451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:29.342459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04c05ebe-1183-4d1f-bf7f-d1fc84ae1ff4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1493 microversion: 2.1 time: 0.352577 Aug 29 10:52:29.343097 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2061/4125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:28 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:29.474787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:29.475674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:29.487074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.488158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.488600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.489320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.489840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.490266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.601979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:29.606612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:29.622775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.625962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.630204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.631065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.631697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.632269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.758044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:29.767282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:29.775625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8c24a2f-ef90-40ad-933d-a61641a0a2c2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1312 microversion: 2.1 time: 0.305952 Aug 29 10:52:29.780333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2065/4126] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:29 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:29.796822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:29.797836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:29.813156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.813741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.815994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.816896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:29.817516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:29.818122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:29.907834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:29.920639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5c0f287-cea8-41dc-80f2-17a233dc5356 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.326533 Aug 29 10:52:29.923573 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2062/4127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:29 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:29.966895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:29.969427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:29.977394 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-305deb1f-9e7d-4ded-a9aa-8fde9e0ec779 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1278 microversion: 2.1 time: 0.195708 Aug 29 10:52:29.997894 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2066/4128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:29 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:30.364559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:30.365225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:30.373994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.374705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.375150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:30.376067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.377425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.378126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:30.689222 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 10:52:30.689464 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 10:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc (ip 10.222.0.47) !!! Aug 29 10:52:30.700839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:30.709396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3725d854-ffd7-4f27-b9bd-a35950970c4c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1493 microversion: 2.1 time: 0.349577 Aug 29 10:52:30.710019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2063/4129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:30 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1493 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:30.802409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:30.803034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:30.805352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=9 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:30.833525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:30.844601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.846665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.848115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:30.851535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.852253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.853119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:30.943652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:30.944374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:30.951669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.952484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.953109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:30.954035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:30.954676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:30.955439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:31.343931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:31.418268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:31.427452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77177005-5d5f-42c9-a867-93aaa4ba0127 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1312 microversion: 2.1 time: 0.628955 Aug 29 10:52:31.429192 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2067/4130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:30 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1312 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:31.453145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:31.454197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:31.461694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:31.462350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:31.462899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:31.464262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:31.465339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:31.466613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:31.482907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:31.491380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-289a7c08-607c-4bec-bfb1-66fe4ca754c6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.551621 Aug 29 10:52:31.492482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2064/4131] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:30 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:31.497403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a415ef80-fef1-40d7-a4a0-da875e7b0c35", "name": "network-vif-plugged", "status": "completed", "tag": "2ea89e97-19c1-44f5-928d-3eb7ad48e8f0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:31.508753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:31.509047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:31.510047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:31.522867 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] Creating event network-vif-plugged:2ea89e97-19c1-44f5-928d-3eb7ad48e8f0 for instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 on n-h1-854121-10 Aug 29 10:52:31.529193 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-aa2cf1d3-cae4-458c-af1a-52298ae3dc01 req-98338784-8eb6-4a91-b0fb-cbfad8e42773 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Aug 29 10:52:31.529996 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2065/4132] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:31.598828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:31.607026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75d50bcf-3991-494d-a189-2b9705682b6b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1276 microversion: 2.1 time: 0.176280 Aug 29 10:52:31.608060 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2068/4133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:31 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:31.733146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:31.734021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:31.742771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:31.743519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:31.744054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:31.745787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:31.746402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:31.747021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.134156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:32.153062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9e0782d-87ed-4131-90e7-480d77b0dea2 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1493 microversion: 2.1 time: 0.425223 Aug 29 10:52:32.160486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2066/4134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:31 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1493 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:32.403810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097eb650-74d1-48f7-81b2-388095a08cbc", "name": "network-vif-deleted", "tag": "1a14e8c5-d637-4c38-91cc-d5e066d53122"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:32.419865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:32.420982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:32.421610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.434682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] Creating event network-vif-deleted:1a14e8c5-d637-4c38-91cc-d5e066d53122 for instance 097eb650-74d1-48f7-81b2-388095a08cbc on n-h1-854121-10 Aug 29 10:52:32.440373 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c19cdc77-6604-42f2-859b-87426b7f09f3 req-23bc04f9-a094-470a-a931-de9e9d43ce7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043403 Aug 29 10:52:32.441468 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2069/4135] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:52:32.450186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:32.451124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:32.459691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:32.460556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:32.461259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.462264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:32.463006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:32.464477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.514721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:32.515656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:32.523413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:32.524157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:32.524815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.525811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:32.527266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:32.527991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:32.951947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:32.967333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-190f1f36-bb4c-44fe-a0ef-e905cc23825b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1312 microversion: 2.1 time: 0.522675 Aug 29 10:52:32.972636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:32.996207 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2067/4136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:32 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1312 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:32.996925 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e6e8ee1d-b661-481e-a55a-c78970dbb6f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1321 microversion: 2.1 time: 0.479205 Aug 29 10:52:32.997006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:32.997006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:32.997178 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2070/4137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:32 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:33.004465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:33.004975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:33.005795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:33.008355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:33.009763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:33.010231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:33.175852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:33.176566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:33.190269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:33.190969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:33.191486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:33.192276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:33.192824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:33.193328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:33.221157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:33.234484 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-968b4430-045b-4c5a-adbe-de83c00fa54c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1276 microversion: 2.1 time: 0.250844 Aug 29 10:52:33.235409 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2068/4138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:32 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:33.290999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:33.291499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:33.291979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:33.292444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lazy-loading 'fault' on Instance uuid 097eb650-74d1-48f7-81b2-388095a08cbc {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:33.378209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da810a1262894dd2add4e5ccddd7957a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1a273d9e8143ff9f1d7c79e1d81f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:33.394225 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3436f10a-7696-43e5-89da-5adc8723949c tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 200 len: 1304 microversion: 2.1 time: 0.222611 Aug 29 10:52:33.395179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2071/4139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:33 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:34.002788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.003416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.008642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.009483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.014582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.015508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.016819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.017815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.018453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.019046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.022172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.027633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.028204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.029064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.029615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.030159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.335958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:34.346328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f49a0027-f471-4697-9ab3-5ff1a49f1b8e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.347459 Aug 29 10:52:34.347572 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2069/4140] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:33 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:34.352878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.353769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.371815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.372931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.373577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.378958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:34.380641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.381318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.382507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.394414 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0e2e9e1-01e2-40c8-8e0c-7b3c11341004 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1503 microversion: 2.1 time: 0.389614 Aug 29 10:52:34.406921 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2072/4141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:34 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:34.425173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.426973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.435713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.436543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.437216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.438230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.438887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.439619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.765009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:34.780021 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc599d9b-232c-49ac-8655-c9d2c555ede7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.430420 Aug 29 10:52:34.793813 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2070/4142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:34 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:34.798259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.798259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] [instance: 097eb650-74d1-48f7-81b2-388095a08cbc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.809139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.809638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.810104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.811429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.811896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.812333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.837263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] HTTP exception thrown: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Request method failure captured: Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc HTTP/1.1 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJntqL3S8BWFgPNsHfGNPQngEJFLvC-3q4hP8n1mRK6GttBju4yrDrV6WkkvLjqh6nqvqGGkbLLrXbmvR-rO7fWq_iZ3SxNVKKc8b_-3RtbY33uua-ybnWaFc6NnIbX8svhq2CroOiq1jAVzB6GkdXE05Y49X5-6EOCPyUQkywK1RRQ Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5b1a273d9e8143ff9f1d7c79e1d81f92 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b1a273d9e8143ff9f1d7c79e1d81f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5b1a273d9e8143ff9f1d7c79e1d81f92 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueTestJSON-598613302 Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueTestJSON-598613302-project Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: da810a1262894dd2add4e5ccddd7957a Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueTestJSON-598613302-project Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '097eb650-74d1-48f7-81b2-388095a08cbc'} Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:34.840096 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] Returning 404 to user: Instance 097eb650-74d1-48f7-81b2-388095a08cbc could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee1b7dbd-b4ec-4536-8c6d-afce566d03d4 tempest-ServerRescueTestJSON-598613302 tempest-ServerRescueTestJSON-598613302-project] 10.222.0.47 "GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc" status: 404 len: 111 microversion: 2.1 time: 0.057732 Aug 29 10:52:34.843638 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2071/4143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:34 2022] GET /compute/v2.1/servers/097eb650-74d1-48f7-81b2-388095a08cbc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:34.871988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:34.880778 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59a45ade-eb42-48a2-9ebd-749975b297c8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1503 microversion: 2.1 time: 0.467288 Aug 29 10:52:34.881447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2073/4144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:34 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1503 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:34.901428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:34.902064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:34.909241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.909773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.910222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.910930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:34.911563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:34.911996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:34.934800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:34.944785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:35.071033 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ce74c92-d7a5-4efd-85cc-d7270082c439 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 204 len: 0 microversion: 2.1 time: 0.173350 Aug 29 10:52:35.073938 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2072/4145] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:34 2022] DELETE /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:35.082520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:35.083148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:35.098720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.099226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.099671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:35.100395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.100923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.101276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:35.374162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:35.375155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:35.389950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.391146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.391910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:35.392980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.394615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.395294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:35.682494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:35.686755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:35.697603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2545c5c4-7200-4f11-8e60-fcbbc650ba0e tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.329350 Aug 29 10:52:35.703066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aaecc91b-1ac1-4062-bf32-4488cbbe7fe8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1509 microversion: 2.1 time: 0.624930 Aug 29 10:52:35.713536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2073/4146] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:35 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:35.714281 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2074/4147] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:35 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1509 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:35.805879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:35.806486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:35.812570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.813060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.813732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:35.814422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:35.814876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:35.815297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:36.015289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:36.025447 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eba4eedb-6b6b-4323-ac81-10447c8bb000 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.223358 Aug 29 10:52:36.037347 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2074/4148] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:35 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:36.332571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "tag": "104d28dd-b503-4efc-97f5-8fb8427f51b2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:36.345522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:36.346043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:36.346718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:36.382771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] Creating event network-changed:104d28dd-b503-4efc-97f5-8fb8427f51b2 for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:52:36.390924 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-93de8b40-1ad2-407d-a02e-43aa02d79436 req-990df3b0-77b4-4b2a-bb4f-f69ae466c0cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064523 Aug 29 10:52:36.391835 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2075/4149] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:36.721755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:36.723123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:36.730012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:36.731365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:36.740190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:36.741065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:36.741726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:36.742001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:36.742996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:36.743142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:36.743659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:36.743898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:36.744417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:36.745764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:36.746687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:36.747435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:37.078400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:37.094356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b69d13da-04a9-4fcb-8f0b-cab18aa32ff0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1509 microversion: 2.1 time: 0.369704 Aug 29 10:52:37.096081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2076/4150] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:36 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:37.103222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:37.103955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:37.128561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:37.132451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:37.132656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:37.133029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:37.133861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:37.135039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:37.136732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:37.144948 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16e0ffd1-c263-484b-8c23-62bd285f0139 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.430484 Aug 29 10:52:37.145777 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2075/4151] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:36 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:37.308088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:37.316628 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b9efe0c-2c17-443e-99d5-bf03219ea8fc tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.218932 Aug 29 10:52:37.317278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2077/4152] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:37 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:38.120267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:38.121018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:38.128072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.128650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.129304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.130361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.130828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.131293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.166205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:38.167451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:38.174490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.185987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.188904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.189875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.190478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.191051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.488212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:38.497121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec29bdf6-9fc6-4669-81c3-ccab3f44bd0f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1509 microversion: 2.1 time: 0.381065 Aug 29 10:52:38.498264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2076/4153] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:38 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:38.503087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:38.503870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:38.506289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:38.511207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.512330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.512987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.516792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.517362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.517919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.520095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6f78890c-5c0c-4e11-9ee9-55d3aa4e37fc tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.357626 Aug 29 10:52:38.520768 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2078/4154] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:38 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:38.525448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f44f9b-fd88-417d-a21a-9d6fcb783727", "tag": "9b4baf34-6a68-4e6e-88c1-bdd9507538f8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:38.536172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:38.536813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:38.537475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:38.550319 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] Creating event network-changed:9b4baf34-6a68-4e6e-88c1-bdd9507538f8 for instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 on n-h1-854121-10 Aug 29 10:52:38.555627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2c885c2f-3495-404f-b7f6-ec51c2af417b req-96855d52-6db8-460a-ae3d-0e9266bdcb9b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033641 Aug 29 10:52:38.556770 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2079/4155] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:38.684633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:38.694160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20d708ed-2bbf-476d-9bee-6288dd2c1bb1 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.194430 Aug 29 10:52:38.695393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2077/4156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:38 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:39.527029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:39.530007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:39.543957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.544083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:39.544675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:39.545121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.545753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.546654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.547253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.547833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.556786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.565314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.566108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.567190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.567855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.568453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.590975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.594300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.600339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.601020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lazy-loading 'fault' on Instance uuid a415ef80-fef1-40d7-a4a0-da875e7b0c35 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:39.702633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:39.711164 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-238abf58-091d-4d49-98e2-1f86f19371ce tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 200 len: 1311 microversion: 2.1 time: 0.192410 Aug 29 10:52:39.720335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2080/4157] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:39 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 1311 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:39.727826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:39.733668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:39.751107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.751825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.752463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.753476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:39.754289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:39.755049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:39.899247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:39.907479 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acaf2f05-f9da-45ea-b77c-216057eba563 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.370349 Aug 29 10:52:39.908767 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2078/4158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:39 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:39.972551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:39.983589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f1e7a7db-3802-4866-b3b6-3085f17e9230 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.261838 Aug 29 10:52:39.984408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2081/4159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:39 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:40.595929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a415ef80-fef1-40d7-a4a0-da875e7b0c35", "name": "network-vif-deleted", "tag": "2ea89e97-19c1-44f5-928d-3eb7ad48e8f0"}, {"name": "network-changed", "server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "tag": "459daec1-63bb-414e-ae4a-603c7d8607af"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:40.608428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:40.608915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:40.609535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:40.624384 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Creating event network-vif-deleted:2ea89e97-19c1-44f5-928d-3eb7ad48e8f0 for instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 on n-h1-854121-10 Aug 29 10:52:40.624741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] Creating event network-changed:459daec1-63bb-414e-ae4a-603c7d8607af for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:52:40.632958 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-228a5458-28ee-4bea-98a7-ce1268c6e6e8 req-b56657a5-7771-4424-8915-cd5daa2d8472 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040728 Aug 29 10:52:40.633582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2079/4160] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:40.742546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:40.743768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:40.753462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:40.754006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:40.755072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:40.755989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:40.756633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:40.757218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:40.780861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 HTTP/1.1 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a415ef80-fef1-40d7-a4a0-da875e7b0c35'} Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:40.784265 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:52:40.788507 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:40.789983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:40.791060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa3336b7-d29b-4181-9b49-12ede4a9762f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 404 len: 111 microversion: 2.1 time: 0.052463 Aug 29 10:52:40.793314 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2082/4161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:40 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:40.806546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15a7c224-b540-4939-8976-ad01ce294e48 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: .version_select at 0x7f66c6beb160>, body: {"keypair": {"name": "tempest-key-1827362320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO04d0xRQ+Dkxo+nHd4tvhNJphoVx+DA3XU+enPm0httSkBrlvGW72pJPDRLtpWn/YA4+rT/j5Gz6Qa/cuH0oGvKSqv65HMhfefDZTWgShDOa6CVrOsbSsfNeU235vRE3g=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:40.826690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-15a7c224-b540-4939-8976-ad01ce294e48 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:40.858471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-15a7c224-b540-4939-8976-ad01ce294e48 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:40.929532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:40.930597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:40.941522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15a7c224-b540-4939-8976-ad01ce294e48 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.136358 Aug 29 10:52:40.945088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:40.947869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:40.948246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2080/4162] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:52:40 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:40.948921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:40.949777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:40.950255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:40.950690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:40.957336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b74d51e5-f741-433d-bb43-0b79854874aa tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '.version_select at 0x7f66c65ccee0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:40.969468 n-d-854121-10 devstack@n-api.service[128681]: WARNING oslo_db.sqlalchemy.utils [None req-b74d51e5-f741-433d-bb43-0b79854874aa tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 10:52:40.984376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b74d51e5-f741-433d-bb43-0b79854874aa tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.034326 Aug 29 10:52:40.988152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2081/4163] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 29 10:52:40 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:41.011967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:41.014152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:41.024487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:41.025194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:41.026928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:41.028245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:41.029162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:41.029825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:41.591624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:41.611529 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe2da098-7458-469e-8215-b3c65b61f420 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.684240 Aug 29 10:52:41.612327 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2083/4164] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:40 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:41.625301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-435161995", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-key-1827362320", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:41.648758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:41.659743 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49518d5d-d660-4781-a46a-3e4256e8db9e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.657307 Aug 29 10:52:41.661904 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2082/4165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:40 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:41.753042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:42.638949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:42.642517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:42.648037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:42.648560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:42.650921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:42.652542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:42.653033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:42.655402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.656513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.657370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:42.658382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.659056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.659692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:42.672456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.672958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.673573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:42.674562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.675187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.675887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:42.715556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:42.723996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:42.740716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:42.743355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:42.800139 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-178c868c-edd8-4cd4-a405-3d32ba72ca45 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184606 Aug 29 10:52:42.807475 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2084/4166] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:42.807475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:42.807475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:42.813893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.814678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.815201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:42.816137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:42.816834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:42.817612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:43.222665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:43.238516 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ec6111ef-7c87-4a1f-9848-d523764e0cd7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.436214 Aug 29 10:52:43.240458 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2085/4167] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:42 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:43.244738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:43.251366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd652a6f-6763-4e12-a697-6448f33b2321 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:43.252304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd652a6f-6763-4e12-a697-6448f33b2321 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:43.254955 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7027655f-cb93-4505-a0e3-31edcd0d216f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.625179 Aug 29 10:52:43.261841 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2083/4168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:42 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:43.353054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd652a6f-6763-4e12-a697-6448f33b2321 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:43.364651 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd652a6f-6763-4e12-a697-6448f33b2321 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1228 microversion: 2.1 time: 0.121231 Aug 29 10:52:43.367052 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2086/4169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:43 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:43.482452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f44f9b-fd88-417d-a21a-9d6fcb783727", "name": "network-vif-plugged", "status": "completed", "tag": "9b4baf34-6a68-4e6e-88c1-bdd9507538f8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:43.501851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:43.503414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:43.504234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:43.530734 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] Creating event network-vif-plugged:9b4baf34-6a68-4e6e-88c1-bdd9507538f8 for instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 on n-h1-854121-10 Aug 29 10:52:43.542629 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-bce2f680-91c6-4345-9015-f82e6a183abc req-f5f3957d-8fef-47bd-80a6-a0ed2e2cecb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064340 Aug 29 10:52:43.543787 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2084/4170] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:44.262371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:44.263791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:44.288354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.294335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.296235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:44.297143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.298828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.300320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:44.454734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-257fd35a-4522-41a9-9d96-7b9a4f20e2cd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: .version_select at 0x7f66c5da8f70>, body: {"keypair": {"name": "tempest-keypair-274043270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANrkFx1kyC4jtCb/ACZfBZpxMVkU/3cS22qu4y2UPFTlSuKs0UJ4BybhT6JjZ5huH6SbMvL9BTi4dEGPliNW2MIHSzE3EH/oQRTr4tQ7cMtGOZ7+jV/0RMUjFY4n2hPiQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:44.500578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-257fd35a-4522-41a9-9d96-7b9a4f20e2cd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:44.507248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-257fd35a-4522-41a9-9d96-7b9a4f20e2cd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for user d2437d037d844ce2aa3bbceaf369f908 and project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:44.545642 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-257fd35a-4522-41a9-9d96-7b9a4f20e2cd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.381701 Aug 29 10:52:44.546999 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2087/4171] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:52:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:44.552567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:44.553539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:44.578865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.579615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.580352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:44.583164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.584168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.586009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:44.592903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:44.889107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:44.900479 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-763b826e-1df3-489e-bf87-2721a71340ae tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1318 microversion: 2.1 time: 0.643550 Aug 29 10:52:44.904164 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2085/4172] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:44 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:44.914459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:44.915110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:44.935676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.936364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.937313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:44.938205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:44.938684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:44.939275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:45.128782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:45.141116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-724ecdb0-8ab3-455a-a891-515540dede86 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1280 microversion: 2.1 time: 0.235805 Aug 29 10:52:45.145010 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2086/4173] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:44 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:45.206738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:45.220547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-605d735c-204d-4ee0-8f81-73c1dc7a6b8a tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.668097 Aug 29 10:52:45.221447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2088/4174] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:44 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:45.922325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:45.923159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:45.939690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:45.940640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:45.941241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:45.942818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:45.943288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:45.943804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.165328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:46.166225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:46.176132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.183020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.184931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.191265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.193065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.193758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.360034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:46.371024 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24db8fde-dd4e-463f-ae60-825fa147fc0b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1286 microversion: 2.1 time: 0.209306 Aug 29 10:52:46.383093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2089/4175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:46 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:46.389795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:46.390842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:46.403867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.407315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.408056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.408825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.411321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.412043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.521313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:46.540387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e56b945-be95-475b-bde7-4f0355da6656 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1509 microversion: 2.1 time: 0.623217 Aug 29 10:52:46.543828 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2087/4176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:45 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1509 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:46.564379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:46.565128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:46.572208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.574261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.574862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.575762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:46.576385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:46.576968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:46.940848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:46.954646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95491ab7-8040-4b10-9436-1c4c33a55a73 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.569952 Aug 29 10:52:46.960126 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2090/4177] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:46 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:47.016119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:47.065922 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce9578b1-1b7e-4acc-8de3-a6f33cca0380 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1509 microversion: 2.1 time: 0.503975 Aug 29 10:52:47.068077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2088/4178] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:46 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:47.089775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:47.095141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:47.112393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.114332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.115442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.131363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.136452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.138765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.372776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5261ac8c-d28c-4860-a837-a13deb4b4660 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "PUT /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1081 microversion: 2.1 time: 0.289124 Aug 29 10:52:47.373333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2091/4179] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:52:47 2022] PUT /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1081 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:47.392871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:47.393656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:47.406791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:47.406791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:47.415128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.415625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.416064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.416815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.417262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.417690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.427074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.427685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.428128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.429167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.429812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.432831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.696184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:47.711422 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c97b05d-1ae4-4b54-9def-4b2da3be0ee7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1286 microversion: 2.1 time: 0.307039 Aug 29 10:52:47.712658 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2092/4180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:47 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:47.912130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:47.921585 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bbd4b366-d318-40c1-a078-9e551689092b tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1507 microversion: 2.1 time: 0.534221 Aug 29 10:52:47.922925 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2089/4181] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:47 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:47.943156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:47.944152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:47.952649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.953256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.953796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:47.954596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:47.955210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:47.955656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.051701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1890554080", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:48.157140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:48.157823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:48.158446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:48.159023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:48.159581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:48.173218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.176177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.176800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.180812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.183193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.183801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.187317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:48.192012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:48.211954 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec397f84-3750-4e31-8a57-6b20cd800745 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1507 microversion: 2.1 time: 0.272683 Aug 29 10:52:48.217925 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2090/4182] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:47 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:48.229732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:48.234839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:48.251570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.253271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.254573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.257533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.258268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.259740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.260936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Getting quotas for project 6ac59de756c94dbb922eee59ad10ad8b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:48.270456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Getting quotas for user 9c15c40ac8db4c50ba41347915a82713 and project 6ac59de756c94dbb922eee59ad10ad8b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:48.297439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:48.300953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:48.415174 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-113270e0-69ba-4474-a254-de38e1edd1e1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.609994 Aug 29 10:52:48.438709 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2093/4183] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:52:48.458508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:48.468435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:48.488020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:48.494231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:48.496535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.497204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.497821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.498856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.499460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.500179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.505185 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33cf428b-d77b-4318-abe1-75b10022e80d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.285865 Aug 29 10:52:48.506487 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2091/4184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:48 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:48.514631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:48.515950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:48.590757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:48.599957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:48.603593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:48.605118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-22bd03a2-f07f-45b0-8f86-9a687f6514c4 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1278 microversion: 2.54 time: 0.096727 Aug 29 10:52:48.619257 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2092/4185] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:48 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:48.629458 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d55acda-9932-44ae-82eb-164b6c6adbcf tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "PUT /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1083 microversion: 2.1 time: 0.188966 Aug 29 10:52:48.633006 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2094/4186] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:52:48 2022] PUT /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1083 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:48.650052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:48.652325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:48.664413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.664969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.665442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.666193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.667526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.668468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.751515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:48.752309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:48.770157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.770920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.771371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:48.772078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:48.772534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:48.772949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:49.146170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:49.157473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d0d0dc7-e1b7-4e5d-913d-54bde8033c48 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1509 microversion: 2.1 time: 0.511680 Aug 29 10:52:49.161811 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2093/4187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:48 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:49.177596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-593177625", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6799f4e-b262-4ef1-9b11-9920ad0bd3f8"}], "security_groups": [{"name": "tempest-securitygroup--13044036"}], "key_name": "tempest-keypair-274043270", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:49.319760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:49.335139 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ae6022e-434a-493b-bf6f-b7574e8766d5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.601446 Aug 29 10:52:49.336778 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2095/4188] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:48 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:49.362610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:49.363430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:49.377917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:49.378643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:49.379236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:49.380789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:49.382719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:49.383534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:49.453464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] validate_networks() for [('e6799f4e-b262-4ef1-9b11-9920ad0bd3f8', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:52:49.857324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:49.865732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8224f10a-befc-479b-88c7-adcc61eb77f0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1509 microversion: 2.1 time: 0.509347 Aug 29 10:52:49.871070 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2096/4189] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:49 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:49.878138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d594e5c2-99a5-4757-ae5f-477a00f5684c", "tag": "ecd60446-366e-4a6b-b525-8efdbb463f88"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:49.902635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:49.903221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:49.903760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:49.916058 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] Creating event network-changed:ecd60446-366e-4a6b-b525-8efdbb463f88 for instance d594e5c2-99a5-4757-ae5f-477a00f5684c on n-h1-854121-10 Aug 29 10:52:49.926827 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6a03ed4d-91d4-4956-9da8-b6f5f0185254 req-04abdfad-b058-47a3-bbdb-b7e04c96c4e8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054475 Aug 29 10:52:49.927707 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2097/4190] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:49.934603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:49.935546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:49.942273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:49.943002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:49.943443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:49.944144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:49.944792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:49.945228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.253095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.272921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6822ba12-f4cb-4dd8-bd5e-e02c26464e86 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.343430 Aug 29 10:52:50.287063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2098/4191] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:49 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:50.294569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "name": "network-vif-plugged", "status": "completed", "tag": "104d28dd-b503-4efc-97f5-8fb8427f51b2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:50.305852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.306710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.307805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.346334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] Creating event network-vif-plugged:104d28dd-b503-4efc-97f5-8fb8427f51b2 for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:52:50.361601 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-01f82e97-85cf-40f5-a4f9-d9237a127113 req-ff70035c-640b-4b2e-97cf-610cd734642f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065138 Aug 29 10:52:50.368218 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2099/4192] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:50.376359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.378136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.387098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.387984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.388751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.389676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.390458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.391297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.404924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:50.405850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:50.406612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:50.407344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:50.407979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:50.419242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.419734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.420172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.420904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.421359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.421812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.449331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:50.468022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for user d2437d037d844ce2aa3bbceaf369f908 and project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:50.484741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:52:50.487879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:52:50.495496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.501278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:50.515933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.517963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.519730 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-782a3a7d-f4a2-4042-b778-fe21de4c237f tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1348 microversion: 2.54 time: 0.148736 Aug 29 10:52:50.520762 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2100/4193] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:50 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1348 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:50.528903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.529765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.537609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.538457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.539082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.539962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.540642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.541339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.561234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3eb8eb7f-efe6-4369-a120-ddbc713513a2 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.397924 Aug 29 10:52:50.569079 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2094/4194] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:52:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:52:50.577228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:50.577461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.578089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.592163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.592668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.593110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.595050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.595674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.596130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.718318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0cf0b8ec-7a90-4212-863b-3cc2af88bdc7 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 204 len: 0 microversion: 2.1 time: 0.195431 Aug 29 10:52:50.723859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2101/4195] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:50 2022] DELETE /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:50.736344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f67a235-71e8-4946-98cf-eb5131691e3e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.743540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f67a235-71e8-4946-98cf-eb5131691e3e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.826769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f67a235-71e8-4946-98cf-eb5131691e3e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.838960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f67a235-71e8-4946-98cf-eb5131691e3e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1236 microversion: 2.1 time: 0.112263 Aug 29 10:52:50.839862 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2102/4196] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:50 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:50.844680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.845203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.850304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:50.859524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.860098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.860493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.861215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.861683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.862155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.863289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d7cd3c2-5bcd-4c19-966f-c697bead4d13 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.292084 Aug 29 10:52:50.864876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2095/4197] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:50 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:50.902259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:50.946946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:50.964485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.api [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Instance is already in deleting state, ignoring this request Aug 29 10:52:50.966261 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f31c1e5d-31f3-448d-a15f-61323a018335 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 204 len: 0 microversion: 2.1 time: 0.125183 Aug 29 10:52:50.966908 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2103/4198] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:50 2022] DELETE /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:50.976346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:50.976920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:50.988344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.989220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.989877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:50.991906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:50.992501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:50.992950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.159376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:51.174136 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a4e7665-8347-467c-9e0f-3c7b2123c997 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1515 microversion: 2.1 time: 0.202950 Aug 29 10:52:51.177022 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2096/4199] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:50 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:51.300462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:51.301128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:51.321040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.321559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.322068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.325481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.326019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.326506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.528122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:51.546829 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-accc69e2-b6e2-423a-a476-cd01446d5e9d tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.251967 Aug 29 10:52:51.547901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2104/4200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:51 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:51.551305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:51.552562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:51.560066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.560911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.561570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.562758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.563348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.564782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.699463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:51.709167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:51.711226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:51.713002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f054d710-5f66-4b7e-b8dc-6d9172fa9503 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1336 microversion: 2.54 time: 0.167869 Aug 29 10:52:51.730318 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2097/4201] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:51 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:52:51.864685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:51.865449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:51.871968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.872442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.872876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.873573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.874050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.874474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.887194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:51.888127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:51.895217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.895862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.896501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:51.897461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:51.903881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:51.904802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.004927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.013930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ceef46b9-24e7-44fb-8439-ee3fcf03208c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1240 microversion: 2.1 time: 0.153030 Aug 29 10:52:52.014519 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2105/4202] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:51 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:52.139690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.149522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39eb6066-57ec-4e9f-89f4-5c218b64c236 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.267208 Aug 29 10:52:52.150285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2098/4203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:51 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:52.196932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:52.197535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:52.204268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.204675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.205108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.205824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.206575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.206945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.379394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "name": "network-vif-plugged", "status": "completed", "tag": "459daec1-63bb-414e-ae4a-603c7d8607af"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:52.389426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.390002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.390436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.403739 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] Creating event network-vif-plugged:459daec1-63bb-414e-ae4a-603c7d8607af for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:52:52.409341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a1d52160-2be2-48ca-aa19-a495538b9e37 req-8bf0a77b-6729-47fc-909b-5786d8b7dd6b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Aug 29 10:52:52.410168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2099/4204] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:52:52.442479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.450997 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a295e6a5-deeb-4b87-9e14-35f8266473f3 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1515 microversion: 2.1 time: 0.257821 Aug 29 10:52:52.451822 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2106/4205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:52 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:52.571633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:52.572439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:52.579530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.580097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.580610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.581582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.582082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.582514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.736024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.738378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:52.738995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:52.744018 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d92b48ce-330a-4256-8b21-9447d699eda8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.176628 Aug 29 10:52:52.745480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2100/4206] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:52 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:52.746238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.746739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.747182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.748125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:52.748594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:52.749026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:52.822574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.832253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.833718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:52.834870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22858797-227a-4f16-85d9-1a9a2af33366 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1336 microversion: 2.54 time: 0.100722 Aug 29 10:52:52.835438 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2107/4207] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:52 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:52:53.036390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:53.037018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:53.046130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.047329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.048096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.050071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.051123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.051727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.143121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.157914 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11fa4672-6711-4fff-857d-a77e48973b29 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1240 microversion: 2.1 time: 0.125047 Aug 29 10:52:53.158733 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2101/4208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:53 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:53.181739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:53.183032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:53.195780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.196368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.197045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.198630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.199272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.199880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.460689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.471302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a4bcfe4d-94eb-49fe-b7d5-e8d0edd767a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.293512 Aug 29 10:52:53.484770 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2108/4209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:53 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.484993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.685786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.694127 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a450eadb-c276-420f-815d-552c819eb52c tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1515 microversion: 2.1 time: 0.225610 Aug 29 10:52:53.694698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2102/4210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:53 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:53.766565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:53.767108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:53.773727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.774210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.774654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.775364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.775850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.776320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.859592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:53.861471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:53.875096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.875598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.876039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.876750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:53.877210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:53.877841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:53.962710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.980089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.981818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:53.983015 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61350951-98a0-44ff-a8c3-6fe50683ded1 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1336 microversion: 2.54 time: 0.128031 Aug 29 10:52:53.991841 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2103/4211] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:53 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:52:53.997852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:54.009634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02417b44-717e-4bf3-a6c8-918dd5f1185f tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.247098 Aug 29 10:52:54.010655 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2109/4212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:53 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:54.180618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:54.181390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:54.192105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.192877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.193489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.194425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.195255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.195467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.271888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:54.285129 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41091d61-2608-4853-92b0-450b8a00db0a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1232 microversion: 2.1 time: 0.107543 Aug 29 10:52:54.286298 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2104/4213] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:54 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:54.492424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:54.493067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:54.500340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.500829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.501282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.502009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.502470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.502898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.689005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:54.699326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d178593-134a-48d8-ad2c-09d5b8f6176e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.210581 Aug 29 10:52:54.699937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2110/4214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:54 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:54.719652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:54.720279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:54.727326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.727824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.728270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.729952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:54.730504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:54.730938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:54.959865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:54.968590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2adb360f-0419-4626-8a14-74df714ad0c5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1515 microversion: 2.1 time: 0.253291 Aug 29 10:52:54.969447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2105/4215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:54 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:55.005547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:55.006609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:55.014999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.015621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.016540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.017387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.018233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.018789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.031213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:55.032090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:55.038611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.039352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.039960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.040839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.041296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.042171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.128445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:55.153431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:55.155099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:55.159275 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36b179fd-f7c8-4b66-a7a1-8aefddab582e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1336 microversion: 2.54 time: 0.157481 Aug 29 10:52:55.162958 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2111/4216] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:55 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:55.298201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:55.311689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:55.312613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:55.314647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-303306b8-6665-421a-b96e-3e0ab08adac8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1333 microversion: 2.1 time: 0.284827 Aug 29 10:52:55.319270 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2106/4217] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:55 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:55.324702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.325438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.326122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.327138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.328860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.329522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.375177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f44f9b-fd88-417d-a21a-9d6fcb783727", "name": "network-vif-deleted", "tag": "9b4baf34-6a68-4e6e-88c1-bdd9507538f8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:55.390465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.391201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.392079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.415933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] Creating event network-vif-deleted:9b4baf34-6a68-4e6e-88c1-bdd9507538f8 for instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 on n-h1-854121-10 Aug 29 10:52:55.447586 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3f395a99-4113-44a1-ab2b-3d08ad872ee9 req-b01470e0-b71f-4e97-b98b-e77b7adb6e94 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071802 Aug 29 10:52:55.448784 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2107/4218] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:52:55.467599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:55.482178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d594e5c2-99a5-4757-ae5f-477a00f5684c", "name": "network-vif-plugged", "status": "completed", "tag": "ecd60446-366e-4a6b-b525-8efdbb463f88"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:55.496361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a9ca070f-635d-4278-939c-435e6ebaff1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1288 microversion: 2.1 time: 0.192588 Aug 29 10:52:55.497289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2112/4219] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:55 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1288 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:55.499224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.499850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.500513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.516489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] Creating event network-vif-plugged:ecd60446-366e-4a6b-b525-8efdbb463f88 for instance d594e5c2-99a5-4757-ae5f-477a00f5684c on n-h1-854121-10 Aug 29 10:52:55.525644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4cdc725b-5470-4373-96cb-39ba990bd9bc req-ca8becae-2daf-4b4d-a191-c848b36a4109 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048389 Aug 29 10:52:55.529781 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2108/4220] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:55.721076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:55.721693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:55.739023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.739532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.739984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.740717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:55.741180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:55.741654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:55.993708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:55.994631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.000936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.001431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.002001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.002885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.003344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.003774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.035875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.036361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.036803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.037259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lazy-loading 'fault' on Instance uuid d8f44f9b-fd88-417d-a21a-9d6fcb783727 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:56.127738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.135796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c539f281-7105-4e5c-b29e-e3cd98ec5a7e tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1308 microversion: 2.1 time: 0.147154 Aug 29 10:52:56.136373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2109/4221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:55 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:56.140033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.147708 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ddd3a7c-0e4a-47f3-bf97-6bb2110a2b29 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.430824 Aug 29 10:52:56.148474 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2113/4222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:55 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:56.191188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.192409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.200593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.201556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.202410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.203374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.203929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.204687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.314584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.318440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:56.325686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.327496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.328746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0bc178f-07b5-4794-b3d0-6ed9accc4d12 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1357 microversion: 2.54 time: 0.141728 Aug 29 10:52:56.329291 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2110/4223] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:56 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:56.355441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ccab19a6-b45e-4cdd-857a-e42a1027d15a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Action: 'create', calling method: .version_select at 0x7f66c6630430>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1573165307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVqEFqfqc/yADIoB9rtJkiVkHCCcbnmcs4DYIY9AjpPYTEr2VoYKQz/fR+sqdLAEnv8VgOHDr1w6ib4KVHEXqo7kQ3pmclB4i9gzX4tcyRNSU0Q8TTm14E5pbil3uC+SQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:56.357479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.359636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.372391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ccab19a6-b45e-4cdd-857a-e42a1027d15a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Getting quotas for project 6ac59de756c94dbb922eee59ad10ad8b. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:52:56.377908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-ccab19a6-b45e-4cdd-857a-e42a1027d15a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Getting quotas for user 9c15c40ac8db4c50ba41347915a82713 and project 6ac59de756c94dbb922eee59ad10ad8b. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:52:56.378530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.380821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.381588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.382834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.383546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.384132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.408849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ccab19a6-b45e-4cdd-857a-e42a1027d15a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.057076 Aug 29 10:52:56.416075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2111/4224] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:52:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 10:52:56.422615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1573165307", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:52:56.427534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.435015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.436013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.437084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.438039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.438561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.438939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.549287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:52:56.550235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:52:56.550901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:52:56.551496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:52:56.552107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:52:56.637310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.644023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.644515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.644946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.645651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.646169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.646580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.686199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.689860 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04990562-36eb-44f9-989b-b68748cc9756 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "POST /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf/action" status: 202 len: 1140 microversion: 2.54 time: 0.272050 Aug 29 10:52:56.690534 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2112/4225] 10.222.0.47 () {62 vars in 1320 bytes} [Mon Aug 29 10:52:56 2022] POST /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf/action => generated 1140 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 10:52:56.696705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.697317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.709209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-813550f5-3b33-4561-83d8-ee31456a6c27 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1668 microversion: 2.1 time: 0.366408 Aug 29 10:52:56.710194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.710708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.711355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.712093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.712661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.713103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.726820 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2114/4226] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:56 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:56.733032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.733640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.740645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.741128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.741563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.742293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.742743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.743166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.835822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.859840 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ca35a7d-09b5-419d-8017-9f29e6078093 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1306 microversion: 2.1 time: 0.164816 Aug 29 10:52:56.860002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.862427 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2113/4227] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:56 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1306 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:56.871944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.873340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.874116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.876217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:56.879057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d69e9f2-fc93-4af0-a6ba-80ab641d52f6 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.149729 Aug 29 10:52:56.879917 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2115/4228] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:56 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:56.882419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.882419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.882419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.882984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.883441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.883869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.910196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5c54091d-b04c-4b66-b83c-3eca1c21d876 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce/ips" status: 200 len: 179 microversion: 2.1 time: 0.046537 Aug 29 10:52:56.910814 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2114/4229] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:52:56 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce/ips => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:52:56.925771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:56.926370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:56.933307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.934737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.935264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.935969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:56.936434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:56.936860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:56.966464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:52:57.066968 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b0b5243-d600-49f5-b282-9a0a230dfdf2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 204 len: 0 microversion: 2.1 time: 0.148121 Aug 29 10:52:57.068399 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2116/4230] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:56 2022] DELETE /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:52:57.076786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:57.077418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:57.084782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.085072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.085525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.086295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.086772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.087206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.158376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:57.159106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:57.168789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.169359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.169947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.171072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.171734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.172245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.223927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.224414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.225469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.225469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lazy-loading 'fault' on Instance uuid d8f44f9b-fd88-417d-a21a-9d6fcb783727 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:57.329259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:57.338034 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38bd2935-41ad-43a4-932d-809f9e3b7f9a tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1308 microversion: 2.1 time: 0.185255 Aug 29 10:52:57.339250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2117/4231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:57 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:57.344893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:57.346434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:57.352872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.353035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.353634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.355241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.355697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.356207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.362276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:57.395525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:57.407067 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2790c0e2-9a5d-4947-b66f-ccc6392d28fb tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1674 microversion: 2.1 time: 0.334311 Aug 29 10:52:57.407649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2115/4232] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:57 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1674 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:57.624248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:57.632909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-268c9e4f-5f4d-4ae6-9ec3-864cf03a5367 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.292588 Aug 29 10:52:57.633844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2118/4233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:57 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:57.882803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:57.883571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:57.889648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.890182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.890624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.891332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.891803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.892237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.903453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:57.904794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:57.912036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.912532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.912975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:57.913883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:57.914638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:57.915081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.031116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.041235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.043551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.045057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f4a04ed-98e8-4cd6-9f90-feb479ecf33b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.146445 Aug 29 10:52:58.045765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2119/4234] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:57 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:52:58.116562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.126448 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d71518f3-608d-46b7-8652-60876eee667c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.247632 Aug 29 10:52:58.129756 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2116/4235] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:57 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:58.358523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:58.359048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:58.360895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:52:58.366187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.366667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.367099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.367787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.368235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.368651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.399275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.399753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.400193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.400637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lazy-loading 'fault' on Instance uuid d8f44f9b-fd88-417d-a21a-9d6fcb783727 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:52:58.428744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:58.429348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:58.436415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.436996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.437336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.438071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.438526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.439052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.443885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874da72fc8d49748fe5ade5c4942f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d95d6a0fc242b6b8a01668e1f2bb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.453429 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f050208-a8a3-4d3d-9752-a838406482aa tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 200 len: 1308 microversion: 2.1 time: 0.099455 Aug 29 10:52:58.454284 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2120/4236] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:58 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:58.600828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.610024 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db016fee-5347-4c57-8047-23444f01a9c8 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1674 microversion: 2.1 time: 0.184939 Aug 29 10:52:58.610527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2117/4237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:58 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:58.656088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:58.656920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:58.674540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.676002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.676686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.677254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:58.678316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:58.678908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:58.825474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:58.835772 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f8faecb-3087-4538-a7cc-d541716ca571 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1328 microversion: 2.1 time: 0.183729 Aug 29 10:52:58.836581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2121/4238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:58 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1328 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:52:59.068892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.069590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.076640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.077212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.078388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.079114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.079583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.080166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.148798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.150004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.180526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.181407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.183160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.184127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.184590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.185020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.259606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:59.269937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:59.272189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:59.273755 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0069b1f6-7c87-48e7-948b-1b24a6434577 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.208792 Aug 29 10:52:59.274676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2118/4239] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:52:59.413367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:59.423596 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c17cb564-26a5-4d73-a1a0-2da32eca19a8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.278534 Aug 29 10:52:59.425091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2122/4240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:52:59.474498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.475115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: d8f44f9b-fd88-417d-a21a-9d6fcb783727] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.492665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.493397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.494148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.494788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.495213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.495642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.529000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] HTTP exception thrown: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Request method failure captured: Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 HTTP/1.1 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJnYlQ4iQ2iruoexp_Ms1y5FuO1OivH5N9DZxGVb7QXIIwXC3ZG3zqW9-bphmf0bnXl986vpsVbaP9VG2OchwU_Rij1jp1Vt5V6CMH9PScJh2_LGe2JHBF9oGbu5Vvxu-sA0mDO2RIouxbCAv4v188se0_wq9q840xw8swAS7z-VO0E Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4874da72fc8d49748fe5ade5c4942f04 Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd8f44f9b-fd88-417d-a21a-9d6fcb783727'} Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.531968 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Returning 404 to user: Instance d8f44f9b-fd88-417d-a21a-9d6fcb783727 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dc44a89-5725-4674-85e7-d178f631ba03 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727" status: 404 len: 111 microversion: 2.1 time: 0.063356 Aug 29 10:52:59.539942 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2119/4241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/d8f44f9b-fd88-417d-a21a-9d6fcb783727 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:59.545168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.545785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.552408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.552986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.553494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.554318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.554840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.555339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.570794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] HTTP exception thrown: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Request method failure captured: Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 HTTP/1.1 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJnYlQ4iQ2iruoexp_Ms1y5FuO1OivH5N9DZxGVb7QXIIwXC3ZG3zqW9-bphmf0bnXl986vpsVbaP9VG2OchwU_Rij1jp1Vt5V6CMH9PScJh2_LGe2JHBF9oGbu5Vvxu-sA0mDO2RIouxbCAv4v188se0_wq9q840xw8swAS7z-VO0E Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4874da72fc8d49748fe5ade5c4942f04 Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b8811b68-5d2d-45e2-86bb-edeaa4792c43'} Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:59.573229 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Returning 404 to user: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:59.576950 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30ceb530-0832-42a3-99c9-6f01cca06f50 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 404 len: 111 microversion: 2.1 time: 0.034768 Aug 29 10:52:59.585228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.586067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: b8811b68-5d2d-45e2-86bb-edeaa4792c43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.589025 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2123/4242] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:59 2022] DELETE /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:59.593226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.593834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.594333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.595109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.595632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.596142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.611166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] HTTP exception thrown: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Request method failure captured: Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 HTTP/1.1 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJnYlQ4iQ2iruoexp_Ms1y5FuO1OivH5N9DZxGVb7QXIIwXC3ZG3zqW9-bphmf0bnXl986vpsVbaP9VG2OchwU_Rij1jp1Vt5V6CMH9PScJh2_LGe2JHBF9oGbu5Vvxu-sA0mDO2RIouxbCAv4v188se0_wq9q840xw8swAS7z-VO0E Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4874da72fc8d49748fe5ade5c4942f04 Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b8811b68-5d2d-45e2-86bb-edeaa4792c43'} Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.613055 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. Aug 29 10:52:59.616474 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.618261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Returning 404 to user: Instance b8811b68-5d2d-45e2-86bb-edeaa4792c43 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:59.619331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5934b877-88cb-4ef4-aa08-8a812d2ffad5 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43" status: 404 len: 111 microversion: 2.1 time: 0.039234 Aug 29 10:52:59.637000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.637598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.640537 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2120/4243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/b8811b68-5d2d-45e2-86bb-edeaa4792c43 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:59.645498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.648110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.651997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.652481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.652920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.653628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.654127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.654545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.664427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.665905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.668726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.669692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.670437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.671313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.689436 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] HTTP exception thrown: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Request method failure captured: Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 HTTP/1.1 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJnYlQ4iQ2iruoexp_Ms1y5FuO1OivH5N9DZxGVb7QXIIwXC3ZG3zqW9-bphmf0bnXl986vpsVbaP9VG2OchwU_Rij1jp1Vt5V6CMH9PScJh2_LGe2JHBF9oGbu5Vvxu-sA0mDO2RIouxbCAv4v188se0_wq9q840xw8swAS7z-VO0E Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4874da72fc8d49748fe5ade5c4942f04 Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ef6b9b48-aa63-4815-a256-635a41937148'} Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:59.691866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.695210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.698642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Returning 404 to user: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:59.699804 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8208cd40-4c6d-483b-a5ca-f39b442b36ef tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 404 len: 111 microversion: 2.1 time: 0.075338 Aug 29 10:52:59.703731 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2124/4244] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:52:59 2022] DELETE /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:59.714148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.718934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] [instance: ef6b9b48-aa63-4815-a256-635a41937148] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.733100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.733591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.734062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.734768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.735218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.735639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.761266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] HTTP exception thrown: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Request method failure captured: Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 HTTP/1.1 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJnYlQ4iQ2iruoexp_Ms1y5FuO1OivH5N9DZxGVb7QXIIwXC3ZG3zqW9-bphmf0bnXl986vpsVbaP9VG2OchwU_Rij1jp1Vt5V6CMH9PScJh2_LGe2JHBF9oGbu5Vvxu-sA0mDO2RIouxbCAv4v188se0_wq9q840xw8swAS7z-VO0E Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c0d95d6a0fc242b6b8a01668e1f2bb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c0d95d6a0fc242b6b8a01668e1f2bb32 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1807165561 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4874da72fc8d49748fe5ade5c4942f04 Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiskConfigTestJSON-1807165561-project Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ef6b9b48-aa63-4815-a256-635a41937148'} Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:52:59.762806 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. Aug 29 10:52:59.766402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:52:59.767327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] Returning 404 to user: Instance ef6b9b48-aa63-4815-a256-635a41937148 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:52:59.768401 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc8beb35-cc33-47b7-95be-47261a3602b0 tempest-ServerDiskConfigTestJSON-1807165561 tempest-ServerDiskConfigTestJSON-1807165561-project] 10.222.0.47 "GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148" status: 404 len: 111 microversion: 2.1 time: 0.063214 Aug 29 10:52:59.769156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2125/4245] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/ef6b9b48-aa63-4815-a256-635a41937148 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:52:59.857688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:52:59.858340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:52:59.864818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.865540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.866328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.867103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:52:59.867559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:52:59.868131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:52:59.890966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:52:59.900509 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5baa1637-8576-418d-9d16-3789263efdac tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1674 microversion: 2.1 time: 0.258701 Aug 29 10:52:59.902468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2121/4246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1674 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:00.014820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.023144 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ddc21800-a984-4793-8197-0692fe188643 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1509 microversion: 2.1 time: 0.170454 Aug 29 10:53:00.023742 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2126/4247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:52:59 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:00.045063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.045684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.051902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.052398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.052841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.053553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.054044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.054477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.191891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.200788 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5bbee3f3-7961-47fa-b565-10b8963d6725 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1509 microversion: 2.1 time: 0.160522 Aug 29 10:53:00.201373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2122/4248] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:00 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:00.221787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.222289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.229081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.229570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.230032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.230888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.231610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.232040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.257679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:53:00.296543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.297933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.303730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.304219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.304653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.305567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.305843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.306259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.352724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a46c10cc-bca0-4c4a-a360-38441dc2d185 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 204 len: 0 microversion: 2.1 time: 0.134691 Aug 29 10:53:00.357601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2127/4249] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:00 2022] DELETE /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:53:00.363971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.364661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.374802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.375625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.376414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.377467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.378188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.378996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.392833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.401867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.403760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.404944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53a23d9c-870c-4cb8-a564-52b94cb38049 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.112334 Aug 29 10:53:00.420945 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2123/4250] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:00 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:00.448228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.448851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.451072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:00.457181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.457675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.458131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.459569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.459569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.459792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.567189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.576379 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f3f647c6-5031-41e4-9dbc-88e6d63ab74a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1515 microversion: 2.1 time: 0.218072 Aug 29 10:53:00.577161 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2128/4251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:00 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:00.628866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:00.637747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ebcc7fcf-9c03-4814-aadb-6a3c7acba050 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.193872 Aug 29 10:53:00.638331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2124/4252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:00 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:00.787993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b980d711-fd13-4285-8ee6-23599482ab10", "tag": "5bfdccf5-c446-4730-8e8f-cf0f867c5a1d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:00.798558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.799047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.799492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.810632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] Creating event network-changed:5bfdccf5-c446-4730-8e8f-cf0f867c5a1d for instance b980d711-fd13-4285-8ee6-23599482ab10 on n-h1-854121-10 Aug 29 10:53:00.815665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d7318b5b-15e4-4f8f-a2b8-cec0e2cb7845 req-363c7230-6024-40dd-9e41-e4f8e136f066 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031497 Aug 29 10:53:00.816761 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2129/4253] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:00.928886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:00.929776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:00.939864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.940673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.941306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:00.942336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:00.943004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:00.943587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.118487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:01.126424 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f171d6f-3886-4aa4-a48f-e647d763e2d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1653 microversion: 2.1 time: 0.206537 Aug 29 10:53:01.127176 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2125/4254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:00 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1653 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:01.425580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=20 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:01.431596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:01.432666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:01.440136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.440879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.441320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.442056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.442512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.442939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.540877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:01.550650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:01.553285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:01.554616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd75620e-b1b8-4b2e-901a-82b709696bc3 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.129982 Aug 29 10:53:01.555263 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2130/4255] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:01 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:01.598671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:01.600277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:01.607545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.608044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.608487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.609448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.609952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.610550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.659513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:01.660871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:01.668490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.669068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.669581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.670542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:01.671069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:01.671599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:01.987018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:01.999617 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-480fc072-4af9-41af-83c8-6e063fd82ba9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1515 microversion: 2.1 time: 0.405031 Aug 29 10:53:02.001159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2126/4256] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:01 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:02.017504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:02.028140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-980cb159-a682-462e-adfa-0a8b598fab64 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.372514 Aug 29 10:53:02.028733 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2131/4257] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:01 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:02.151773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:02.152840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:02.160985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:02.161771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:02.162215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:02.163110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:02.163573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:02.163998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:02.468483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:02.474587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:02.487222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-831bdd5a-5fd2-4375-bc5e-9d96b5500fb2 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1653 microversion: 2.1 time: 0.337388 Aug 29 10:53:02.503838 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2127/4258] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:02 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1653 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:02.577312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:02.578743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:02.583244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:02.591527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:02.592140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:02.593524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:02.594291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:02.594754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:02.602230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:02.695499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:02.708263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:02.711088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:02.712551 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-26f7ac19-7231-4025-9377-739ef3c68f53 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.139826 Aug 29 10:53:02.714938 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2132/4259] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:02 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:02.849324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "name": "network-vif-deleted", "tag": "104d28dd-b503-4efc-97f5-8fb8427f51b2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:02.868258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:02.868942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:02.870661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:02.887761 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] Creating event network-vif-deleted:104d28dd-b503-4efc-97f5-8fb8427f51b2 for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:53:02.894427 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d3a08b01-2423-429e-8573-2999957dccb9 req-036efbe1-df38-4694-aa48-1b4f2e4b08f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047985 Aug 29 10:53:02.895027 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2128/4260] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:03.020480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:03.021097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:03.030397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.031131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.031740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.032679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.033354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.034006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.055193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:03.056329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:03.075237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.075808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.076259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.082760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.083461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.083917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.355844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.367496 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d48ac82d-4cff-45c9-9547-9ccb97f0951f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.318088 Aug 29 10:53:03.371721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2129/4261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:03 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:03.466648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.480665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c9bf368-bfe3-4442-8d6b-c5792a468a85 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1515 microversion: 2.1 time: 0.463918 Aug 29 10:53:03.481639 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2133/4262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:03 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1515 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:03.508503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:03.509224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:03.516832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.519455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.520021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.520833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.521555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.522228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.590130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.590919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.592883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.593462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lazy-loading 'fault' on Instance uuid 2160409c-7aa8-4ab1-9792-03332db107ce {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:53:03.662765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8f757924d14388b749d5ec9e9ace58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1518e676de64458995ffaed9b3331908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.673401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa43f8a4-00bc-46d8-ac89-ef74777f0d17 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 200 len: 1302 microversion: 2.1 time: 0.167744 Aug 29 10:53:03.674205 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2130/4263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:03 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 1302 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:03.739164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:03.739978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:03.749753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.757884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.758394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.759153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:03.759641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:03.760754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:03.866080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.886524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.888087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:03.892720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83f5e040-c70b-43fc-bb01-00f0b5322deb tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.158698 Aug 29 10:53:03.893452 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2134/4264] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:03 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:04.394460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:04.395689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:04.405491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.407020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.408064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.409115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.409949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.410760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.501902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:04.502512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:04.512335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.512821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.516043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.516782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.517234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.517666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.548531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:04.591764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.592901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.593585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.594412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lazy-loading 'fault' on Instance uuid d594e5c2-99a5-4757-ae5f-477a00f5684c {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:53:04.664020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:04.669247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:04.677462 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09ab5703-6950-4981-b30e-8e7476a38cd6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.293033 Aug 29 10:53:04.679723 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2131/4265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:04 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:04.679971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c3fd84b1-87a8-4108-b012-4787838e24f3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 200 len: 1318 microversion: 2.1 time: 0.179618 Aug 29 10:53:04.680816 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2135/4266] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:04 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:04.697916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:04.699048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:04.706810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.707411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.707962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.708902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.709546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.710204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.730294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce HTTP/1.1 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '2160409c-7aa8-4ab1-9792-03332db107ce'} Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:04.733358 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:04.737576 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:04.738652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:04.739528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f53f850-e6aa-48e1-a8ef-5c5a67fdfe4b tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 404 len: 111 microversion: 2.1 time: 0.047281 Aug 29 10:53:04.740102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2132/4267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:04 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:04.919573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:04.920724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:04.936241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.936732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.941085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.942439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:04.942817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:04.943251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:04.995429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160409c-7aa8-4ab1-9792-03332db107ce", "name": "network-vif-deleted", "tag": "459daec1-63bb-414e-ae4a-603c7d8607af"}, {"server_uuid": "d594e5c2-99a5-4757-ae5f-477a00f5684c", "name": "network-vif-deleted", "tag": "ecd60446-366e-4a6b-b525-8efdbb463f88"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:05.008981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:05.015689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.016437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.017055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.032963 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Creating event network-vif-deleted:459daec1-63bb-414e-ae4a-603c7d8607af for instance 2160409c-7aa8-4ab1-9792-03332db107ce on n-h1-854121-10 Aug 29 10:53:05.033783 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] Creating event network-vif-deleted:ecd60446-366e-4a6b-b525-8efdbb463f88 for instance d594e5c2-99a5-4757-ae5f-477a00f5684c on n-h1-854121-10 Aug 29 10:53:05.041945 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-060af009-26b9-47bd-bb47-c327a9c95a29 req-16e1c583-ae6c-4b74-9ed7-8997dacffe1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059260 Aug 29 10:53:05.043103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2133/4268] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:05.081490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:05.101463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:05.104506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:05.106201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c1caa20-4515-4ad2-863f-54291209e7af tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.191129 Aug 29 10:53:05.106844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2136/4269] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:04 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:05.531241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:05.532227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:05.549403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.549982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.552190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.555800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.556584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.558820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.606163 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea0ede8c-b4ea-4af8-9602-ab116e43dd47 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/ips" status: 200 len: 150 microversion: 2.1 time: 0.079096 Aug 29 10:53:05.607368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2134/4270] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:53:05 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:05.734716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:05.741865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:05.742494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:05.743333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:05.772878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.773400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.773889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.774637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.775105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.776068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.777735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.780498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.782266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.793062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:05.793062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:05.793062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:05.818902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c HTTP/1.1 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd594e5c2-99a5-4757-ae5f-477a00f5684c'} Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:05.821536 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:05.827479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:05.828932 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c616ef65-44db-4b24-8951-a497a16eeb7a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 404 len: 111 microversion: 2.1 time: 0.114757 Aug 29 10:53:05.830022 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2137/4271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:05 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:05.862512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40e88e14-cc7c-42fe-b4b3-60aaf2b956ec tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '.version_select at 0x7f66c5d7e4c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:05.904688 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40e88e14-cc7c-42fe-b4b3-60aaf2b956ec tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-key-1827362320" status: 202 len: 0 microversion: 2.1 time: 0.067818 Aug 29 10:53:05.909663 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2138/4272] 10.222.0.47 () {58 vars in 1209 bytes} [Mon Aug 29 10:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1827362320 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 10:53:06.145882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:06.146580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:06.184806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:06.186668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:06.187682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:06.188515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:06.190637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:06.191478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:06.389143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:06.498306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:06.513158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:06.515269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:06.516722 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11e65f9f-141a-4a7a-9096-1aab631babd7 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.389370 Aug 29 10:53:06.518155 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2139/4273] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:06 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:06.525348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1503076707", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:06.567259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:06.576787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8764ce02-0c1c-4df5-a8bd-ddac7e388a5c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.860575 Aug 29 10:53:06.577386 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2135/4274] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:05 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:06.619788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:53:07.543746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:07.544502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:07.551954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.552676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.553368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.554345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.555095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.555748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.596438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:53:07.597367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:53:07.598046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:53:07.599090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:53:07.599681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:53:07.611002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.611848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.612726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.613605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.614221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.614801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.636373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:53:07.643867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:53:07.651882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:07.660161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:07.661427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:53:07.663156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:07.664155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:07.664393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-712a5ee6-cf63-46ed-aa9f-d1faea6a4278 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.127540 Aug 29 10:53:07.665163 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2136/4275] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:07 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:07.686688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:07.689150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:07.701082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.702918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.703952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.706810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:07.709247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:07.712857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:07.740165 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2ea132f-c77c-4a77-901f-f419d7ac0963 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219274 Aug 29 10:53:07.742685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2140/4276] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:53:07.752722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1382be83-f25a-46bd-9c60-9a45c5a4ea53 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:07.755091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1382be83-f25a-46bd-9c60-9a45c5a4ea53 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:07.878941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1382be83-f25a-46bd-9c60-9a45c5a4ea53 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:07.887036 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1382be83-f25a-46bd-9c60-9a45c5a4ea53 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1209 microversion: 2.1 time: 0.138203 Aug 29 10:53:07.891732 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2141/4277] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:07 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:07.926712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:07.942901 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-634d7962-26bc-4877-bffc-37539fc32334 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.269054 Aug 29 10:53:07.943661 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2137/4278] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:07 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:08.393682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ee018a5-6976-4175-8e74-5627ddee5e53"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:08.397151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:08.405138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.405960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.406560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.407527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.408487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.409078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.697610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:08.699233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:08.710982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.712044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.717241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.718301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.719030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.721236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.908339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:08.919500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:08.920953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:08.922338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48f0bbf4-e96a-49c4-8010-e7317bbf63bd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.231170 Aug 29 10:53:08.927663 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2138/4279] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:08 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:08.932974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:08.933611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:08.948611 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1fa5db01-1d68-4cb1-bec1-33205a0c7f1b tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "POST /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561848 Aug 29 10:53:08.951462 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2142/4280] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:53:08 2022] POST /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:08.974213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:08.975162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:08.990607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.991772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.994156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.995305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.996153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:08.996661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.997101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:08.997627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:08.999420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.002032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.002671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.004363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.350452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:09.358616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eed0049f-bd23-4b37-93b0-b64b40d3eaf8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1205 microversion: 2.1 time: 0.429716 Aug 29 10:53:09.359209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2139/4281] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:08 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1205 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:09.454598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:09.455163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:09.471926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.474061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.475155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.478001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.478676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.479251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.534076 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce HTTP/1.1 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '2160409c-7aa8-4ab1-9792-03332db107ce'} Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:09.539138 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.543670 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.545668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:09.546720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99361f35-7c94-41f6-93f4-91d0bc852b1c tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 404 len: 111 microversion: 2.1 time: 0.100501 Aug 29 10:53:09.547743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2140/4282] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:09 2022] DELETE /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:09.555973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:09.556783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 2160409c-7aa8-4ab1-9792-03332db107ce] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:09.558715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:09.566681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.567344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.568521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.568771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-759d0a51-323a-4352-a53d-2dd64137630f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.606349 Aug 29 10:53:09.569611 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2143/4283] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:08 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:09.570027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.570642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.571268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.588817 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce HTTP/1.1 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '2160409c-7aa8-4ab1-9792-03332db107ce'} Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.591429 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. Aug 29 10:53:09.595097 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.596631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 2160409c-7aa8-4ab1-9792-03332db107ce could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:09.597864 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-76c8d9aa-241a-4cb0-bd7f-af8a68c60afa tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce" status: 404 len: 111 microversion: 2.1 time: 0.045925 Aug 29 10:53:09.598914 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2141/4284] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:09 2022] GET /compute/v2.1/servers/2160409c-7aa8-4ab1-9792-03332db107ce => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:09.608292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:09.609045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:09.620524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.621859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.622471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.623496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.624174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.625230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.642886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 HTTP/1.1 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7c3313ba-d1ce-4503-9526-ee9a28a5ba59'} Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:09.644993 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.648538 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.653255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:09.655359 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56c62ae7-8dfe-4088-a220-758210d56ab4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 404 len: 111 microversion: 2.1 time: 0.051319 Aug 29 10:53:09.660313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2144/4285] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:09 2022] DELETE /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:09.665411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:09.666427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] [instance: 7c3313ba-d1ce-4503-9526-ee9a28a5ba59] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:09.678288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.679598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.681220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.683883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.685889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.686960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.731545 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] HTTP exception thrown: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Request method failure captured: Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 HTTP/1.1 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJocLMKLHwIE-rj3W8VBYAIoU2zIFGDwuq-i8CzvdgJzRJzqxzfruPl6JkckZ6MfODOQV75z-nskK0yiYwBvmjXpUbLaLNWmIDS5qqCYsiY_t6XLNFZJKqcF1Nm3-lQt67XxZeOZjVsr2QU9nF1kq0UiVGDlmC5ZB_6SJIwFRe5zZXw Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1518e676de64458995ffaed9b3331908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1518e676de64458995ffaed9b3331908"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1518e676de64458995ffaed9b3331908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 1518e676de64458995ffaed9b3331908 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestMultiNic-589268138 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4c8f757924d14388b749d5ec9e9ace58 Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestMultiNic-589268138-project Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7c3313ba-d1ce-4503-9526-ee9a28a5ba59'} Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:09.735173 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. Aug 29 10:53:09.739143 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:09.746147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] Returning 404 to user: Instance 7c3313ba-d1ce-4503-9526-ee9a28a5ba59 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:09.750100 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e27df3ef-2ba2-47dd-8a24-0357a1f573d4 tempest-ServersTestMultiNic-589268138 tempest-ServersTestMultiNic-589268138-project] 10.222.0.47 "GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59" status: 404 len: 111 microversion: 2.1 time: 0.086647 Aug 29 10:53:09.751442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2142/4286] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:09 2022] GET /compute/v2.1/servers/7c3313ba-d1ce-4503-9526-ee9a28a5ba59 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:53:09.949395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:09.950232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:09.967162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.970035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.972189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:09.973220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:09.977325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:09.978076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:10.137567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b980d711-fd13-4285-8ee6-23599482ab10", "name": "network-vif-plugged", "status": "completed", "tag": "5bfdccf5-c446-4730-8e8f-cf0f867c5a1d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:10.159417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:10.168315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:10.168920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:10.199176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] Creating event network-vif-plugged:5bfdccf5-c446-4730-8e8f-cf0f867c5a1d for instance b980d711-fd13-4285-8ee6-23599482ab10 on n-h1-854121-10 Aug 29 10:53:10.214541 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-db47f3be-8862-4fc8-95c3-3f36dde3c549 req-bfcbeb81-f6e3-4efe-bcab-ea43313e1064 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075999 Aug 29 10:53:10.216009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2143/4287] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:10.328072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:10.346145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:10.348008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:10.350606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f6d23bb-70d1-4e5c-a1ad-909bc14c7eaa tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.406023 Aug 29 10:53:10.355298 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2145/4288] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:09 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:10.385619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:10.386848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:10.394925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:10.395704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:10.396286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:10.397759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:10.398373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:10.399065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:10.589823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:10.595709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:10.596637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:10.602323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5e6f62e-b888-4922-8ab1-2f742e748844 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1267 microversion: 2.1 time: 0.222537 Aug 29 10:53:10.603588 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2144/4289] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:10 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:10.612540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:10.614777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:10.615505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:10.617825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:10.620436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:10.622275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:11.108305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:11.124287 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32e34b16-3ff6-4c2c-8ba2-fb8f40510147 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1360 microversion: 2.1 time: 0.537914 Aug 29 10:53:11.130002 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2146/4290] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:10 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1360 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:11.381322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:11.382284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:11.392106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:11.392752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:11.393207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:11.396743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:11.398611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:11.399705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:11.628117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:11.628736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:11.645689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:11.646545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:11.647010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:11.649836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:11.651617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:11.652218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:11.788685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:11.804056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:11.805625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:11.807040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58d724fb-5636-465d-a5ea-0f150a8577e8 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.430458 Aug 29 10:53:11.823952 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2145/4291] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:11 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:12.157842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:12.158717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:12.169408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:12.172270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:12.172927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:12.173879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:12.183278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:12.183992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:12.250811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:12.264822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c183d27a-61e5-4525-a366-61ef586e1e51 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.641201 Aug 29 10:53:12.281014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2147/4292] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:11 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:12.834560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:12.835550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:12.850753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:12.854410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:12.857098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:12.860352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:12.862256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:12.863220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.102489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:13.117928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:13.121080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:13.126175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a1ab569-5bff-4366-8c84-eebce96975ba tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.297490 Aug 29 10:53:13.127522 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2148/4293] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:12 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:13.143214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1", "tag": "e87836d6-323a-4806-9a68-e0969427790e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:13.156796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:13.164877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:13.167474 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-258160bb-8dd8-43be-8805-aa03c04bf64d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1545 microversion: 2.1 time: 1.014522 Aug 29 10:53:13.168381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:13.168844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.174705 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2146/4294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:12 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1545 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:13.203317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:13.204168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:13.205525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] Creating event network-changed:e87836d6-323a-4806-9a68-e0969427790e for instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 on n-h1-854121-10 Aug 29 10:53:13.216645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:13.223719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-30f73e66-493c-4163-b351-711ef942664a req-1d9e532b-183a-444b-b956-b217bcdfdf76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091056 Aug 29 10:53:13.224561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:13.224735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2149/4295] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:13.225268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.226354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:13.228227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:13.232939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.292022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:13.292748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:13.314172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:13.316055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:13.316668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.319217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:13.322138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:13.323436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:13.844663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0171da5f-881b-48ef-adc3-b5e0d7e2fbc8 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.651153 Aug 29 10:53:13.845411 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2147/4296] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:53:13 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-interface => generated 284 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:14.156490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:14.157122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:14.170864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:14.176316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:14.176911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:14.177681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:14.180183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:14.181050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:14.273110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:14.281282 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7481079f-088a-4af2-ba3d-f2fab9b887ef tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.994294 Aug 29 10:53:14.289378 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2150/4297] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:13 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:14.406579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:14.421214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:14.426271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:14.427820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1996279-b7bf-4caa-8a82-15ccfa987f43 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.277849 Aug 29 10:53:14.428560 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2148/4298] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:14 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:15.314609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:15.315323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:15.328877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:15.329483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:15.329959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:15.330662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:15.331112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:15.331799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:15.453009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:15.453947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:15.470352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:15.470920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:15.471373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:15.474656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:15.474906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:15.478634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:15.516179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:15.984741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:16.000523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:16.006178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:16.007575 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aaa91aa0-d781-4866-b721-8d9774106a6c tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.560460 Aug 29 10:53:16.011022 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2149/4299] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:15 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:17.000957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:17.017751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4734fef2-f9d0-4a53-8627-bb5a82d3facb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 1.705763 Aug 29 10:53:17.022791 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2151/4300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:15 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:17.043904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:17.045103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:17.068080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:17.068584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:17.069206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:17.070160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:17.070792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:17.071403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:17.440445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:17.459286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:17.460736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:17.466232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f47f3a42-78cc-4066-a256-38ee42ffe038 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.427532 Aug 29 10:53:17.467042 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2150/4301] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:17 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:17.647439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b980d711-fd13-4285-8ee6-23599482ab10", "tag": "5bfdccf5-c446-4730-8e8f-cf0f867c5a1d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:17.663260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:17.673448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:17.680892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:17.683768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:17.715046 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] Creating event network-changed:5bfdccf5-c446-4730-8e8f-cf0f867c5a1d for instance b980d711-fd13-4285-8ee6-23599482ab10 on n-h1-854121-10 Aug 29 10:53:17.727874 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c78ba568-72e8-4476-bc48-efcbedd14f60 req-ec501c93-7338-41bd-be54-1ef60663df70 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086222 Aug 29 10:53:17.730329 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2152/4302] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:18.045346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:18.046119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:18.058617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:18.059113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:18.059549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:18.060264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:18.064525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:18.065054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:18.491730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:18.500983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:18.503911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:18.527574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:18.527574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:18.527995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:18.530085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:18.531372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:18.532257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:18.697756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:18.698012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:18.730930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:18.733522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1869bc4e-ad6a-4c14-865d-d3367e2f52be tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.693117 Aug 29 10:53:18.737888 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2151/4303] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:18 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:18.739514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:18.741002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a937fc20-2233-4829-9a9b-5839c74e6155 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.250711 Aug 29 10:53:18.741839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2153/4304] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:18 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:19.762793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:19.764136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:19.772823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:19.774113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:19.785602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:19.793921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:19.795575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:19.795697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:19.796164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:19.796931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:19.797401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:19.797851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:19.798570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:19.800412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:19.801368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:19.802188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:19.964062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:19.982956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:19.989494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:19.991231 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8c9f23c-e9f1-49cf-9b4e-16c04fd50b2e tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.222972 Aug 29 10:53:19.996785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2154/4305] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:19 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:20.351224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:20.359289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd4ef266-57a2-4314-92ff-583573a6e479 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.601049 Aug 29 10:53:20.373860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2152/4306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:19 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:21.028161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:21.030574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:21.040139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:21.042417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:21.043102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:21.046367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:21.048807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:21.049615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:21.271487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:21.284923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:21.302961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:21.304584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:21.311666 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7023eb0-c269-4fb6-ae74-b8cf3c76d349 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.290073 Aug 29 10:53:21.312325 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2155/4307] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:21 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:21.381061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:21.382550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:21.396439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:21.397185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:21.397923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:21.398944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:21.402962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:21.404754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:21.811340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:21.824529 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec26328a-f70b-4620-88d2-e8a9f92063d3 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.447576 Aug 29 10:53:21.825022 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2153/4308] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:21 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:22.081508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1", "name": "network-vif-plugged", "status": "completed", "tag": "e87836d6-323a-4806-9a68-e0969427790e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:22.112571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:22.117387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:22.117975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:22.143948 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] Creating event network-vif-plugged:e87836d6-323a-4806-9a68-e0969427790e for instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 on n-h1-854121-10 Aug 29 10:53:22.158381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-75e5ffc8-e65b-4575-8efc-27453286d570 req-459f9477-1e28-49c2-a847-74145347fec4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087238 Aug 29 10:53:22.159297 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2156/4309] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:22.339173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:22.339806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:22.350897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:22.351423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:22.351848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:22.356928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:22.357633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:22.358337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:22.489045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:22.504125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:22.506944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:22.513287 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9d4e798-f230-4078-a3da-97e5f8e51236 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.179299 Aug 29 10:53:22.523607 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2154/4310] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:22 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:22.852558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:22.854887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:22.863081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:22.863777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:22.864374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:22.865379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:22.866020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:22.866594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:23.046257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-874101625", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d8a78c7a-611e-44ec-a1af-d83f6ec3d915"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:23.091361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:23.105485 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b28d43bb-68d1-4e79-a563-4a4b3f162eed tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.258357 Aug 29 10:53:23.106913 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2155/4311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:22 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:23.142458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] validate_networks() for [('d8a78c7a-611e-44ec-a1af-d83f6ec3d915', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:53:23.543799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:23.545074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:23.553263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:23.554210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:23.554880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:23.555993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:23.557430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:23.558301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:23.753068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:23.763549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:23.765162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:23.766391 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e36fe4e6-0e8b-4f6f-a4ca-c15f20b2a132 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.229893 Aug 29 10:53:23.794845 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2156/4312] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:23 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:23.815117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:53:23.815541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:53:23.816022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:53:23.816436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:53:23.816992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:53:23.827312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:23.827806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:23.828666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:23.829649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:23.830216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:23.830643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:23.854463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Getting quotas for project c11d48411b624c2184b8b98c1ee50767. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:53:23.861171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Getting quotas for user 5e30439e323d4d10b10aa6048b3743cd and project c11d48411b624c2184b8b98c1ee50767. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:53:23.877424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Going to run 3 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:53:23.880882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:23.931356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=5b811fa3-bdae-4b01-8337-ecf42a0cffd8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:23.996070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=c0f40244-d142-4499-a099-08702a46bd87,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:24.117379 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed3b35cc-4c6b-4372-9124-616feb1260a0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295223 Aug 29 10:53:24.129906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:24.130675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:24.131357 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2157/4313] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:53:24.138329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.140783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:24.143821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.144500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.145591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.147153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.148008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.188090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.190652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:53:24.235070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.236040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.236843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.237863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.238851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.239483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.276217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0239cd9b-583b-4d8d-aa71-bef80c32644c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.139390 Aug 29 10:53:24.284005 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2158/4314] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:53:24 2022] GET /compute/v2.1/servers => generated 1015 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:24.289950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8221274e-05c6-4059-b145-cc5661320b2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:24.290831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8221274e-05c6-4059-b145-cc5661320b2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:24.408803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8221274e-05c6-4059-b145-cc5661320b2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.419331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8221274e-05c6-4059-b145-cc5661320b2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1222 microversion: 2.1 time: 0.134013 Aug 29 10:53:24.434405 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2159/4315] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:24 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:24.533298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.563561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-696cf0de-b2e7-4b4a-abd6-e9df2af7afa5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1309 microversion: 2.1 time: 0.437485 Aug 29 10:53:24.580126 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2157/4316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:24 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1309 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:24.814634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:24.815262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:24.823941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:24.827963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.828474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.830595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.833897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:24.834391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:24.834853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:24.969482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.975495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:24.976299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:24.988024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.989861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:24.993674 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9578d6df-97f5-4037-bdd4-2a35bef5b107 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.187086 Aug 29 10:53:24.995117 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2160/4317] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:24 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:25.015942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.016554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.017134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.018715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.019192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.019631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.236668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'services' on Instance uuid 6a048117-3050-4f21-b0ac-1dc689a5f63f {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:53:25.412491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0df2b1cf-e10a-43d8-9c58-7e2d60e17687 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments/7ee018a5-6976-4175-8e74-5627ddee5e53" status: 202 len: 0 microversion: 2.1 time: 0.441832 Aug 29 10:53:25.413178 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2158/4318] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:53:24 2022] DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments/7ee018a5-6976-4175-8e74-5627ddee5e53 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:53:25.426977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:25.430399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:25.455086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e50bdf2f-9056-4868-9e1d-2623ec813921 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:25.459018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e50bdf2f-9056-4868-9e1d-2623ec813921 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:25.474178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.474671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.477612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.481789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.482451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.485269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.574290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3fe88b37-9f9e-4a8a-ac95-cc9167a92560 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153635 Aug 29 10:53:25.575371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2161/4319] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:25 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:25.591490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:25.592616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:25.601866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.602750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.603990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.605050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:25.605522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e50bdf2f-9056-4868-9e1d-2623ec813921 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:25.606155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:25.607283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:25.618011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e50bdf2f-9056-4868-9e1d-2623ec813921 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1222 microversion: 2.1 time: 0.173964 Aug 29 10:53:25.618612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2159/4320] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:25 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:25.869254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:25.882043 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86c54717-24e7-4c3d-ba39-3313a39d0997 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1490 microversion: 2.1 time: 0.297652 Aug 29 10:53:25.900950 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2162/4321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:25 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1490 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:26.020179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:26.021154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:26.046285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1503076707", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:26.059600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.060477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.063171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.065366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.066736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.067388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.159000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:53:26.278704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:26.294574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:26.305043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:26.308125 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a093a333-bc79-467a-af49-bf948024d3a9 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.292815 Aug 29 10:53:26.311128 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2160/4322] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:26 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:26.589043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:26.591659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:26.625558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.627570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.628164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.630494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.631109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.632619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.789209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db81b915-9a37-4f2c-b553-8b25dc422fbc tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205760 Aug 29 10:53:26.797054 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2161/4323] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:26 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:26.813880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:26.814943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:26.822705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.830963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.831765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.832873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:26.833469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:26.833992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:26.995341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:27.007762 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7ddbf94-e59a-4b37-94b0-33304a9419d4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1274 microversion: 2.1 time: 0.209476 Aug 29 10:53:27.009235 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2162/4324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:26 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:27.127436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:53:27.128375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:53:27.129335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:53:27.129952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:53:27.130550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:53:27.148077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.151686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.152979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:27.154503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.162770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.163475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:27.196881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:53:27.203893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:53:27.221848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:53:27.226381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:27.285558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6f31c752-9df3-46f4-8265-4a22219ab86f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245740 Aug 29 10:53:27.286917 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2163/4325] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:53:27.302847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-baa19c74-54ca-4cbe-b23b-1490a6bbb26e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:27.310600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-baa19c74-54ca-4cbe-b23b-1490a6bbb26e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:27.333672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:27.334466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:27.346743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.349099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.350525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:27.351250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.356414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.357411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:27.409601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-baa19c74-54ca-4cbe-b23b-1490a6bbb26e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:27.437597 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-baa19c74-54ca-4cbe-b23b-1490a6bbb26e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1209 microversion: 2.1 time: 0.142575 Aug 29 10:53:27.455841 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2163/4326] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:27 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1209 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:27.531374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:27.544626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:27.548358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:27.552056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8959c8dc-f3a7-40b8-bb84-05256e5f3a99 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.223175 Aug 29 10:53:27.557549 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2164/4327] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:27 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:27.809238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:27.811733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:27.868114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.869423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.880964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:27.885764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:27.897474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:27.910137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:28.024502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-815f6122-8e7c-47eb-a3b1-da3cdacdfc8c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219992 Aug 29 10:53:28.025968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2164/4328] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:27 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:28.041911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:28.042797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:28.061234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:28.063514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:28.065785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:28.068597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:28.069240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:28.090291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:28.280563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:28.289030 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96f4c268-31f1-416e-ab2a-f07e087377e3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1274 microversion: 2.1 time: 0.254321 Aug 29 10:53:28.300498 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2165/4329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:28 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:28.467969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9210b415-4760-48bf-b252-79a528173146 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:28.472714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9210b415-4760-48bf-b252-79a528173146 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:28.580719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:28.581913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:28.607204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:28.607898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:28.608790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:28.610124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:28.610725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:28.611260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:28.635133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9210b415-4760-48bf-b252-79a528173146 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:28.653865 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9210b415-4760-48bf-b252-79a528173146 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1209 microversion: 2.1 time: 0.191509 Aug 29 10:53:28.668175 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2165/4330] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:28 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:28.743535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:28.762475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:28.764777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:28.770176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f648a484-5561-4c32-96c3-eb72a6561253 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.193384 Aug 29 10:53:28.773171 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2166/4331] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:28 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:29.039117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:29.043087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:29.071000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.071806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.076356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.077421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.078590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.080132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.131591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bfaff6b4-22fc-4f8b-bb59-1bac7b83a893 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098817 Aug 29 10:53:29.136661 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2166/4332] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:29 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:29.311578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:29.312188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:29.324736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.328007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.329372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.330347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.332002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.333307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.522056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:29.531915 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2c3be3b-58ba-4a3f-8b5d-4de0e22f3d91 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1280 microversion: 2.1 time: 0.224531 Aug 29 10:53:29.534925 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2167/4333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:29 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:29.680621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:29.682709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:29.699914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.700437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.701352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.702192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.702881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.710472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.800582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:29.801257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:29.812012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.814376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.814989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.822505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:29.823300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:29.823954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:29.857786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:29.877799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ec831b5-bb31-4907-bd38-3ceb6e4df9d4 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1261 microversion: 2.1 time: 0.200931 Aug 29 10:53:29.878473 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2167/4334] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:29 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:29.956023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:29.966695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:29.968226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:29.969480 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44696239-6670-429e-b665-680afe333b40 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1409 microversion: 2.54 time: 0.172961 Aug 29 10:53:29.994674 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2168/4335] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:29 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1409 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:30.161270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:30.171410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:30.189026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.189540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.190032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:30.190708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.191171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.198121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:30.252800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:30.299350 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7bbf756d-158e-47b8-8b38-f4ccff6ee574 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151547 Aug 29 10:53:30.308052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2168/4336] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:30 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:30.557036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:30.557709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:30.567867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.568355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.570237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:30.571118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.578612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.579377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:30.716503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:30.730048 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c72e3cf4-450a-4a14-80a8-cffda270620d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1280 microversion: 2.1 time: 0.173407 Aug 29 10:53:30.731962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2169/4337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:30 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:30.903870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:30.904856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:30.930789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.931712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.932625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:30.933649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:30.934474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:30.938273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.021942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:31.022823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:31.040494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.041059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.041533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.042252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.048880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.052595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.083865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:31.093659 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68956e9d-6151-49a5-86c8-7eef7999d537 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1261 microversion: 2.1 time: 0.196704 Aug 29 10:53:31.100920 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2169/4338] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:30 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:31.173842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:31.186364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:31.188294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:31.189741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b4e0ef26-0d35-458c-abf8-1b3471f34546 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1427 microversion: 2.54 time: 0.173046 Aug 29 10:53:31.190947 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2170/4339] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:31 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:31.314742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:31.317581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:31.329565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.333573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.334255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.335214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.336034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.338988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.405981 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca3b65e5-3fb8-417d-a190-87672b6488e3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096598 Aug 29 10:53:31.412951 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2170/4340] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:31 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:31.752444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:31.753078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:31.759569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.760236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.760737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.761416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:31.771428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:31.772231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:31.875587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:31.886629 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b94647a-c7ee-40c8-a39e-8d6c60854293 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1280 microversion: 2.1 time: 0.138503 Aug 29 10:53:31.887752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2171/4341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:31 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1280 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:32.127457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:32.128238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:32.136896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.141800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.142236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.143039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.143575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.144078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.222651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:32.223679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:32.235828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.236992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.237725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.238950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.241190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.244754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:32.251406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.259232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-459abde8-a3e0-4956-9b4d-9cbd70c1cc9f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1279 microversion: 2.1 time: 0.135845 Aug 29 10:53:32.267603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2171/4342] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:32 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:32.426975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:32.429656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:32.445085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.450792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.451524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.452431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.453043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.453622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.463753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:32.482867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:32.484532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:32.485798 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7e81afd-3609-44ba-bf15-d8c22601f814 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1415 microversion: 2.54 time: 0.270794 Aug 29 10:53:32.486371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2172/4343] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:32 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1415 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:32.508653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-826d7a1b-a1ed-434f-8f19-b33a7befb67e tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086256 Aug 29 10:53:32.510495 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2172/4344] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:32 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:32.908560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:32.909897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:32.933036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.935263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.938827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:32.939784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:32.940400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:32.943838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:33.290001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:33.290812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:33.303304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:33.304608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:33.305288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:33.307618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:33.308261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:33.311676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:33.854873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:33.864851 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f157008d-0ff7-4ddd-a5d2-d71bdcca4fa0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1280 microversion: 2.1 time: 0.960996 Aug 29 10:53:33.866142 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2173/4345] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:32 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1280 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:33.888596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:33.889473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:33.906270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:33.907777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:33.908458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:33.909418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:33.911651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:33.916132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.014661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:34.029398 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f5ba6c4-3742-48fa-b1c8-b992265713a9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1267 microversion: 2.1 time: 0.742495 Aug 29 10:53:34.030060 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2173/4346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:33 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1267 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:34.041586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.047893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:34.078210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.080305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.081474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.084761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.085466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.086744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.146540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:34.163328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3686d591-8686-4c85-8c72-72b4ed760f6d tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131444 Aug 29 10:53:34.168148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:34.169039 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2174/4347] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:53:34 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:53:34.174621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:34.176043 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ce4b3e7-8327-4994-b969-13a3d16f51b0 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1400 microversion: 2.54 time: 0.308559 Aug 29 10:53:34.178493 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2174/4348] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:33 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1400 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:34.205165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff99b8af-3ce2-4fa5-984b-433fd9d0a97b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '.version_select at 0x7f66c5bce940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.254205 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff99b8af-3ce2-4fa5-984b-433fd9d0a97b tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1573165307" status: 204 len: 0 microversion: 2.54 time: 0.053281 Aug 29 10:53:34.255133 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2175/4349] 10.222.0.47 () {60 vars in 1319 bytes} [Mon Aug 29 10:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1573165307 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:53:34.273413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.279589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:34.287302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.298276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.303660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.305837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.307077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.311300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.326909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.328134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:34.359754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.360405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.361022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.362486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.374204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.374954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.405070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:53:34.446253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:53:34.474358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:34.600680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:34.622954 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd4ef760-f99f-434e-9501-eae9bdcd09c5 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 204 len: 0 microversion: 2.1 time: 0.299677 Aug 29 10:53:34.623602 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2176/4350] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:34 2022] DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:53:34.632582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.637003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:34.651565 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62097fbf-855b-459a-917e-9248c5c6f837 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 204 len: 0 microversion: 2.54 time: 0.380987 Aug 29 10:53:34.652366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.652586 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2175/4351] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:53:34 2022] DELETE /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:53:34.653160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.653814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.654667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.655426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.656042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.664146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:34.664873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:34.685051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.685559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.686030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:34.686747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:34.693954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:34.694615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.092129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.109887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.111529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.112727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53ba2eb0-67a1-44c0-a3da-99d40381298a tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1406 microversion: 2.54 time: 0.455513 Aug 29 10:53:35.113810 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2176/4352] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:34 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:35.132728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f40244-d142-4499-a099-08702a46bd87", "tag": "032da6fb-024c-4594-ac75-1a09b07aede7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:35.154015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:35.154509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:35.155410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.176861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] Creating event network-changed:032da6fb-024c-4594-ac75-1a09b07aede7 for instance c0f40244-d142-4499-a099-08702a46bd87 on n-h1-854121-10 Aug 29 10:53:35.193345 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-34ab2e20-ecc2-427f-996b-a44bbb127363 req-2eab524b-7239-4929-a444-2baf0b92c52a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076968 Aug 29 10:53:35.196204 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2177/4353] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:35.205645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:35.207715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:35.221498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:35.222565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:35.223276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.224217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:35.224870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:35.225522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.420458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.430590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38f77620-b153-4ad3-ba43-2df5b2a91aa3 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1681 microversion: 2.1 time: 0.802357 Aug 29 10:53:35.433296 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2177/4354] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:34 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1681 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:35.438134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:35.443239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:35.463096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:35.464004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:35.464618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.465387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:35.465875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:35.466303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:35.717431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.725558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e966c257-82e0-4a3d-b610-4ab883e2a325 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.525820 Aug 29 10:53:35.731445 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2178/4355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:35 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:35.888241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:35.898706 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01bf5034-9417-4ee2-94fa-5ffd1e6836b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.463905 Aug 29 10:53:35.914963 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2178/4356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:35 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:36.140726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:36.142357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:36.155551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.156306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.156893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:36.157962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.158567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.161371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:36.360987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:36.379532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:36.383315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:36.386466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e54fbbc-2445-449d-88a7-c8afd39c9ddd tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1406 microversion: 2.54 time: 0.249422 Aug 29 10:53:36.388221 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2179/4357] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:36 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:36.457154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:36.458713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:36.469350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.477161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.478054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:36.478972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.479660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.480319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:36.748064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:36.748689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:36.755260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.755761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.756198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:36.756907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:36.768964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:36.769644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.061828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.073678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-59819417-3aac-49be-97e7-617c4a5f7be0 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1681 microversion: 2.1 time: 0.620714 Aug 29 10:53:37.076465 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2179/4358] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:36 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1681 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:37.094020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:37.095117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:37.107537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.108401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.116173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.118595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.119354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.132627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.171053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:37.214587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.217829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:37.250491 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7a5efd17-7923-4ae0-9128-448144ccd0fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.495926 Aug 29 10:53:37.251384 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2180/4359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:36 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:37.263388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d8be8b-7e45-4c98-b621-f1186134a809", "tag": "9e7dc640-4e55-484a-b759-bd3b2fc70bbd"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:37.300309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.301089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.301722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.347207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] Creating event network-changed:9e7dc640-4e55-484a-b759-bd3b2fc70bbd for instance 02d8be8b-7e45-4c98-b621-f1186134a809 on n-h1-854121-10 Aug 29 10:53:37.363538 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a33c5496-6827-4e0d-8eef-b8f33c02f877 req-f2cba6fc-7726-4be7-928e-fd0595f730a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110654 Aug 29 10:53:37.364948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2181/4360] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:37.376228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b811fa3-bdae-4b01-8337-ecf42a0cffd8", "tag": "a36e1ed2-40af-40fb-9de5-1ceae5620ce5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:37.397832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.402702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.403313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.421227 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] Creating event network-changed:a36e1ed2-40af-40fb-9de5-1ceae5620ce5 for instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 on n-h1-854121-10 Aug 29 10:53:37.440403 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0f9754c4-7a1d-4316-a642-f28711083a52 req-66a10d56-340c-419c-9b41-cd40e0ff8f0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073989 Aug 29 10:53:37.441427 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2182/4361] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:37.449335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:37.456439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.457711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:37.467421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.468794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.469975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.471376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:37.472493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9f252acc-5c9d-46e0-8e74-ff7f15a39be2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.385351 Aug 29 10:53:37.473452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2180/4362] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:37 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:37.474188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:37.482777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:37.636972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.653587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.656177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:37.660640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15949b29-58d9-42ac-aa6e-6d4555100faf tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1406 microversion: 2.54 time: 0.217795 Aug 29 10:53:37.661252 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2183/4363] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:37 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:38.098332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:38.099111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:38.107400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.108062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.108747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.109527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.110111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.110627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.275865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:38.277117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:38.284133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.284815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.285408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.286371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.286969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.287699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.565651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.575106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d95a789-d73b-4296-a8fa-1bd9fcae178c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1681 microversion: 2.1 time: 0.482371 Aug 29 10:53:38.579690 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2181/4364] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:38 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:38.586102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:38.587351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:38.595182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.595898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.596378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.597287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.597937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.598381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.643468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.650110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:38.661611 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7b275a1-9f63-4f0d-b4e7-5fbd76e0580e tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.390048 Aug 29 10:53:38.663155 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2184/4365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:38 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:38.704682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:38.706336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:38.720724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.722042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.722834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.723917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:38.724676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:38.725503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:38.807154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.819705 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32d36420-d76f-4cf4-b966-c1f23eb5a468 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.237439 Aug 29 10:53:38.827359 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2182/4366] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:38 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:38.843756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.858913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.861345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:38.865040 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18317adb-3ce5-4d99-9ba5-3da5a0c1eb98 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1406 microversion: 2.54 time: 0.177382 Aug 29 10:53:38.868601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2185/4367] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:38 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:39.070366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1593136640", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "b56dd048-f320-4530-9db7-0598f341bc89"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:39.131284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] validate_networks() for [('b56dd048-f320-4530-9db7-0598f341bc89', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:53:39.504231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602ae28a-a632-4d0f-85f0-35ad75cc2924", "tag": "c8d30663-8865-487d-8016-75fbd95295a3"}, {"server_uuid": "6a048117-3050-4f21-b0ac-1dc689a5f63f", "name": "network-vif-deleted", "tag": "3979b77b-0754-46e8-9833-253cfe5e2b9a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:39.535022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:39.539206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:39.539911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:39.577585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Creating event network-changed:c8d30663-8865-487d-8016-75fbd95295a3 for instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 on n-h1-854121-10 Aug 29 10:53:39.580001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] Creating event network-vif-deleted:3979b77b-0754-46e8-9833-253cfe5e2b9a for instance 6a048117-3050-4f21-b0ac-1dc689a5f63f on n-h1-854121-10 Aug 29 10:53:39.607841 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-95f6c151-be6d-4448-ba05-6287f1754971 req-d6a36f12-9ec1-49ff-8e96-448b93ffade1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108759 Aug 29 10:53:39.620714 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2186/4368] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:39.632854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:39.633594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:39.657365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:39.657957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:39.658408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:39.659140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:39.659605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:39.660087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:39.917236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:39.933242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73cfc0e8-51fa-47f7-97b3-940f320f3c4a tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1326 microversion: 2.1 time: 0.311082 Aug 29 10:53:39.936357 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2187/4369] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:39 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1326 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:39.951817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:39.955483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:39.970675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:39.971376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:39.973032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:39.997012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:39.997685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:39.998349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.412663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:40.424969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30463811-58f3-4772-864f-fe0a9fa9cbf9 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.487474 Aug 29 10:53:40.425565 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2188/4370] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:39 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:40.442064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:40.442602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:40.455327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.455834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.456541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.457256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.457727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.464065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.486224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:53:40.486685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:53:40.487122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:53:40.487537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:53:40.487951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:53:40.503401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.504126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.504739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.506293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.506917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.507507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.557772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Getting quotas for project 014443a3b87642f5877ab945ba000446. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:53:40.566661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Getting quotas for user 073290bf39994eeaa840b9dbccfea517 and project 014443a3b87642f5877ab945ba000446. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:53:40.596464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:53:40.602400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:53:40.729561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-010d4060-8e98-435c-a239-80fd80c1219d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.802782 Aug 29 10:53:40.732173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2183/4371] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:53:40.738867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:40.739820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:40.741436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:40.753221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.753480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.753848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.754558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.757592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.758056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.768703 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebf31563-9265-48e6-9e90-035ea38314db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.342022 Aug 29 10:53:40.769304 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2189/4372] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:40 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:40.782129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:40.788793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:40.869973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.872847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.874308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:40.874906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lazy-loading 'fault' on Instance uuid f94bc313-e591-4a34-9eb0-4bb5ec532abf {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:53:40.928718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:40.941627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:40.943321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:40.952681 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78db2672-933e-4e8c-b9fe-03d3fea5dea1 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1259 microversion: 2.21 time: 0.172862 Aug 29 10:53:40.952681 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2190/4373] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:40 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:40.957953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:40.959665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:40.985564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:40.994856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:40.999145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.000021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.000635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.001181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.016525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:41.021059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:41.030319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:41.039377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c15c40ac8db4c50ba41347915a82713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac59de756c94dbb922eee59ad10ad8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:41.044944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b90502da-5ef2-426c-a5fe-c3f48a4f9595 tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 200 len: 1411 microversion: 2.54 time: 0.311421 Aug 29 10:53:41.046079 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2184/4374] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:40 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 1411 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:41.046358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.047045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.047757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.048315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lazy-loading 'fault' on Instance uuid 6a048117-3050-4f21-b0ac-1dc689a5f63f {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:53:41.114917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90c88821f014e85937cb469aa95e365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2b0b8926be4968a170dcbd81ce371f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:41.121381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7bb5ac7-42d2-4299-99ec-02d759ba25e9 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 200 len: 1331 microversion: 2.1 time: 0.167380 Aug 29 10:53:41.122120 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2191/4375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:40 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:41.446615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:41.447873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:41.455969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.456818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.457665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.458511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.459070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.459713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.648501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:41.657995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a86bfb7-6bd5-4c6a-8ddf-debbc4e626fe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.215653 Aug 29 10:53:41.659182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2185/4376] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:41 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:41.797210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:41.798665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:41.806996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.807873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.808566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.809510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:41.810220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:41.811283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:41.984761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:41.985807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:42.009661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.014032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.015914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.022878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.023644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.029201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.153279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:42.165714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:42.172709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:42.174439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a9551f3-f59a-46fa-87b2-2176bdd06717 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1263 microversion: 2.21 time: 0.198997 Aug 29 10:53:42.191701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2186/4377] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:41 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:42.197349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:42.198073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] [instance: f94bc313-e591-4a34-9eb0-4bb5ec532abf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:42.212380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.213487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.213976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.214702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.215175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.215613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.249936 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] HTTP exception thrown: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Request method failure captured: Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf HTTP/1.1 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJp_PT2XlHRPUXU79c8a6E5EfVQ6nIEkDbLqovftWNCTEf_MrwiEXuKsro74NRSaVocY2FYVuc_7y7coRREtViRl90NeMOGcdlcuNM6hjS8pdsgAiy11B8M2BjySiJdBieUiI_pRWO9Th5oTYb7p1an0vZweWysaJ4qcaWt-Von5SSY Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.54 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 6ac59de756c94dbb922eee59ad10ad8b Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerShowV254Test-310871022 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ac59de756c94dbb922eee59ad10ad8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ac59de756c94dbb922eee59ad10ad8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ac59de756c94dbb922eee59ad10ad8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ac59de756c94dbb922eee59ad10ad8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerShowV254Test-310871022 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 6ac59de756c94dbb922eee59ad10ad8b Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerShowV254Test-310871022 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerShowV254Test-310871022-project Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 9c15c40ac8db4c50ba41347915a82713 Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerShowV254Test-310871022-project Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f94bc313-e591-4a34-9eb0-4bb5ec532abf'} Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:42.276694 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. Aug 29 10:53:42.280544 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.282819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] Returning 404 to user: Instance f94bc313-e591-4a34-9eb0-4bb5ec532abf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:42.283936 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-430342dc-0bc1-4eb8-8a50-32a096aa52be tempest-ServerShowV254Test-310871022 tempest-ServerShowV254Test-310871022-project] 10.222.0.47 "GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf" status: 404 len: 111 microversion: 2.54 time: 0.091093 Aug 29 10:53:42.285082 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2187/4378] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:42 2022] GET /compute/v2.1/servers/f94bc313-e591-4a34-9eb0-4bb5ec532abf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:53:42.295493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:42.297692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:42.322722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.323574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.324411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.325388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.326116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.326765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.360551 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f HTTP/1.1 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6a048117-3050-4f21-b0ac-1dc689a5f63f'} Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:42.364486 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:42.368152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:42.376490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:42.383443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17113cf7-7428-44ee-990a-e2d1fc034732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 404 len: 111 microversion: 2.1 time: 0.096926 Aug 29 10:53:42.387911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2188/4379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:42 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:42.398385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69770e1b-af49-4059-90e0-810347c84c30 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '.version_select at 0x7f66c5bc5ca0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:42.434871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:42.442396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69770e1b-af49-4059-90e0-810347c84c30 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974528955" status: 202 len: 0 microversion: 2.1 time: 0.049114 Aug 29 10:53:42.448751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1534c53e-8b8c-4b10-9f1f-480654d68664 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.656314 Aug 29 10:53:42.449392 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2189/4380] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974528955 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:53:42.450088 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2192/4381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:41 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:42.679416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:42.684366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:42.705610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.711004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.719197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:42.722497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:42.724599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:42.725959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:43.064087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:43.076586 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-564c391f-69d9-4c35-970d-d32b9c79a446 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.401651 Aug 29 10:53:43.077179 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2190/4382] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:42 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:43.202825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:43.203453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:43.229488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:43.236835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:43.240067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:43.241048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:43.245455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:43.246536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:43.463405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:43.474249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:43.475192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:43.485434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:43.488171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:43.489139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:43.491458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:43.492111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:43.493190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:43.502457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:43.504993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:43.506189 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d5225d3-4de9-4bf9-9f38-a6c799245f3b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1311 microversion: 2.21 time: 0.310447 Aug 29 10:53:43.509290 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2193/4383] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:43 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:43.824326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:43.855418 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c82133d5-bb1e-45e7-8e6d-c436f024530e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.387592 Aug 29 10:53:43.870135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2191/4384] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:43 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:44.098703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:44.099318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:44.109108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.110979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.118025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.120107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.120753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.122390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.169955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:44.522756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:44.535814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:44.536437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:44.540197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e8e3e76d-a784-4c3d-8610-6267b48164de tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.443057 Aug 29 10:53:44.542453 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2194/4385] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:44 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:44.553524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.555324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.555790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.561734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.562490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.566118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.746112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:44.756749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:44.762765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:44.765634 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92998a20-7c5f-4ed6-a844-e5ab275ebffb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1311 microversion: 2.21 time: 0.233108 Aug 29 10:53:44.766304 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2192/4386] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:44 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:44.789517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b811fa3-bdae-4b01-8337-ecf42a0cffd8", "name": "network-vif-plugged", "status": "completed", "tag": "a36e1ed2-40af-40fb-9de5-1ceae5620ce5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:44.818396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.820300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.820847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.870405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] Creating event network-vif-plugged:a36e1ed2-40af-40fb-9de5-1ceae5620ce5 for instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 on n-h1-854121-10 Aug 29 10:53:44.891082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:44.892114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-869b7e9d-3fae-44d3-b8b0-3905c1b5886f req-bbc26d15-6c68-4205-a831-9bfa476ea08a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105599 Aug 29 10:53:44.892356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:44.894385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2195/4387] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:44.910078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.910689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.911010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:44.916862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:44.917362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:44.917847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:45.244238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:45.255784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-194142bc-cd65-4627-bbb8-f436999108c0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.365914 Aug 29 10:53:45.258480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2193/4388] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:44 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:45.564094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:45.564711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:45.572778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:45.573265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:45.573730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:45.586707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:45.589057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:45.589547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:45.624949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-737e58ec-877e-4ffe-9627-e6bc3bc8f2b1 tempest-ExtensionsTest-830444023 tempest-ExtensionsTest-830444023-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:45.629615 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-737e58ec-877e-4ffe-9627-e6bc3bc8f2b1 tempest-ExtensionsTest-830444023 tempest-ExtensionsTest-830444023-project] 10.222.0.47 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.251660 Aug 29 10:53:45.632046 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2196/4389] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:53:45 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:45.642329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38414de0-2c0f-4b5e-b7b5-c6cf818978c0 tempest-ExtensionsTest-830444023 tempest-ExtensionsTest-830444023-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:45.644901 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38414de0-2c0f-4b5e-b7b5-c6cf818978c0 tempest-ExtensionsTest-830444023 tempest-ExtensionsTest-830444023-project] 10.222.0.47 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006933 Aug 29 10:53:45.647625 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2197/4390] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 29 10:53:45 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:53:45.788413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:45.789400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:45.806060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:45.806990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:45.807872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:45.810451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:45.813129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:45.814112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:46.049747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:46.078420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:46.082281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:46.092161 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2dc5c80-5cec-44ed-8d87-810283c3eb8e tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1329 microversion: 2.21 time: 0.307736 Aug 29 10:53:46.096437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2198/4391] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:45 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1329 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:46.238524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:46.248155 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-807fee3a-6244-4cd0-85a2-be4023b0d0fc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.687808 Aug 29 10:53:46.249938 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2194/4392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:45 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:46.277192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:46.278198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:46.292812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:46.295732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:46.296489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:46.298401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:46.301577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:46.302566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:46.670804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:46.685193 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51425aaf-0966-436c-9430-1e2efa5dad3d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.411475 Aug 29 10:53:46.687921 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2199/4393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:46 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:47.122743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:47.123363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:47.135538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.136418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.136939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:47.138340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.141928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.142645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:47.278466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:47.278466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:47.283015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:47.299590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.300191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.300649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:47.303222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.304929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.305398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:47.380683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:47.392932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:47.397577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:47.401183 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-774fb18e-4590-4b9c-a297-c05a8c92acdc tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1317 microversion: 2.21 time: 0.281337 Aug 29 10:53:47.417036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2195/4394] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:47 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:47.624924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:47.637647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6896856f-1be8-4a56-8a2f-e0a42c6effeb tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.368568 Aug 29 10:53:47.638457 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2200/4395] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:47 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:47.710026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:47.710756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:47.722108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.722865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.723495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:47.726432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:47.730011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:47.730724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:48.375625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:48.401855 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d83638fd-3158-4678-bf9e-541b66f31e46 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.695871 Aug 29 10:53:48.408626 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2196/4396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:47 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:48.426029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:48.427109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:48.440715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:48.443228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:48.457331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:48.458315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:48.458814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:48.459263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:48.658263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:48.658964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:48.668360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:48.669417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:48.669894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:48.670620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:48.671094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:48.675100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:48.995882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:49.007102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:49.008844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:49.011181 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28a32bc5-b94d-47e8-88bc-150978f628ab tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.590417 Aug 29 10:53:49.012219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:49.013095 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2201/4397] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:48 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:49.019128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f40244-d142-4499-a099-08702a46bd87", "name": "network-vif-plugged", "status": "completed", "tag": "032da6fb-024c-4594-ac75-1a09b07aede7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:49.020279 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4c06908-60c5-4769-ab56-fc47d5629c2d tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.366183 Aug 29 10:53:49.021159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2197/4398] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:48 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:49.030367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.031180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.031686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.043717 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] Creating event network-vif-plugged:032da6fb-024c-4594-ac75-1a09b07aede7 for instance c0f40244-d142-4499-a099-08702a46bd87 on n-h1-854121-10 Aug 29 10:53:49.048878 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-de39e761-e56b-4d05-abf6-9933051b734a req-176a68c1-1de2-4088-9c48-a3e0a4ee41ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Aug 29 10:53:49.049776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2202/4399] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:49.159755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d9d22b-2a98-4833-8781-30740c801bbf", "tag": "50bc363a-c3ac-4e9a-bcb8-0628a330a9c7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:49.206568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.208098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.211804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.237893 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] Creating event network-changed:50bc363a-c3ac-4e9a-bcb8-0628a330a9c7 for instance c6d9d22b-2a98-4833-8781-30740c801bbf on n-h1-854121-10 Aug 29 10:53:49.246288 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6ecacb97-b9f2-4867-8cff-b09bd769d248 req-a3635eb0-8052-41c1-8d3d-1760c7fc4a8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089106 Aug 29 10:53:49.247591 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2198/4400] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:49.432912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:49.434494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:49.441131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.441918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.442419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.443199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.443782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.444384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.489370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:49.490173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:49.498009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.498849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.499496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.500525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.501195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.501957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.519357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f HTTP/1.1 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6a048117-3050-4f21-b0ac-1dc689a5f63f'} Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:49.521370 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.524917 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.527399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:49.528696 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39c9bd69-80f1-4244-a332-16dfdebbbff6 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 404 len: 111 microversion: 2.1 time: 0.043819 Aug 29 10:53:49.529808 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2199/4401] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:49 2022] DELETE /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:53:49.540799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:49.543652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 6a048117-3050-4f21-b0ac-1dc689a5f63f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:49.552912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.553737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.554325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.555175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:49.555777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:49.557014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:49.587343 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f HTTP/1.1 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6a048117-3050-4f21-b0ac-1dc689a5f63f'} Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:49.593745 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 6a048117-3050-4f21-b0ac-1dc689a5f63f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c73b8647-10ca-4485-9e1d-27129aa9cb88 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f" status: 404 len: 111 microversion: 2.1 time: 0.061563 Aug 29 10:53:49.597152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2200/4402] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:49 2022] GET /compute/v2.1/servers/6a048117-3050-4f21-b0ac-1dc689a5f63f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:53:49.761404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:49.770076 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b63ffeb-41af-43d2-8205-8b803c335a09 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.343100 Aug 29 10:53:49.784193 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2203/4403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:49 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:50.037233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:50.037959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:50.040606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:50.041338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:50.046652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.048703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.051580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.052574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.053675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.058628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.058856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.059631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.060228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.061145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.061874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.062698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.530300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:50.590385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:50.801014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:50.811678 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e336bd1-8851-44c8-9f4a-b36965810c0f tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.775168 Aug 29 10:53:50.816349 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2204/4404] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:50 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:50.830504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:50.831744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:50.842052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.842921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.844542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.845416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:50.848522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:50.850222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:50.950511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:51.044284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:51.055185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:51.061120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:51.065556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5968c27f-067f-43ce-87aa-d39f0136813f tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 1.033961 Aug 29 10:53:51.066562 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2201/4405] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:50 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:51.107521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602ae28a-a632-4d0f-85f0-35ad75cc2924", "name": "network-vif-plugged", "status": "completed", "tag": "c8d30663-8865-487d-8016-75fbd95295a3"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:51.125656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:51.130669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:51.131429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:51.161422 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] Creating event network-vif-plugged:c8d30663-8865-487d-8016-75fbd95295a3 for instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 on n-h1-854121-10 Aug 29 10:53:51.161585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:51.170452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ea6fb69-37f9-4aa1-a98f-543ddd18febe tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.352795 Aug 29 10:53:51.171511 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2205/4406] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:50 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:51.186278 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-616a411a-d82c-476d-90b9-3ca25d1adfe5 req-4b45a0de-700c-4264-8966-fa899d176220 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082837 Aug 29 10:53:51.189501 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2202/4407] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:51.837514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:51.838170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:51.845306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:51.845870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:51.846319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:51.847027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:51.847491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:51.847924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.003733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:52.012856 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a905452-d8e6-406e-b98d-201285a42815 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.179973 Aug 29 10:53:52.013883 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2206/4408] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:51 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:52.090733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:52.091508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:52.099550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.100293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.101015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.101987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.103267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.104970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.193640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:52.195088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:52.206756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.215824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.216385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.217195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.217755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.218402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.291459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:52.302092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:52.303935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:52.305415 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44547a36-e612-4bb8-9622-26670c9cb6aa tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.219413 Aug 29 10:53:52.314635 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2203/4409] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:52 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:52.426652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:52.437067 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58dcfe3e-060e-4935-8c71-92d8a7e3d949 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.248910 Aug 29 10:53:52.449801 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2207/4410] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:52 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:52.672779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:52.673794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:52.680228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.681645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.682616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.683796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:52.684493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:52.685040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:52.710411 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4906315e-ca8c-4f4d-a767-356de11f4dfe tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/ips" status: 200 len: 145 microversion: 2.1 time: 0.041478 Aug 29 10:53:52.711441 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2204/4411] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:53:52 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:53.037678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:53.038427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:53.047179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.048213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.052954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.053842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.055488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.056687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.212204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d8be8b-7e45-4c98-b621-f1186134a809", "name": "network-vif-plugged", "status": "completed", "tag": "9e7dc640-4e55-484a-b759-bd3b2fc70bbd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:53.238574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.239067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.239509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.268795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:53.276350 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] Creating event network-vif-plugged:9e7dc640-4e55-484a-b759-bd3b2fc70bbd for instance 02d8be8b-7e45-4c98-b621-f1186134a809 on n-h1-854121-10 Aug 29 10:53:53.285471 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-04c1e936-38f0-44c8-a397-77fc6c2f295c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.251756 Aug 29 10:53:53.285471 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2208/4412] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:53 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:53.289612 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4108e991-6477-406a-b400-35217b064eb7 req-db063fdc-42d8-4246-9c34-748b18b70cd4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080297 Aug 29 10:53:53.291064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2205/4413] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:53:53.332778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:53.333558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:53.341222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.341798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.342338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.343133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.343684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.344266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.461283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:53.462937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:53.469402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.470087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.470532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.473227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:53.473961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:53.476700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:53.513954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:53.527001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:53.530250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:53.531828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4161d89-c5d5-45d6-ae00-f057f81d1f2a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.204431 Aug 29 10:53:53.536301 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2209/4414] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:53 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:53.637434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:53.650488 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35941fdc-9780-4e57-9c69-105c7bc9435a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.190222 Aug 29 10:53:53.650488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2206/4415] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:53 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:54.140292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.141105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.148375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.148637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.149251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.150064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.150545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.150968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.166706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 HTTP/1.1 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '2a89248c-19fc-437e-a607-a698abe2b4e4'} Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:54.168841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:54.172865 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b04e348-948b-4834-8068-b71b72194732 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 404 len: 111 microversion: 2.1 time: 0.033988 Aug 29 10:53:54.178757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.179369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 2a89248c-19fc-437e-a607-a698abe2b4e4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.181871 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2210/4416] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:54 2022] DELETE /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:54.186576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.187064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.187691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.188619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.189088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.189512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.203103 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 HTTP/1.1 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '2a89248c-19fc-437e-a607-a698abe2b4e4'} Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.204735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 2a89248c-19fc-437e-a607-a698abe2b4e4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:54.209827 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5be3fdf2-70a7-42c5-b5ad-d8ed1bf5f492 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4" status: 404 len: 111 microversion: 2.1 time: 0.031205 Aug 29 10:53:54.210530 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2207/4417] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:54 2022] GET /compute/v2.1/servers/2a89248c-19fc-437e-a607-a698abe2b4e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:54.216850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.217407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.224371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.224859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.225362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.226095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.226550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.227219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.245374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc HTTP/1.1 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc'} Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:54.246974 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:54.251384 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf924a54-68c5-4334-8ecc-eee5548f731c tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 404 len: 111 microversion: 2.1 time: 0.036294 Aug 29 10:53:54.258425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.259003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.273626 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2211/4418] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:54 2022] DELETE /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:54.287946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.288573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.289016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.289739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.292807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.293648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.305194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.307551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.320262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.320778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.321229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.322242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.323406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:54.328487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.335903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.387295 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc HTTP/1.1 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc'} Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:54.395890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:54.401886 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-493e67c1-1fa0-4120-b113-8011e494b950 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc" status: 404 len: 111 microversion: 2.1 time: 0.146325 Aug 29 10:53:54.407025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2208/4419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:54 2022] GET /compute/v2.1/servers/eea8f45e-c5a5-4750-8d1f-3ef7ee8e12fc => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:54.563541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.564167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.573503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.578648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.579130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.580027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.580501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.581378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.582595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:54.593744 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7328ddc9-5757-4f66-9365-9ee0fb2fe67a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1322 microversion: 2.1 time: 0.293374 Aug 29 10:53:54.609727 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2212/4420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:54 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:54.672818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:54.673433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:54.683007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.685469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.686019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.686766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:54.689998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:54.690443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:54.832078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:54.846245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:54.848067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:54.850235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-13b56823-e805-446a-aa31-f1fb1780c660 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.291579 Aug 29 10:53:54.853718 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2209/4421] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:54 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:54.954542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:54.964279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7af956cb-4a41-439b-a628-626bc6d10c01 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1309 microversion: 2.1 time: 0.295598 Aug 29 10:53:54.977456 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2213/4422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:54 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:55.621958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:55.622565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:55.631494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.634847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.636031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:55.641602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.642307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.643171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:55.882413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:55.882413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:55.887638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.888138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.888592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:55.889309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.889795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.890235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:55.897117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:55.909342 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46945262-9ddd-46ea-913e-827a25114bca tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1515 microversion: 2.1 time: 0.291716 Aug 29 10:53:55.910690 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2210/4423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:55 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:55.934216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:55.935171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:55.944684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.947798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.948456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:55.950809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:55.951642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:55.954608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.205257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.212067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.220775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e15a8701-0b2e-408c-bda2-e9f202e300cc tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 200 len: 1515 microversion: 2.1 time: 0.292187 Aug 29 10:53:56.220954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.226883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.228933 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b445328a-37e8-4020-939f-c50cfce5112a tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.357219 Aug 29 10:53:56.229672 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2214/4424] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:55 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:56.234169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2211/4425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:55 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:56.240999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.241617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.247069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.248103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.248718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.249371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.250014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.250897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.251515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.252103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.258944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.260521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.261133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.262725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.263663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.264279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.518885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.521289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:56.530951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51db679c-a7ee-4a0c-8800-1e7410da888f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1491 microversion: 2.1 time: 0.300017 Aug 29 10:53:56.545970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.546458 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2215/4426] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:56 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1491 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:56.557470 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49189820-4084-4e1a-9dea-de48cc18ea36 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1515 microversion: 2.1 time: 0.319455 Aug 29 10:53:56.557832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.558606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.559389 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2212/4427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:56 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:56.580261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.580457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.581174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.581887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.582012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.582871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.583530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.584296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.593490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.596302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.598291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.599235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.605146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.612981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.681809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:53:56.862396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92ab180c-f522-430a-bde5-c7c4c6c71b53 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 204 len: 0 microversion: 2.1 time: 0.286084 Aug 29 10:53:56.863036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2213/4428] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:56 2022] DELETE /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:53:56.872143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.875160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.877568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:53:56.891249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.891747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.892189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.892916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.893370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.898109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.919724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:56.930527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0aee2337-0bc1-4c06-bfb6-c069b5dea390 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1490 microversion: 2.1 time: 0.380245 Aug 29 10:53:56.948429 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2216/4429] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:56 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1490 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:56.962768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:56.964641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:56.978797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.980012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:56.995449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:56.998850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:56.999606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.000833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.195699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.212904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6adc0fd5-8698-4202-b5fb-12fb3288782a tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1521 microversion: 2.1 time: 0.342982 Aug 29 10:53:57.214954 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2214/4430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:56 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:57.231510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d9d22b-2a98-4833-8781-30740c801bbf", "name": "network-vif-plugged", "status": "completed", "tag": "50bc363a-c3ac-4e9a-bcb8-0628a330a9c7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:57.254618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.256169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.258440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.285853 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] Creating event network-vif-plugged:50bc363a-c3ac-4e9a-bcb8-0628a330a9c7 for instance c6d9d22b-2a98-4833-8781-30740c801bbf on n-h1-854121-10 Aug 29 10:53:57.300691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e78ac846-d70e-40d7-819f-829a75707193 req-e739ebdd-8ed7-4cb6-8182-d5baed6a3d99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084281 Aug 29 10:53:57.303878 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2215/4431] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:53:57.311248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:57.312113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:57.320496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.321337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.321994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.322882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.323644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.324229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.340200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.356480 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2144c1e3-e818-4a10-9447-fb757cb9b32f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1491 microversion: 2.1 time: 0.404952 Aug 29 10:53:57.370679 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2217/4432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:56 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1491 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:57.378950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:57.379794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:57.387754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.391450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.392173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.402201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.403009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.403570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.457293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:53:57.481187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.490062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.495305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.497384 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7574f30-70b4-4808-9ce9-3f8da16b434d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.192198 Aug 29 10:53:57.501290 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2216/4433] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:57 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:53:57.606605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-620d8908-e8a8-4ce6-8fa6-b66a5c03bc90 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 204 len: 0 microversion: 2.1 time: 0.231906 Aug 29 10:53:57.608070 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2218/4434] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:57 2022] DELETE /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:53:57.616042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:57.616892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:57.624041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.624777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.625359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.626407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.627002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.627568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.638821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9bbd1d9-ab61-4938-bef0-8313deed8a2a"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:53:57.642093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:57.650462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.651487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.652545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.653495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:57.654278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:57.655003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:57.793959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:57.802216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4159e586-3457-4f49-b61b-8b7a50f6b59a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1497 microversion: 2.1 time: 0.190018 Aug 29 10:53:57.802805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2217/4435] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:57 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:58.238077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:58.238945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:58.245235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.245965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.246563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:58.247467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.248081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.248668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:58.420949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:58.430521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d770641-ce5a-4b71-845b-7ec127e60388 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1521 microversion: 2.1 time: 0.196208 Aug 29 10:53:58.431611 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2218/4436] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:58 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:58.523277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:58.523893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:58.533183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.533672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.534138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:58.534837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.535291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.535720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:58.713532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:58.723897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:58.726906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:58.731272 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45d46c12-e623-4170-93d4-3e35b46d83af tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.211988 Aug 29 10:53:58.731909 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2219/4437] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:58 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:53:58.823498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:58.824135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:58.830542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.831310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.831750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:58.832721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:58.833385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:58.834078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.031830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:59.042949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a704fb93-4045-48fb-af17-1666c9a20042 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1497 microversion: 2.1 time: 0.223464 Aug 29 10:53:59.044198 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2220/4438] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:58 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:53:59.052856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:59.053692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:59.061519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.062070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.062509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.063207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.063716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.064279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.082942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff HTTP/1.1 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1e84f4fb-ead3-47cf-82d1-48637080f1ff'} Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:59.084992 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.089888 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.091638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:59.092658 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6d260d3-1732-449e-afdb-818e412e6af2 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 404 len: 111 microversion: 2.1 time: 0.047479 Aug 29 10:53:59.093481 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2221/4439] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:53:59 2022] DELETE /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:59.102144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:59.103254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] [instance: 1e84f4fb-ead3-47cf-82d1-48637080f1ff] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:59.114658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.115485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.116242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.117289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.117927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.119595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.136556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] HTTP exception thrown: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Request method failure captured: Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff HTTP/1.1 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJjyPdF0tQUG04r9bvmWA5eul2oV5yS52FEOrWpMfWjS6Yq1gSxX-iy6tziZBGKothZI0cP5ZhECoERYM7n-RM6jxfn2HQgC8nkBOpmtIxTEinH65PSonKlSz5tr6lJrfIBPkhQSgOS3Rlhd3Q0mSk-h8I7vV-8l1MUM-U-WJ7f1M3M Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b2b0b8926be4968a170dcbd81ce371f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3b2b0b8926be4968a170dcbd81ce371f Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1556540788 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: c90c88821f014e85937cb469aa95e365 Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeNegativeTest-1556540788-project Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1e84f4fb-ead3-47cf-82d1-48637080f1ff'} Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:53:59.138348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:53:59.145939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] Returning 404 to user: Instance 1e84f4fb-ead3-47cf-82d1-48637080f1ff could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:53:59.151967 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9723908b-7005-4e1b-8662-be65dc8222b8 tempest-AttachVolumeNegativeTest-1556540788 tempest-AttachVolumeNegativeTest-1556540788-project] 10.222.0.47 "GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff" status: 404 len: 111 microversion: 2.1 time: 0.048204 Aug 29 10:53:59.151967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2222/4440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:59 2022] GET /compute/v2.1/servers/1e84f4fb-ead3-47cf-82d1-48637080f1ff => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:53:59.451213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:59.452420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:59.470558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.471315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.472080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.472962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.473587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.474186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.741985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:53:59.753221 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f66c89fd-9db9-4d63-9226-42a5399b61a7 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1521 microversion: 2.1 time: 0.303807 Aug 29 10:53:59.756527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2223/4441] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:53:59 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:53:59.769555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:53:59.776753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:53:59.791201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.791882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.792540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.794024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:53:59.798133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:53:59.798845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:53:59.865457 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1498cba0-6ccf-41ee-9cb2-c17198230008 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.230596 Aug 29 10:53:59.867715 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2219/4442] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:53:57 2022] POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments => generated 194 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:00.039005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:00.051488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:00.053853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:00.055230 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-28cd55df-d5be-4480-94ec-0a65047ab12b tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.297388 Aug 29 10:54:00.057334 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2224/4443] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:53:59 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:00.076480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:00.077375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:00.087933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:00.088754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:00.089416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:00.090573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:00.091331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:00.092119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:00.263438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:00.272627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7fb990c2-118f-4204-9ff2-bdc16f7ff3cb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1497 microversion: 2.1 time: 0.200763 Aug 29 10:54:00.273459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2220/4444] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:00 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:00.782543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:00.783258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:00.800110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:00.800548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:00.805517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:00.807623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:00.808230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:00.808783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.093723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:01.095680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:01.097926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:01.099247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:01.106396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69f8c9a8-390a-4b10-a635-3381d07a2bc3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1521 microversion: 2.1 time: 0.328961 Aug 29 10:54:01.108315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2225/4445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:00 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:01.111943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:01.123430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:01.123950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.132209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:01.132998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:01.136954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.302437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:01.303245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:01.315173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:01.316223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:01.317486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.319294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:01.320317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:01.320973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.475461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:01.488696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:01.490903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:01.492545 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-66a548ce-8890-43a2-8222-aa7f171ca490 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1359 microversion: 2.21 time: 0.408952 Aug 29 10:54:01.495094 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2221/4446] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:01 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:01.595867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:01.610370 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2049761e-d5fa-4723-bec2-aabc23733c21 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1497 microversion: 2.1 time: 0.316431 Aug 29 10:54:01.625019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2226/4447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:01 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1497 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:01.931506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b811fa3-bdae-4b01-8337-ecf42a0cffd8", "name": "network-vif-deleted", "tag": "a36e1ed2-40af-40fb-9de5-1ceae5620ce5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:01.949653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:01.954440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:01.955171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:01.987951 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] Creating event network-vif-deleted:a36e1ed2-40af-40fb-9de5-1ceae5620ce5 for instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 on n-h1-854121-10 Aug 29 10:54:01.994859 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dac5b90c-84dd-4e0d-98a8-7ad16212c17e req-a9042016-9dde-41ae-8ee0-5c63f08ea1ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066938 Aug 29 10:54:01.997637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2222/4448] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:02.132317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:02.132947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:02.149222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.152229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.152704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.153990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.153990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.155764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.252425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.253358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.254344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.254989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lazy-loading 'fault' on Instance uuid 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:54:02.360997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:02.371261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f623ec4-b538-4207-a910-152fe39d2803 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 200 len: 1312 microversion: 2.1 time: 0.247316 Aug 29 10:54:02.388011 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2227/4449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:02 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:02.518261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:02.519854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:02.533776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.547042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.550018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.554065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.554930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.558413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.632825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:02.633452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:02.656461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.657004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.661261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.663511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.664805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.666976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.756705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:02.757203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:02.769871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:02.771625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lazy-loading 'fault' on Instance uuid 02d8be8b-7e45-4c98-b621-f1186134a809 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:54:02.874575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:02.887904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ff797dc-b2ad-4b1a-a357-9b6c2e193005 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1299 microversion: 2.1 time: 0.258095 Aug 29 10:54:02.889189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2228/4450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:02 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:02.958305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:02.972848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:02.992060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:02.998122 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b921e36-0135-4efd-8013-d2a09e66c439 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1551 microversion: 2.21 time: 0.484502 Aug 29 10:54:03.019014 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2223/4451] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:02 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1551 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:03.035124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.036013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:03.044440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.045093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.045835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.046750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.047571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.048118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.101364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:03.289149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09c754f4-0968-4c53-9e07-fc8cad97fd86 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 204 len: 0 microversion: 2.21 time: 0.258350 Aug 29 10:54:03.290627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2229/4452] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:54:03 2022] DELETE /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:54:03.302451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.303095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:03.318173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.332604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.333191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.334002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.334488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.343281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.394584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.395300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:03.413507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.415761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.416225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.425339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.426172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.426292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.490974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] HTTP exception thrown: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 HTTP/1.1 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '5b811fa3-bdae-4b01-8337-ecf42a0cffd8'} Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.496824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 404 to user: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3b526ed-10e6-4861-b4e9-46380cd91bfe tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 404 len: 111 microversion: 2.1 time: 0.108673 Aug 29 10:54:03.502297 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2230/4453] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:54:03.510858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.536750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:03.543139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:03.554493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.555265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.555920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.557181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.558486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.559129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.775178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10d384b2-527e-42bb-aab2-ad1b0630ee7c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.267463 Aug 29 10:54:03.784152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2231/4454] 10.222.0.47 () {58 vars in 1230 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:54:03.790091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b32d127c-9c17-49f7-a8aa-1ceb8ff4487c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b32d127c-9c17-49f7-a8aa-1ceb8ff4487c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 10:54:03.794876 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 10:54:03.800421 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:03.803472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b32d127c-9c17-49f7-a8aa-1ceb8ff4487c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:03.804960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b32d127c-9c17-49f7-a8aa-1ceb8ff4487c tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019492 Aug 29 10:54:03.806247 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2232/4455] 10.222.0.47 () {58 vars in 1182 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:03.818233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.825219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:03.826256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:03.836337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.837199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.840575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.841870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.842607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.843280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.893904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:54:03.911560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:03.922039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:03.923489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:03.924706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15ae4425-6b77-44c7-9dcd-0eba1daccb90 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1557 microversion: 2.21 time: 0.629569 Aug 29 10:54:03.940068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2224/4456] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1557 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:03.952804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:03.953418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:03.963387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.963881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.965383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.965383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:03.965581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:03.965921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:03.979903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5637bbc-f44a-469c-89bb-45ec89c3cbcd tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.165352 Aug 29 10:54:03.989436 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2233/4457] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers => generated 681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:04.005471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.020468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.022408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.servers [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Removing options 'limit' from query {{(pid=128681) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 10:54:04.025115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:04.036664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.037718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.039472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.042734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.044183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.045318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.094138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.096930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.097393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.097947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lazy-loading 'fault' on Instance uuid 02d8be8b-7e45-4c98-b621-f1186134a809 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:54:04.101655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:54:04.170475 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50a56d84-06c1-42b7-9337-4a370847a753 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.170467 Aug 29 10:54:04.181735 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2234/4458] 10.222.0.47 () {58 vars in 1144 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:54:04.186288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.186864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d8be8b-7e45-4c98-b621-f1186134a809", "name": "network-vif-deleted", "tag": "9e7dc640-4e55-484a-b759-bd3b2fc70bbd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:04.195977 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff39b7c8-7230-4d46-bcbb-193bdde87e2d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 200 len: 1299 microversion: 2.1 time: 0.254785 Aug 29 10:54:04.198070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.198656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.199237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.215605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2225/4459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:03 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:04.219494 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] Creating event network-vif-deleted:9e7dc640-4e55-484a-b759-bd3b2fc70bbd for instance 02d8be8b-7e45-4c98-b621-f1186134a809 on n-h1-854121-10 Aug 29 10:54:04.234789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-182797e0-5036-4d3f-af3a-d753b3fdfe9a req-8131f0dc-b967-4603-8cb4-d8ddb7311cf3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049130 Aug 29 10:54:04.235343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-705d61b6-f0db-4891-84d0-75ff4ec11b69 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.236197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2235/4460] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-705d61b6-f0db-4891-84d0-75ff4ec11b69 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: action_args: {} Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi '-1' Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 10:54:04.242123 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 10:54:04.247117 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.253074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-705d61b6-f0db-4891-84d0-75ff4ec11b69 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:04.254215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-705d61b6-f0db-4891-84d0-75ff4ec11b69 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.037372 Aug 29 10:54:04.258233 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2226/4461] 10.222.0.47 () {58 vars in 1142 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:04.268952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cceaccee-729c-4156-9b18-8bb930816d52 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cceaccee-729c-4156-9b18-8bb930816d52 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: action_args: {} Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi 'testing' Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 10:54:04.274954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cceaccee-729c-4156-9b18-8bb930816d52 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cceaccee-729c-4156-9b18-8bb930816d52 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.011937 Aug 29 10:54:04.278797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2236/4462] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:04.286950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a970a316-b09c-43e9-9e1a-66f5e27570aa tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.300159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a970a316-b09c-43e9-9e1a-66f5e27570aa tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.301082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a970a316-b09c-43e9-9e1a-66f5e27570aa tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:04.342822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.servers [None req-a970a316-b09c-43e9-9e1a-66f5e27570aa tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Flavor 'non_existing_flavor' could not be found {{(pid=128682) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 29 10:54:04.343877 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a970a316-b09c-43e9-9e1a-66f5e27570aa tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061504 Aug 29 10:54:04.348685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2227/4463] 10.222.0.47 () {58 vars in 1178 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:54:04.362462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.367951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.379253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:04.395484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.397308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.397939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.398847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.400073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.400668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.603333 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fb4a98f-a64d-4e70-a96d-501d6061d964 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.245185 Aug 29 10:54:04.611673 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2237/4464] 10.222.0.47 () {58 vars in 1174 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:54:04.626760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.634791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.636040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:04.645018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.646031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.646732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.650906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.652151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.652849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.821080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-896f7442-c3e1-4ed7-942a-3ed739cbb8ea tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.201117 Aug 29 10:54:04.832994 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2228/4465] 10.222.0.47 () {58 vars in 1184 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:54:04.845558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.850882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:04.851930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:04.858151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.858987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.859642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.860756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:04.861443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:04.862116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:04.902210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:54:04.968271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:04.969582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.008654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.009581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.011069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.012204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.014119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.015336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.016330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.017450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.017964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.018733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.511181 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5fcb4ab1-1731-478d-a434-1e365fd08916 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.669424 Aug 29 10:54:05.512790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2238/4466] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:05.517643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.518601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.539021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.539724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.540429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.541299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.541938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.542509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.558453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.576810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.583727 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:54:05.595626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.597195 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36d6ff3e-c52d-41a7-b707-94778ea481fb tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1557 microversion: 2.21 time: 0.633339 Aug 29 10:54:05.597981 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2229/4467] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:04 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1557 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:05.602684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-533826b7-8cb1-48cc-ac3d-a0013c5b60b0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 HTTP/1.1 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '02d8be8b-7e45-4c98-b621-f1186134a809'} Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.604663 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:54:05.608340 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.609483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:05.610520 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67e0b4c8-604f-4a03-b14b-402ba081bd55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 404 len: 111 microversion: 2.1 time: 0.096627 Aug 29 10:54:05.611237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2239/4468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:05 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:05.644596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.645097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.645952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-533826b7-8cb1-48cc-ac3d-a0013c5b60b0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.650853 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-533826b7-8cb1-48cc-ac3d-a0013c5b60b0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.051651 Aug 29 10:54:05.653608 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2230/4469] 10.222.0.47 () {58 vars in 1178 bytes} [Mon Aug 29 10:54:05 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:54:05.659607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.670062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.674179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.676025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.682675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.689090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:05.691043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.691043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.709928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Searching by: {'deleted': False, 'project_id': 'c11d48411b624c2184b8b98c1ee50767'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:54:05.733152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.733483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.739554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.740417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.740897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.741328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.783990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:05.812676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:54:05.860148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b3aabb9-c500-4297-b08b-b0e01c22e4c5 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.193943 Aug 29 10:54:05.869585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2231/4470] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:54:05 2022] GET /compute/v2.1/servers => generated 681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:05.886171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.887286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.903330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.904083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.904765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.905782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.906475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.907092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.941995 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] HTTP exception thrown: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 HTTP/1.1 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '5b811fa3-bdae-4b01-8337-ecf42a0cffd8'} Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:05.947171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:05.950714 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:05.953993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 404 to user: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:05.955176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb6576f7-72c1-4857-bb01-3cf69b503c34 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 404 len: 111 microversion: 2.1 time: 0.082415 Aug 29 10:54:05.956203 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2232/4471] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:54:05 2022] DELETE /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:05.961094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-642e8320-dfb1-447f-bcc7-80f8c0a987d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 204 len: 0 microversion: 2.1 time: 0.340521 Aug 29 10:54:05.962619 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2240/4472] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:54:05 2022] DELETE /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:54:05.970737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.972115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.988130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.989163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.989756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:05.995171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:05.995327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:05.995696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:05.996044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:05.996190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.013123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.014039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.014627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.015499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.016099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.016669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.061588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:06.068968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:06.234476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b299d23-e1b7-4c6d-a052-201cfb4b8d97 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 204 len: 0 microversion: 2.1 time: 0.273312 Aug 29 10:54:06.235962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2233/4473] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:54:05 2022] DELETE /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:54:06.249915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:06.251507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:06.270219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.271559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.272722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.274150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.275252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.277794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.353046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:06.525800 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c259662a-e99f-4702-9bad-a939e6be1a56 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "DELETE /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 204 len: 0 microversion: 2.1 time: 0.284793 Aug 29 10:54:06.528461 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2234/4474] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:54:06 2022] DELETE /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:54:06.536165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d9d22b-2a98-4833-8781-30740c801bbf", "name": "network-vif-deleted", "tag": "50bc363a-c3ac-4e9a-bcb8-0628a330a9c7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:06.547513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.548512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.549234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.565175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] Creating event network-vif-deleted:50bc363a-c3ac-4e9a-bcb8-0628a330a9c7 for instance c6d9d22b-2a98-4833-8781-30740c801bbf on n-h1-854121-10 Aug 29 10:54:06.572131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ce1f1f0c-e6a9-4598-8fec-12ee4a472877 req-e1391b87-08ba-46cb-900b-16394668646a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041572 Aug 29 10:54:06.577243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2235/4475] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:06.587485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:06.588422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 5b811fa3-bdae-4b01-8337-ecf42a0cffd8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:06.596765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.597276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.597966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.598739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.599458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.600003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.615682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] HTTP exception thrown: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 HTTP/1.1 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '5b811fa3-bdae-4b01-8337-ecf42a0cffd8'} Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:06.617739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 404 to user: Instance 5b811fa3-bdae-4b01-8337-ecf42a0cffd8 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ec0f12b4-0c39-47af-b4e4-586913072d5b tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8" status: 404 len: 111 microversion: 2.1 time: 0.041235 Aug 29 10:54:06.623358 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2236/4476] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:06 2022] GET /compute/v2.1/servers/5b811fa3-bdae-4b01-8337-ecf42a0cffd8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:06.633601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:06.636214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:06.646332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.647018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.650902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.651932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.652610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.653462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.841660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:06.859575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:06.862569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:06.865971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-21c10299-055f-47f5-8334-f0553879edd0 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1515 microversion: 2.21 time: 0.240410 Aug 29 10:54:06.869991 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2237/4477] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:06 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:06.878617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:06.879970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:06.891980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.892506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.893048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.893943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:06.895010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:06.895695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:06.928064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:06.940002 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50888087-95ac-4603-be39-2759641fb5da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1496 microversion: 2.1 time: 0.972946 Aug 29 10:54:06.955742 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2241/4478] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:05 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1496 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:07.378401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:07.391267 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bab8d0e3-b7d5-46c8-accd-692be8c16a59 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 200 len: 1521 microversion: 2.1 time: 0.519320 Aug 29 10:54:07.406202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2238/4479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:06 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:07.892101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:07.892726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:07.905724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:07.909929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:07.911738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:07.915503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:07.916306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:07.918834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:07.964637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:07.965439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:07.980359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:07.981195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:07.981975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:07.982925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:07.983585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:07.984299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:07.985814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:08.172004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:08.185261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:08.186771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:08.187954 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc29a8d0-1f2b-480a-98d1-eb1869d60578 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1344 microversion: 2.21 time: 0.299729 Aug 29 10:54:08.188528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2242/4480] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:07 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1344 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:08.345487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:08.355127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-00ac96a9-9fbd-4c43-a11e-1b11879199b9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1496 microversion: 2.1 time: 0.395822 Aug 29 10:54:08.355992 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2239/4481] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:07 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1496 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:08.415354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:08.416641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:08.427837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:08.429543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:08.432214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:08.434261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:08.435392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:08.436538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:08.727309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:08.742407 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c9239cd5-0ae0-48a2-a9e0-54bb921acfe4 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 200 len: 1521 microversion: 2.1 time: 0.333031 Aug 29 10:54:08.743037 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2243/4482] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:08 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:09.211162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:09.211913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:09.221399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.222080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.222644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.223458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.223926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.224401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.378129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:09.378761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:09.388781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.389294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.390961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.392574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.393054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.393528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.409456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:09.427726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:09.429196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '073290bf39994eeaa840b9dbccfea517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014443a3b87642f5877ab945ba000446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:09.441461 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7bd496f-f1b5-45bb-8779-f3d67a735206 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 200 len: 1344 microversion: 2.21 time: 0.223361 Aug 29 10:54:09.442213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2240/4483] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:09 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 1344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:09.764823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:09.765550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:09.771723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.779792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.780448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.781478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:09.782208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:09.782828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:09.855507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:09.866653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f6acd69-16e8-4c1a-82cc-71fd0984a595 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1496 microversion: 2.1 time: 0.492521 Aug 29 10:54:09.869508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2244/4484] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:09 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1496 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:10.126776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:10.138967 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb79432f-23f9-4364-9cde-e6bedcc194f3 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 200 len: 1521 microversion: 2.1 time: 0.378253 Aug 29 10:54:10.139568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2241/4485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:09 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:10.466327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:10.467051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:10.483406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.483998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.484509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.485294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.497611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.498286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.515777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] HTTP exception thrown: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Request method failure captured: Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf HTTP/1.1 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqy17en4_oZ-saSrXd7BFBy7_ehcUQQpu9xU-M3sr757D7LwVz7F2CdJX6h7u_kMmK2_Kmtjwde_jZh_p46oMwbdjkhfjKyxi1inwwdNIkojBa4TdxepYbY-WWO13Hy9gIBqNINeJ8aSuhRIAyrhp1OVfpzd3imTo_f0v82y5Z8eJU Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_014443a3b87642f5877ab945ba000446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/014443a3b87642f5877ab945ba000446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 073290bf39994eeaa840b9dbccfea517 Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c6d9d22b-2a98-4833-8781-30740c801bbf'} Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.528129 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Returning 404 to user: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dee1fa5-6137-445e-a8a3-c590347b267d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 404 len: 111 microversion: 2.21 time: 0.067966 Aug 29 10:54:10.535890 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2245/4486] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:10 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:10.541688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '.version_select at 0x7f66c5cfd670>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:10.542294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:10.558915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:10.560476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.561133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.561870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.562846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.563537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.566475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.725377 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d388d266-e0dc-445d-9b87-44823d91fa50 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.190901 Aug 29 10:54:10.729939 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2242/4487] 10.222.0.47 () {60 vars in 1337 bytes} [Mon Aug 29 10:54:10 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf/os-instance-actions => generated 611 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:54:10.742021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:10.742427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:10.779991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.784536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.794856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.798682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.799294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.802622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.824306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f40244-d142-4499-a099-08702a46bd87", "name": "network-vif-deleted", "tag": "032da6fb-024c-4594-ac75-1a09b07aede7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:10.864351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.876640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.877352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.894739 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] HTTP exception thrown: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Request method failure captured: Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf HTTP/1.1 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqy17en4_oZ-saSrXd7BFBy7_ehcUQQpu9xU-M3sr757D7LwVz7F2CdJX6h7u_kMmK2_Kmtjwde_jZh_p46oMwbdjkhfjKyxi1inwwdNIkojBa4TdxepYbY-WWO13Hy9gIBqNINeJ8aSuhRIAyrhp1OVfpzd3imTo_f0v82y5Z8eJU Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_014443a3b87642f5877ab945ba000446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/014443a3b87642f5877ab945ba000446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 073290bf39994eeaa840b9dbccfea517 Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c6d9d22b-2a98-4833-8781-30740c801bbf'} Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:10.900433 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:10.905806 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:10.906578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Returning 404 to user: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:10.909984 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef638672-d772-4eee-a2fd-cac2d786f3e4 tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 404 len: 111 microversion: 2.21 time: 0.169726 Aug 29 10:54:10.912870 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2246/4488] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:54:10 2022] DELETE /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:10.917812 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] Creating event network-vif-deleted:032da6fb-024c-4594-ac75-1a09b07aede7 for instance c0f40244-d142-4499-a099-08702a46bd87 on n-h1-854121-10 Aug 29 10:54:10.934215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:10.945629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:10.946736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9de0a871-576c-46ba-898b-ba625b8d807b req-3cc7b394-1aed-4f2d-bf6d-3b37daeecce0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131545 Aug 29 10:54:10.957129 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2243/4489] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:54:10.965319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:10.972388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.976066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] [instance: c6d9d22b-2a98-4833-8781-30740c801bbf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:10.978127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.981727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:10.983858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:10.989111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:10.995072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.007907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.008472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.009115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.016091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.018306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.018945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.074921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] HTTP exception thrown: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Request method failure captured: Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf HTTP/1.1 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJqy17en4_oZ-saSrXd7BFBy7_ehcUQQpu9xU-M3sr757D7LwVz7F2CdJX6h7u_kMmK2_Kmtjwde_jZh_p46oMwbdjkhfjKyxi1inwwdNIkojBa4TdxepYbY-WWO13Hy9gIBqNINeJ8aSuhRIAyrhp1OVfpzd3imTo_f0v82y5Z8eJU Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_014443a3b87642f5877ab945ba000446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/014443a3b87642f5877ab945ba000446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/014443a3b87642f5877ab945ba000446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 014443a3b87642f5877ab945ba000446 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1762409649 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 073290bf39994eeaa840b9dbccfea517 Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-InstanceActionsV221TestJSON-1762409649-project Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c6d9d22b-2a98-4833-8781-30740c801bbf'} Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:11.076852 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. Aug 29 10:54:11.081820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:11.093571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] Returning 404 to user: Instance c6d9d22b-2a98-4833-8781-30740c801bbf could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:11.094647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5bb6101c-bd6f-4cbc-9d5a-dbd0014fd38d tempest-InstanceActionsV221TestJSON-1762409649 tempest-InstanceActionsV221TestJSON-1762409649-project] 10.222.0.47 "GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf" status: 404 len: 111 microversion: 2.21 time: 0.136308 Aug 29 10:54:11.095367 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2244/4490] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:10 2022] GET /compute/v2.1/servers/c6d9d22b-2a98-4833-8781-30740c801bbf => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:11.166838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:11.167462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:11.185814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.186705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.187922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.190237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.190866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.191839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.372691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.374165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.376325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.388265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lazy-loading 'fault' on Instance uuid c0f40244-d142-4499-a099-08702a46bd87 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:54:11.441656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:11.456260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-efc9f24e-32bb-47a1-8439-ceeadbf37ca9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 200 len: 1294 microversion: 2.1 time: 0.541801 Aug 29 10:54:11.457679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2247/4491] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:10 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 1294 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:11.527648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602ae28a-a632-4d0f-85f0-35ad75cc2924", "name": "network-vif-deleted", "tag": "c8d30663-8865-487d-8016-75fbd95295a3"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:11.566451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:11.570995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:11.571995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:11.622561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] Creating event network-vif-deleted:c8d30663-8865-487d-8016-75fbd95295a3 for instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 on n-h1-854121-10 Aug 29 10:54:11.638932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:11.657290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-13259375-ebbe-45ed-932e-89ab721a9613 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 200 len: 1312 microversion: 2.1 time: 0.494480 Aug 29 10:54:11.659889 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2245/4492] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:11 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:11.661584 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9aee775d-905a-4948-8ed6-cc5dbf6e5c61 req-c64114d1-2523-4c9b-97e7-0d402bece016 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139818 Aug 29 10:54:11.669352 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2248/4493] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:54:12.483197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:12.484430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:12.497956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.498563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.499106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.499877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.500430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.504933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.534109 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 HTTP/1.1 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1'} Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.537015 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.542633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:12.543798 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24067003-922b-4db8-b677-3bac5e881df5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 404 len: 111 microversion: 2.1 time: 0.065171 Aug 29 10:54:12.548967 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2246/4494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:12 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:12.686360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:12.688873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: c0f40244-d142-4499-a099-08702a46bd87] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:12.716897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.718435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.720566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.730283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.732443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.733134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.764627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-681411155", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:12.779835 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] HTTP exception thrown: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 HTTP/1.1 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c0f40244-d142-4499-a099-08702a46bd87'} Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.782911 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. Aug 29 10:54:12.787284 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:12.788693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 404 to user: Instance c0f40244-d142-4499-a099-08702a46bd87 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:12.792135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8795cc8-de83-4046-be38-ed05d4ec02d8 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87" status: 404 len: 111 microversion: 2.1 time: 0.114007 Aug 29 10:54:12.793520 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2249/4495] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:12 2022] GET /compute/v2.1/servers/c0f40244-d142-4499-a099-08702a46bd87 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:12.818174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:12.819195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:12.828331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.829261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.829954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.831895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.834207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.835978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.849236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:54:12.886801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:12.887885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:12.888857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:12.889541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lazy-loading 'fault' on Instance uuid 602ae28a-a632-4d0f-85f0-35ad75cc2924 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:54:13.953827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e30439e323d4d10b10aa6048b3743cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11d48411b624c2184b8b98c1ee50767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:13.963080 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30f52c0e-89b6-4368-867a-c2e7e29240b2 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 200 len: 1312 microversion: 2.1 time: 1.165042 Aug 29 10:54:13.964842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2250/4496] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:12 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 1312 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:13.970044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1", "name": "network-vif-deleted", "tag": "e87836d6-323a-4806-9a68-e0969427790e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:13.981158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:13.981981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:13.982639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:13.999907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] Creating event network-vif-deleted:e87836d6-323a-4806-9a68-e0969427790e for instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 on n-h1-854121-10 Aug 29 10:54:14.007630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-67756114-323c-4064-b4ee-1797077cb944 req-cea815b4-8346-490d-82e6-9b342796effe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040863 Aug 29 10:54:14.011933 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2251/4497] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:14.824414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:54:14.825590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:54:14.826121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:54:14.826541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:54:14.826957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:54:14.845023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:14.846358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:14.846358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:14.846866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:14.847323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:14.847954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:14.892888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:14.898782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:14.932235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:54:14.936029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:54:14.986616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:14.995322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:14.997944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] [instance: 602ae28a-a632-4d0f-85f0-35ad75cc2924] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:15.008498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:15.021106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:15.022651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:15.025212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:15.028898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:15.029620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:15.030246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:15.056748 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1015cb9f-b5c1-4290-8c28-b82c2a3852f6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.296210 Aug 29 10:54:15.066712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2247/4498] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:54:15.067976 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] HTTP exception thrown: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Request method failure captured: Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 HTTP/1.1 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJqi4jdgNJ0gFH7-2GNadEZUpQgXMm2tW12rgO4E_pVeDRiAxFFsA5Kn2UghQH_0uH14_0yOzHehIHRoMEYI69KkS4GIpHxw6MCzg-0ewqPeFFUNrbJ-sbJQo68AcjW8XnYc5vSJTO3p6hZjPkvPs32EQ8htvGhJidQyvS3J8Ql1COs Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c11d48411b624c2184b8b98c1ee50767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c11d48411b624c2184b8b98c1ee50767 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1427431548 Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 5e30439e323d4d10b10aa6048b3743cd Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ListServersNegativeTestJSON-1427431548-project Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '602ae28a-a632-4d0f-85f0-35ad75cc2924'} Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:15.074115 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] Returning 404 to user: Instance 602ae28a-a632-4d0f-85f0-35ad75cc2924 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:15.078634 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-abc97603-a57d-4d53-bd44-d4ad357c00c0 tempest-ListServersNegativeTestJSON-1427431548 tempest-ListServersNegativeTestJSON-1427431548-project] 10.222.0.47 "GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924" status: 404 len: 111 microversion: 2.1 time: 0.091241 Aug 29 10:54:15.083199 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2252/4499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:14 2022] GET /compute/v2.1/servers/602ae28a-a632-4d0f-85f0-35ad75cc2924 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:54:15.098722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-94ebf314-f4e7-4ee9-a086-a4812cf25203 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:15.100958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-94ebf314-f4e7-4ee9-a086-a4812cf25203 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:15.244195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94ebf314-f4e7-4ee9-a086-a4812cf25203 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:15.253031 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-94ebf314-f4e7-4ee9-a086-a4812cf25203 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1208 microversion: 2.1 time: 0.185275 Aug 29 10:54:15.260361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2248/4500] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:15 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1208 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:16.011229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:16.029541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:16.030924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:16.031619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:16.070853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:54:16.170261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b85c46e2-5c81-48b2-8edb-2738c1cef23d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action" status: 202 len: 0 microversion: 2.1 time: 0.185573 Aug 29 10:54:16.188136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2253/4501] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:54:15 2022] POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:54:16.196200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:16.197808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:16.223191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:16.227000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:16.229407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:16.231310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:16.232635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:16.235502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:16.300335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:16.303262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:16.340664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:16.345302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:16.348407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:16.361629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:16.364236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:16.365187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:16.546365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:16.559243 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3905325-be6a-4255-9df7-5bdbac17f63a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1204 microversion: 2.1 time: 0.276747 Aug 29 10:54:16.560166 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2254/4502] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:16 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1204 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:16.658713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:16.678333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ae37bf6-f074-49c5-9bd9-268d4ded58b4 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.484184 Aug 29 10:54:16.701342 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2249/4503] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:16 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:17.589006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:17.590304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:17.602416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:17.612784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:17.613539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:17.614480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:17.615168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:17.622559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:17.712139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:17.713346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:17.756750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:17.760168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:17.760829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:17.761733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:17.767691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:17.768262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:18.018854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:18.036204 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-706821c7-27dd-46af-9706-d3ff48327e5a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1268 microversion: 2.1 time: 0.449929 Aug 29 10:54:18.037254 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2255/4504] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:17 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1268 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:18.155593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:18.164387 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5164c5fd-a3e5-4a18-b4f6-aef14efab955 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.458256 Aug 29 10:54:18.185901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2250/4505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:17 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:18.644461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:18.644961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:18.647739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:18.668550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:18.669559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:18.670966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:18.674131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:18.675027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:18.676491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:18.735204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:18.939903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1339b6f1-597c-4520-bbb7-d0d62360561e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 204 len: 0 microversion: 2.32 time: 0.897124 Aug 29 10:54:18.940930 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2256/4506] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:54:18 2022] DELETE /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:54:18.949742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:18.950382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:18.960542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:18.964025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:18.965782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:18.966736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:18.970653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:18.971111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:19.060466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:19.061182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:19.072513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:19.073016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:19.073460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:19.074511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:19.074974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:19.075404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:19.771232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:19.786579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-709b247a-6b88-4ab7-bec3-e85d5e9e87f0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.730879 Aug 29 10:54:19.819497 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2257/4507] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:19 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:19.825071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:19.828172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:19.843980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:19.847051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:19.866532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:19.869325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:19.871288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:19.872016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:19.875109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:19.875747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:19.878259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:19.886012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:19.887647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cf6c894-edf1-4a14-8718-6247321aa612 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2946 microversion: 2.32 time: 0.942297 Aug 29 10:54:19.889376 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2251/4508] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:18 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2946 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:20.346146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:20.366225 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a08373d6-fe67-4e60-8824-e08371f3b017 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.544983 Aug 29 10:54:20.366846 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2258/4509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:19 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:20.837733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:20.839097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:20.897080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:20.897589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:20.898074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:20.898804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:20.899906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:20.900340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:20.916640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:20.917268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:20.929563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:20.930663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:20.931123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:20.931996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:20.932468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:20.932906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:21.409715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:21.427343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:21.429277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:21.434012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72a6ab47-04dc-4722-8cb7-d0613cac73a0 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2946 microversion: 2.32 time: 0.521363 Aug 29 10:54:21.434816 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2259/4510] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:20 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2946 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:21.471809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:21.473379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:21.486923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:21.487802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:21.492184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:21.500611 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44af32c2-dd4c-4c03-8a90-2e9169409291 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.681277 Aug 29 10:54:21.501188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:21.504677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:21.505368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:21.506800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:21.507197 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2252/4511] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:20 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:21.541348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:21.790281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:21.811283 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8515611-ecda-4115-af94-e09681c9b3e1 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.374207 Aug 29 10:54:21.819106 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2260/4512] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:21 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:22.480755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:22.482033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:22.510557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:22.511310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:22.511928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:22.512855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:22.513323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:22.513792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:22.533323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:22.533323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:22.547272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:22.547272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:22.547937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:22.549136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:22.549136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:22.549482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:23.325243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:23.335469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:23.337643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:23.339016 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-31a5cf4f-bfd1-4ac7-badb-c510f285a43a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2946 microversion: 2.32 time: 0.866450 Aug 29 10:54:23.339601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2253/4513] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:22 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2946 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:23.360564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:23.361187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:23.376297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:23.389406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:23.390579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5019fbd-4608-474f-a735-6fbb41238015 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.857453 Aug 29 10:54:23.391231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2261/4514] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:22 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:23.409879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf95a48-30a4-4c34-9d17-a05ed95bfd8c", "tag": "7aa5413e-eba7-4acf-804a-81dda6e9b2c9"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:23.410549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:23.411260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:23.412210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:23.412895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:23.414097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:23.460271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:23.460766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:23.461210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:23.489726 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] Creating event network-changed:7aa5413e-eba7-4acf-804a-81dda6e9b2c9 for instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c on n-h1-854121-10 Aug 29 10:54:23.503524 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-991bc815-ac5c-4069-8583-10e7e7c8c712 req-b8612924-7251-4140-8660-62f5c539866c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097347 Aug 29 10:54:23.504383 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2262/4515] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:24.024312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:24.047322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18f40368-2e38-4782-b78a-789479a0ac2b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.703836 Aug 29 10:54:24.049311 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2254/4516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:23 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:24.372144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:24.372879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:24.390116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:24.390653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:24.391109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:24.391861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:24.392332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:24.392771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:24.412376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:24.413648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:24.431894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:24.432400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:24.432846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:24.433571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:24.434063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:24.434585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:24.856690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:25.215366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:25.254831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:25.265773 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdc8d3b0-df78-4586-9ff6-f4974e360500 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.854539 Aug 29 10:54:25.275487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2255/4517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:24 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:25.295739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:25.300579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:25.326475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:25.327818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:25.330576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:25.335459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:25.335950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:25.339116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:25.339696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:25.365345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:25.367143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:25.369191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b21f0284-c730-4bd9-8c6a-ba30a4ed6233 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2946 microversion: 2.32 time: 1.006423 Aug 29 10:54:25.404511 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2263/4518] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:24 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2946 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:25.411636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "fac7f7da-8cf8-4406-ae02-640005dca23c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:25.428958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:25.431561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:25.432603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:25.456213 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] Creating event network-vif-unplugged:fac7f7da-8cf8-4406-ae02-640005dca23c for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:25.467330 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cf8aa8be-6d60-49a6-8ebe-df6902c39a0d req-9e07fa94-58de-4173-9b5e-5d4a74cf09aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060685 Aug 29 10:54:25.467958 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2264/4519] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:25.747011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:25.758531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6b1ceb07-34ca-4956-b21b-14c7fff67e7a tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.481594 Aug 29 10:54:25.759133 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2256/4520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:25 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:26.331394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:26.332608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:26.371931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:26.374191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:26.376015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:26.378394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:26.380434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:26.383551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:26.412942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:26.413563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:26.434673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:26.435430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:26.436044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:26.436937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:26.437550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:26.438159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:27.147365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:27.165603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d746850-9ddc-43f9-9abb-77376c6b8ff5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.863263 Aug 29 10:54:27.178701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2265/4521] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:26 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:27.196410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:27.198439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:27.223421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:27.225146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:27.225605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:27.226551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:27.227397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:27.229260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:27.594819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:27.606156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:27.607601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:27.608862 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-edb7e657-ed56-4e70-b587-24192fb22df3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2925 microversion: 2.32 time: 1.201800 Aug 29 10:54:27.645077 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2257/4522] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:26 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2925 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:54:27.677405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "61eeaaae-4621-43d9-aad2-3e22a010a9da"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "990c889f-15bb-4bc8-8674-6d5ffc9fa781"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "95f22f43-ba65-4323-8dc1-b3d94b0cd93d"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "274fa1af-4d11-424e-b9a9-d946b476348f"}, {"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-unplugged", "status": "completed", "tag": "c33d5932-5453-449b-9e0f-2a24c345b9bc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:27.722492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:27.722980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:27.723411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:27.804451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Creating event network-vif-unplugged:61eeaaae-4621-43d9-aad2-3e22a010a9da for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:27.806381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Creating event network-vif-unplugged:990c889f-15bb-4bc8-8674-6d5ffc9fa781 for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:27.807067 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Creating event network-vif-unplugged:95f22f43-ba65-4323-8dc1-b3d94b0cd93d for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:27.807578 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Creating event network-vif-unplugged:274fa1af-4d11-424e-b9a9-d946b476348f for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:27.813861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] Creating event network-vif-unplugged:c33d5932-5453-449b-9e0f-2a24c345b9bc for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:27.827021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-16d75c35-b3b8-4878-b1ee-8653f4c90fda req-a8992903-d639-4d3c-a996-c23c15ea075b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.180568 Aug 29 10:54:27.827634 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2258/4523] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:28.191172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:28.191866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:28.208443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:28.208940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:28.209379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:28.210125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:28.210599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:28.211016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:28.299173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:28.328237 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bd85f35-5673-440c-8fbf-e624d16dca0e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 1.144289 Aug 29 10:54:28.328845 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2266/4524] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:27 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:28.644597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:28.645434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:28.668334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:28.668968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:28.669371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:28.670027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:28.671371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:28.671371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:29.262512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:29.274203 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38394469-c966-45b1-b348-585aadfdf69e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 1.086962 Aug 29 10:54:29.296705 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2259/4525] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:28 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:29.354274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:29.354894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:29.375183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:29.375681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:29.376117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:29.387944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:29.388236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:29.388717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:29.718645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:29.778782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:29.782675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:29.786882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8605b9bd-8ec5-4ecd-9f6d-7b61fedf30de tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2925 microversion: 2.32 time: 1.147033 Aug 29 10:54:29.788399 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2267/4526] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:28 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2925 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:30.110698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:30.131400 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-37437c6f-527e-4f55-ad52-226776860d20 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.781887 Aug 29 10:54:30.146745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2260/4527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:29 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:30.304243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:30.305777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:30.320290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:30.325955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:30.326629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:30.334967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:30.335632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:30.336222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:30.820077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:30.821873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:30.829788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:30.830188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:30.831797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:30.833786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:30.834577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:30.834862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:32.313997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:32.340707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:32.358133 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2fdd9ab1-1f16-42ef-8564-d7d197f15515 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 2.058125 Aug 29 10:54:32.364024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:32.374170 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2268/4528] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:30 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:32.376936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:32.381520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bca14d85-4f92-4b31-9b8e-8db880b53b80 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2904 microversion: 2.32 time: 1.565301 Aug 29 10:54:32.401091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:32.401091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:32.404141 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2261/4529] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:30 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2904 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:32.411478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:32.411478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:32.411478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:32.414334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:32.414334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:32.414334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:32.767625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-deleted", "tag": "fac7f7da-8cf8-4406-ae02-640005dca23c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:32.792414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:32.794826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:32.795539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:32.836617 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] Creating event network-vif-deleted:fac7f7da-8cf8-4406-ae02-640005dca23c for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:32.846942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-cf3c66eb-9545-42b9-9997-ee0b16730c5d req-b9e9c7ef-9954-4e09-90ee-3ceb02086ce7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086593 Aug 29 10:54:32.853215 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2262/4530] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:54:33.388707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:33.390367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:33.416835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:33.421830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:33.424247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:33.425452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:33.426235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:33.429289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:33.676314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:33.698300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2159eaa1-4553-46c7-8a10-239fc0843d16 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 1.315654 Aug 29 10:54:33.699561 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2269/4531] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:32 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:33.715812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:33.719805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:33.752437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:33.755247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:33.757828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:33.759574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:33.764718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:33.771141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:34.593334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:34.603266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d775d99a-23ce-4c88-a488-a55a77026531 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 1.220337 Aug 29 10:54:34.603858 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2263/4532] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:33 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:34.619070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf95a48-30a4-4c34-9d17-a05ed95bfd8c", "name": "network-vif-plugged", "status": "completed", "tag": "7aa5413e-eba7-4acf-804a-81dda6e9b2c9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:34.647172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:34.648042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:34.650557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:34.755196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:34.778312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:34.780649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:34.787649 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-540f2807-2173-4175-a15a-b28901044b79 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2745 microversion: 2.32 time: 1.086665 Aug 29 10:54:34.791554 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2270/4533] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:33 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2745 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:34.814120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:34.815243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:34.823588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:34.825772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:34.828826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:34.829914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:34.831329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:34.832985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:35.326659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] Creating event network-vif-plugged:7aa5413e-eba7-4acf-804a-81dda6e9b2c9 for instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c on n-h1-854121-10 Aug 29 10:54:35.337641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f4566f77-052f-4037-bd27-8b3e50165cff req-fea1e3e2-cc80-4dff-819c-2892e75b3fce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.725858 Aug 29 10:54:35.338452 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2264/4534] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:35.560548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:35.583266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1fa5ef7-1556-47de-b400-d8467b456979 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 0.790089 Aug 29 10:54:35.584251 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2271/4535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:34 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:35.635790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:35.637191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:35.644911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:35.653042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:35.654049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:35.655432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:35.656249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:35.657077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:35.817727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:35.819741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:35.834711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:35.835669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:35.837072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:35.837955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:35.838556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:35.839261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:36.294274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:36.303938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-36d1e4a6-dc3b-43fa-b0a9-29e38b6f8b95 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 0.682181 Aug 29 10:54:36.306621 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2265/4536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:35 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:36.351540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:36.368793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:36.374747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:36.380518 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7dc5781c-6e1a-4ab3-a726-8ecfd2f6077e tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2745 microversion: 2.32 time: 0.568660 Aug 29 10:54:36.383961 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2272/4537] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:35 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2745 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:36.609731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:36.610500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:36.624570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:36.625441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:36.626136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:36.627073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:36.627771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:36.628439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:37.330111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:37.340154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:37.371686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:37.372202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:37.375882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:37.380565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:37.381069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:37.381515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:37.828404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:37.842258 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11b18473-47ec-44d6-8266-6d868c26f7ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 1.235828 Aug 29 10:54:37.846013 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2266/4538] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:36 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:37.850914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:37.865955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:37.881322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:37.885267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:37.885968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:37.887833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:37.890346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:37.892166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:38.479327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:38.496039 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f34e94b-bdb2-4cf9-9893-4c869c5ada4a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1308 microversion: 2.1 time: 1.172327 Aug 29 10:54:38.506335 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2273/4539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:37 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1308 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:38.521667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-deleted", "tag": "c33d5932-5453-449b-9e0f-2a24c345b9bc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:38.559328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:38.562825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:38.563561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:38.611830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] Creating event network-vif-deleted:c33d5932-5453-449b-9e0f-2a24c345b9bc for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:38.634275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e1e6ddbf-b2dc-455f-bd2d-7ac2f29e6b86 req-9d1d2d56-90c4-4c4a-8555-4dcd355d6f34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122090 Aug 29 10:54:38.636250 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2274/4540] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:38.696524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:38.708455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:38.729775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:38.732944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8e3117b1-809f-4899-bc29-7ee31ef4d361 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2700 microversion: 2.32 time: 0.885719 Aug 29 10:54:38.756163 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2267/4541] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:37 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2700 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:38.868176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:38.869275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:38.900805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:38.901664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:38.903172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:38.915406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:38.921556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:38.926969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:39.530873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:39.531548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:39.545738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:39.551240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:39.552232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:39.553569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:39.555151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:39.555947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:40.776791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:40.790893 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5740f774-b2ea-44f6-b954-19c7ad72539f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1490 microversion: 2.1 time: 1.264015 Aug 29 10:54:40.791479 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2268/4542] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:39 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1490 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:40.812338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:40.814402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:40.822785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:40.823723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:40.824327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:40.825235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:40.825886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:40.826471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:40.834636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:40.882958 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f206d4bd-c007-420e-b109-79a157efc839 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1720 microversion: 2.1 time: 2.014162 Aug 29 10:54:40.884817 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2275/4543] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:38 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1720 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:40.893436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-deleted", "tag": "274fa1af-4d11-424e-b9a9-d946b476348f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:40.907208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:40.908074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:40.908741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:40.947871 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] Creating event network-vif-deleted:274fa1af-4d11-424e-b9a9-d946b476348f for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:40.960119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d0df44bb-28cd-4a69-a0fc-f11ad10e3d6b req-f15e6049-0f9e-428b-8e85-2a82786ceec2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073564 Aug 29 10:54:40.961969 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2276/4544] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:40.970500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:40.978513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:40.999543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.000711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.001471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:41.002572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.003332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.004257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:41.249419 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b484d5fd-5bf8-4f79-811e-2de9fc7fa2dc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "PUT /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1085 microversion: 2.1 time: 0.285687 Aug 29 10:54:41.265278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2277/4545] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:54:40 2022] PUT /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1085 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:41.273288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:41.286096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:41.306008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.313950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.314796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:41.317611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.319902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.323855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:41.495247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:41.522699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:41.522699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:41.522699 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23932a31-d9d4-4204-a168-8868567503aa tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2369 microversion: 2.32 time: 0.713573 Aug 29 10:54:41.548415 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2269/4546] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:40 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2369 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:41.904908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:41.905557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:41.908973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:41.944804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.945401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.945984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:41.946714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:41.974768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:41.975343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:42.046702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:42.141018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:42.145617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:42.153152 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33ade6e8-1179-4243-bad2-72f0b5bce2b0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1511 microversion: 2.1 time: 0.884079 Aug 29 10:54:42.168839 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2278/4547] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:41 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:42.589773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:42.650274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-186534ab-5f54-4eff-87e1-05b048912094 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: .version_select at 0x7f66c5b7b0d0>, body: {"keypair": {"name": "tempest-keypair-777544132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpcezew8PmPWdQUSaJkTMHwyYdYeXteIGvphSCd1Roymu21phZ/RSpTL4Rk5jRaKSIFUs0R56hYFNpVTkm2xLrRIXb5f1XEOKISyuShs+oKPobYumUT5f9mjIvKcSdR8Q=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:42.657641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33d6732c-803f-45df-8a92-4cd301b73998 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1697 microversion: 2.1 time: 0.739404 Aug 29 10:54:42.659816 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2270/4548] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:41 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1697 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:42.676959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:42.678428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-186534ab-5f54-4eff-87e1-05b048912094 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:42.686502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-186534ab-5f54-4eff-87e1-05b048912094 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:42.686980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:42.722183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:42.723106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:42.726315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:42.730189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:42.732281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:42.734268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:42.736172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-186534ab-5f54-4eff-87e1-05b048912094 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.563246 Aug 29 10:54:42.736783 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2279/4549] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:54:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:43.688003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:43.709945 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1b78c24-28f4-437c-8d2a-638e8abe4ec2 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1511 microversion: 2.1 time: 1.043220 Aug 29 10:54:43.712961 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2271/4550] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:42 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1511 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:43.736536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:43.737469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:43.747447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Action: 'create', calling method: .version_select at 0x7f66c62548b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:43.751730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:43.756897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:43.758665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:43.762894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:43.765788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:43.766473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:43.854105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Getting quotas for project fd2f5888ff924a658eafbad90dd2a428. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:43.888727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Getting quotas for user a772064e6e6244ef927a05d6f8630aa3 and project fd2f5888ff924a658eafbad90dd2a428. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:43.989238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Getting quotas for project fd2f5888ff924a658eafbad90dd2a428. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:44.011011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Getting quotas for user a772064e6e6244ef927a05d6f8630aa3 and project fd2f5888ff924a658eafbad90dd2a428. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:44.063302 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5bdf82b3-01f4-4587-bffb-618e0647c0a2 tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.324426 Aug 29 10:54:44.064299 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2280/4551] 10.222.0.47 () {62 vars in 1214 bytes} [Mon Aug 29 10:54:42 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:54:44.078548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:44.100835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:44.102411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:44.119362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:44.121617 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b155782-6f73-408c-9e6f-7ee3d154457b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 2144 microversion: 2.32 time: 0.405296 Aug 29 10:54:44.127587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.130593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.131372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.150213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2272/4552] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:43 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 2144 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:44.165023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-deleted", "tag": "990c889f-15bb-4bc8-8674-6d5ffc9fa781"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:44.234105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.243084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.247767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.262737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Going to try to start instance {{(pid=128681) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 10:54:44.302627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] Creating event network-vif-deleted:990c889f-15bb-4bc8-8674-6d5ffc9fa781 for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:44.330484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-806122b6-7b07-4c23-b90f-e248875da94f req-fd739f5a-e91d-4016-99de-6175ef2d2d52 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193469 Aug 29 10:54:44.346068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2273/4553] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:44.386096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:44.386096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:44.410714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.411229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.427933 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c269f408-9a36-4772-943b-fe71935137ba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action" status: 202 len: 0 microversion: 2.1 time: 0.345144 Aug 29 10:54:44.434270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.434974 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2281/4554] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:54:44 2022] POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:54:44.443824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.444689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.449544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.494962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fdbebc8b-0318-419a-b47c-27ab5342bd7a tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:44.557679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:54:44.572487 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fdbebc8b-0318-419a-b47c-27ab5342bd7a tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.131692 Aug 29 10:54:44.573098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2282/4555] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 29 10:54:44 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:54:44.593684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:44.597576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:44.623310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.623805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.630985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.631375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:44.631862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:44.632294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:44.908843 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f474e88d-adbf-4f3c-a5c0-8049afaf227e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 204 len: 0 microversion: 2.1 time: 0.560322 Aug 29 10:54:44.912070 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2274/4556] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:54:44 2022] DELETE /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:54:44.948132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a62be7f-aa84-407a-8ebd-33f694f425df tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:45.020952 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a62be7f-aa84-407a-8ebd-33f694f425df tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393" status: 200 len: 235 microversion: 2.64 time: 0.102572 Aug 29 10:54:45.027729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2275/4557] 10.222.0.47 () {60 vars in 1304 bytes} [Mon Aug 29 10:54:44 2022] GET /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 => generated 235 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:54:45.056833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:45.059808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:45.088843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:45.094384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:45.094914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:45.104420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:45.104976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:45.105437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:45.440458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:45.455856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c86686ef-a52c-4361-9b53-bae1d620e662 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1706 microversion: 2.1 time: 0.877424 Aug 29 10:54:45.477596 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2283/4558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:44 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1706 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:45.497490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a709960-3456-4747-92b0-9f9954f8e21a tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:45.577918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:54:45.682818 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a709960-3456-4747-92b0-9f9954f8e21a tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393" status: 204 len: 0 microversion: 2.64 time: 0.203402 Aug 29 10:54:45.691076 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2284/4559] 10.222.0.47 () {60 vars in 1307 bytes} [Mon Aug 29 10:54:45 2022] DELETE /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:54:45.710303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:45.721586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:45.752612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:45.752830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:45.753556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:45.759887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:45.760986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:45.762752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:45.769906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:45.773910 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca2b1f32-bbc2-48cf-b65a-6c8cff0d9f19 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1517 microversion: 2.1 time: 0.742657 Aug 29 10:54:45.790830 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2276/4560] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:45 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1517 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:45.807026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acd83bec-cd8d-487b-a04b-600fa5a9e7cf tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:45.822024 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-acd83bec-cd8d-487b-a04b-600fa5a9e7cf tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] HTTP exception thrown: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acd83bec-cd8d-487b-a04b-600fa5a9e7cf tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Request method failure captured: Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 HTTP/1.1 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJryNL9txmmvoQxKVADfyDPaJEkKHKZS4Eo4CRrhs93GxxqfZh0_Z6JKePv2HkVfscS7ucxVvNquEiIHRtkJDj7V3snnrU30sd64rB34W-0On2ABw7ZuxwOj86mDHGqTdiXSgce4Qr0wXVPZgvd7HnSUXHWNNhhiVH_SjH4Y6v6u3no Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.64 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: fd2f5888ff924a658eafbad90dd2a428 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerGroup264TestJSON-1148448011 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fd2f5888ff924a658eafbad90dd2a428"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fd2f5888ff924a658eafbad90dd2a428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fd2f5888ff924a658eafbad90dd2a428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fd2f5888ff924a658eafbad90dd2a428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerGroup264TestJSON-1148448011 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: fd2f5888ff924a658eafbad90dd2a428 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1148448011 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerGroup264TestJSON-1148448011-project Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a772064e6e6244ef927a05d6f8630aa3 Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerGroup264TestJSON-1148448011-project Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '45ace4b1-ac22-4dc7-bde6-98dbbf4dc393'} Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:45.834260 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. Aug 29 10:54:45.839262 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:54:45.840612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acd83bec-cd8d-487b-a04b-600fa5a9e7cf tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] Returning 404 to user: Instance group 45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:45.842224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-acd83bec-cd8d-487b-a04b-600fa5a9e7cf tempest-ServerGroup264TestJSON-1148448011 tempest-ServerGroup264TestJSON-1148448011-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393" status: 404 len: 117 microversion: 2.64 time: 0.050265 Aug 29 10:54:45.847388 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2277/4561] 10.222.0.47 () {60 vars in 1307 bytes} [Mon Aug 29 10:54:45 2022] DELETE /compute/v2.1/os-server-groups/45ace4b1-ac22-4dc7-bde6-98dbbf4dc393 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:54:46.266907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:46.281832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:46.295576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:46.306935 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c00a19e1-b65f-47ba-b0ee-603cf6bff297 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.613883 Aug 29 10:54:46.309944 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2285/4562] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:45 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:46.449448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb47083d-299b-4045-a28b-87945b3cb372", "name": "network-vif-deleted", "tag": "61eeaaae-4621-43d9-aad2-3e22a010a9da"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:46.480528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:46.481016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:46.481450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:46.483018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:46.483649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:46.495706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:46.496211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:46.496664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:46.497384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:46.512882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:46.513836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:46.535178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] Creating event network-vif-deleted:61eeaaae-4621-43d9-aad2-3e22a010a9da for instance eb47083d-299b-4045-a28b-87945b3cb372 on n-h1-854121-10 Aug 29 10:54:46.561669 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4b08ccb4-ec1c-43e2-9a79-882cfd629b2a req-6897c22a-4a10-4ffb-a0b9-4c08229ad991 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112016 Aug 29 10:54:46.564121 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2278/4563] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:46.829264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:46.832616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:46.850971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:46.862332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:46.863472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:46.864580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:46.873231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:46.875551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:48.616934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:48.620463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:48.629650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9267927-236d-4a3b-b502-294d7ebd1d22 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1706 microversion: 2.1 time: 2.152721 Aug 29 10:54:48.631087 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2286/4564] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:46 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1706 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:48.646365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:48.647193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:48.651972 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4762db18-c5e1-4bd6-8730-2a8deef2ee89 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1517 microversion: 2.1 time: 1.839620 Aug 29 10:54:48.654619 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2279/4565] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:46 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1517 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:48.672005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:48.672845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:48.673732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:48.675155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:48.675840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:48.676939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.348210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:49.401256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:49.407379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:49.417324 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2cf8899f-d284-445c-9613-aa3981141191 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.776464 Aug 29 10:54:49.418090 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2287/4566] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:48 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:49.496160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf95a48-30a4-4c34-9d17-a05ed95bfd8c", "name": "network-vif-deleted", "tag": "7aa5413e-eba7-4acf-804a-81dda6e9b2c9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:49.530597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:49.531276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:49.534499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.599222 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] Creating event network-vif-deleted:7aa5413e-eba7-4acf-804a-81dda6e9b2c9 for instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c on n-h1-854121-10 Aug 29 10:54:49.607731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0cc4d73c-233e-44ed-ae45-58ee732be7cb req-ba7367c0-92ec-455c-b666-62b9c9334f11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116336 Aug 29 10:54:49.613332 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2280/4567] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:54:49.656690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:49.659251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:49.678885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:49.682110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:49.682281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:49.682909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:49.683961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.687606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:49.688382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:49.690191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.698589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:49.702329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:49.703383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.707679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:49.709066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:49.710339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:49.923321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:49.932696 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43673a0d-4b88-4400-9e9f-5bfd367bf5c9 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 200 len: 1314 microversion: 2.1 time: 0.256197 Aug 29 10:54:49.953729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2281/4568] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:49 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:49.953729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-371853219", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "603a8da8-8c3d-423e-879b-e3e712d1b689"}], "security_groups": [{"name": "tempest-securitygroup--1132945111"}], "key_name": "tempest-keypair-777544132", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:50.466220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:50.514358 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12141050-9ad7-4f58-8b16-20cde98a4fb5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1706 microversion: 2.1 time: 0.860133 Aug 29 10:54:50.518130 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2288/4569] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:49 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1706 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:50.535992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:50.538427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:50.569310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:50.574557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:50.575326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:50.576282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:50.576939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:50.577553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:50.608709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] validate_networks() for [('603a8da8-8c3d-423e-879b-e3e712d1b689', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:54:50.863718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:50.881924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:50.883776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:50.885011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27357ea2-ad95-4522-a47e-979dcaedc1a3 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.364974 Aug 29 10:54:50.913619 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2289/4570] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:50 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:50.968563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:50.969502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:50.981490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:50.982899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:50.983655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:50.984535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:50.985145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:50.985731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:51.059597 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c HTTP/1.1 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3bf95a48-30a4-4c34-9d17-a05ed95bfd8c'} Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:51.066380 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:54:51.071376 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:54:51.074053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:54:51.076805 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-984f2e55-7979-4d81-b5ba-6218987217a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 404 len: 111 microversion: 2.1 time: 0.113013 Aug 29 10:54:51.082447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2290/4571] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:50 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:54:51.357402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-466908690", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2ee7939e-e4fc-4ba5-bb8c-c676722f7972"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:54:51.469501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] validate_networks() for [('2ee7939e-e4fc-4ba5-bb8c-c676722f7972', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:54:52.983390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:54:52.984526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:54:52.985147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:54:52.985850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:54:52.986411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:54:53.014003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.014757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.015380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.016298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.016914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.020666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.063268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:53.070190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:53.095897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:54:53.098489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:54:53.178670 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27c09f84-fa92-4108-9937-a0a86e98ab53 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.234759 Aug 29 10:54:53.181747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2282/4572] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:54:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 3238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:54:53.193377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:53.194329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:53.208167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.212630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.213497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.214442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.215075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.219585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.546006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:53.563533 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b91c7df-13d7-4613-b176-88a3af0cdd1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1710 microversion: 2.1 time: 0.380292 Aug 29 10:54:53.564460 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2283/4573] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:53 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1710 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:53.569120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:53.569751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:53.586741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.587241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.587686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.588410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.588847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.589290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.706738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:54:53.707384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:54:53.708042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:54:53.708619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:54:53.709176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:54:53.724340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:53.734214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.734716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.735165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.740760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:53.741325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:53.743400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:53.743594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:53.746113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:53.750054 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-167ef842-4bee-435b-9500-e3456abe1161 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.183275 Aug 29 10:54:53.763702 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2284/4574] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:53 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:53.781791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30432657-2cf5-467d-9e41-ce60cbf251fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:53.782737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30432657-2cf5-467d-9e41-ce60cbf251fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:53.797511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:54:53.814358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Getting quotas for user 08e18b3218b242b395b40f47b805ecba and project 171770ebf8df4976a71ea87cfb51e023. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:54:53.844680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:54:53.849408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:54:53.859150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-30432657-2cf5-467d-9e41-ce60cbf251fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:53.869596 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30432657-2cf5-467d-9e41-ce60cbf251fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1237 microversion: 2.1 time: 0.099013 Aug 29 10:54:53.873692 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2285/4575] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:53 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:53.956566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-209e6e94-61ed-4b8c-b709-a4e8c201abba tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.602898 Aug 29 10:54:53.961764 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2291/4576] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:54:53.968818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c951acf-abd0-4390-a963-dd29419bda73 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:53.969435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c951acf-abd0-4390-a963-dd29419bda73 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:54.181893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c951acf-abd0-4390-a963-dd29419bda73 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:54.217041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c951acf-abd0-4390-a963-dd29419bda73 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1208 microversion: 2.1 time: 0.250887 Aug 29 10:54:54.229466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2286/4577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:53 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1208 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:54.783587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:54.784868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:54.818163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:54.823804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:54.825643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:54.828825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:54.829503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:54.832310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:54.894566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:54.895388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:54.916561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:54.917295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:54.917887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:54.918793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:54.920003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:54.920859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:55.018007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:55.033536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:55.036642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:55.041016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33b6c072-480b-4821-9796-da831d354251 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.265599 Aug 29 10:54:55.042181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2292/4578] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:54 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:54:55.079484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:55.093639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-caaaa395-f3f8-410e-a4e0-848a40331fa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1241 microversion: 2.1 time: 0.203166 Aug 29 10:54:55.094793 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2287/4579] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:54 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:55.247344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:55.249725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:55.271944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:55.275014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:55.276269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:55.279059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:55.279813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:55.282517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:55.486474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:55.505393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77d6c0d3-f8bd-4b2f-b723-3cccd41c90eb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1212 microversion: 2.1 time: 0.265557 Aug 29 10:54:55.511456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2293/4580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:55 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1212 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:56.084698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:56.086920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:56.114561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.116865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.117254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.122047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.122595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.123201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.132549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:56.134073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:56.150781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.151279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.151722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.152435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.152892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.153316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.402204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:56.410259 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38465069-2528-483b-b432-c721206f1f5d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1297 microversion: 2.1 time: 0.281982 Aug 29 10:54:56.410799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2294/4581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:56 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1297 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:54:56.436667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:56.453009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:56.454573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:56.459160 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c91fdd8-bd76-4337-aa2c-4281d75ace07 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.379626 Aug 29 10:54:56.459810 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2288/4582] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:56 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:54:56.532042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:56.533108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:56.544405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.545899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.546874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.548876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:56.549663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:56.550492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:56.893814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:56.903465 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f89dcec0-5042-498e-ac60-df1f5053fbeb tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1268 microversion: 2.1 time: 0.375193 Aug 29 10:54:56.906275 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2295/4583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:56 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1268 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:57.433480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:57.434301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:57.458025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.458989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.460202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:57.462108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.466346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.471258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:57.484103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:57.484874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:57.513878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.516744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.517235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:57.521515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.529303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.530707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:57.761360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:57.769783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:57.770322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cbdca6a-d8fb-42fe-9d3c-a1253a9bde58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1295 microversion: 2.1 time: 0.342468 Aug 29 10:54:57.775841 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2289/4584] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:57 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1295 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:57.808140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:57.815065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:57.816355 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68db57ab-ad85-44cb-8d51-722da8d54d83 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.336410 Aug 29 10:54:57.816908 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2296/4585] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:57 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:54:57.927519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:57.928900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:57.950371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.951022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.954458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:57.955263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:57.959222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:57.962633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:58.697279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:58.718496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-968446a5-806b-4dd1-b6d9-5667398da51d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.794496 Aug 29 10:54:58.722694 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2290/4586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:57 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:58.795046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:58.795664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:58.803962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:58.809436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:58.810161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:58.811077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:58.819068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:58.819567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:58.846205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:58.847092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:58.860039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:58.860787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:58.861635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:58.874760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:58.875554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:58.876204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:59.051158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:59.062255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:59.067577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:59.071297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68cc3fb4-f148-4004-9973-8279fabbfda1 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.229039 Aug 29 10:54:59.076211 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2291/4587] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:54:58 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:54:59.742661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:54:59.744164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:54:59.746783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:54:59.755899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41d15ef9-cbab-4826-9f01-308db9d80133 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.964673 Aug 29 10:54:59.762156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2297/4588] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:58 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:54:59.777209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:59.777757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:59.778185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:59.781600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:54:59.785759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:54:59.786438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:54:59.803038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:00.105210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:00.108434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:00.117315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:00.118826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:00.119616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:00.120931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:00.121681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:00.122486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:00.876054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:00.887359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:00.897791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:00.899523 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4755c4d0-1530-484d-af88-4b2ef243314b tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.800799 Aug 29 10:55:00.923193 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2298/4589] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:00 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:00.930448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:00.941005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:00.941907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:00.943634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:00.963753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] Creating event network-changed:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:55:00.982680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a122c3c6-c0c5-44bd-9eb0-f84a175cdda2 req-305f89a0-f845-4bd2-a4d4-5c21ad9f0a9e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057452 Aug 29 10:55:00.983683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2299/4590] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:00.990720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:00.991901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:01.002188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:01.003157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:01.004074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:01.005360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:01.006211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:01.007002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:01.040987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:01.250872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:01.271393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb798346-abd7-4907-b03e-d5fb9e163bc5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 1.533483 Aug 29 10:55:01.274383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2292/4591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:54:59 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:01.750230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:01.760431 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f5d3e2b-b8ac-40cc-95c2-aeafd12af35c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.774871 Aug 29 10:55:01.761018 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2300/4592] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:00 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:01.934815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:01.937764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:01.958596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:01.960095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:01.967280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:01.970472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:01.975357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:01.977846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:02.093567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:02.111239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:02.113656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:02.116875 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4092a0b5-988a-43e7-849e-ac96a56631ee tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.193585 Aug 29 10:55:02.117752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2293/4593] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:01 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:02.295143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:02.298175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:02.306693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:02.309843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:02.310699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:02.311576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:02.312651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:02.313294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:02.389465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff68ddfe-ec77-4f72-879a-0506436d0357", "tag": "045f0bd4-f72c-43b9-b91f-799899f11286"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:02.415318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:02.418383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:02.419164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:02.441532 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] Creating event network-changed:045f0bd4-f72c-43b9-b91f-799899f11286 for instance ff68ddfe-ec77-4f72-879a-0506436d0357 on n-h1-854121-10 Aug 29 10:55:02.456990 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fe40e870-a659-4b79-8817-dfd3d6210a87 req-1cc765cb-ada5-4221-bcf3-b47ddbdad877 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.460284 Aug 29 10:55:02.460403 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2301/4594] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:55:02.740254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:02.750912 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb3eb020-6a40-4383-a439-c733e75d92db tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.460280 Aug 29 10:55:02.770409 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2294/4595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:02 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:02.786110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:02.787063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:02.806649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:02.809081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:02.810117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:02.812776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:02.813611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:02.814403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:03.143494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:03.144380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:03.153251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:03.165765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:03.166863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:03.168271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:03.170285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:03.170957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:03.172497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:03.207498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:03.216653 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16c9e2ba-294a-4bac-bade-d9cdbf5170b3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.439886 Aug 29 10:55:03.227209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2302/4596] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:02 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:03.325865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:03.341844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:03.341844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:03.347724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-650b6f64-f227-4dd6-ac58-4ca7b06e1b11 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.203865 Aug 29 10:55:03.362368 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2295/4597] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:03 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:55:03.784504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:03.785624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:03.794360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:03.797997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:03.799128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:03.800361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:03.802208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:03.807146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:03.808214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:03.843947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:04.008069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:04.019556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c48c9c8e-dbf5-4749-ac9a-3e657f2930ab tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.241162 Aug 29 10:55:04.021065 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2303/4598] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:03 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:04.249211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:04.250203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:04.266287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=10 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:04.272068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:04.274218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:04.276098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:04.277818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:04.278739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:04.281252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:04.371500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:04.372309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:04.378926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:04.382565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:04.383200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:04.384159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:04.384772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:04.385350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:04.630411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:04.652391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:04.655426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:04.658941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38e2bf92-6878-4b9a-877a-8b6c693c9668 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.292149 Aug 29 10:55:04.660949 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2304/4599] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:04 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:55:04.909798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:04.923755 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3eec7900-467b-4baa-8551-a02759d28b80 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.678673 Aug 29 10:55:04.940404 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2296/4600] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:04 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:05.042956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:05.043571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:05.059765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:05.060271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:05.068438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:05.071590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:05.072101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:05.075639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:05.463299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:05.474878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67d8a543-dc86-474d-aaaa-832e15217755 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.436355 Aug 29 10:55:05.480276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2305/4601] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:05 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:05.685391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:05.686035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:05.712533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:05.713788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:05.715108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:05.716056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:05.720606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:05.724699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:05.957121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:05.957776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:05.990344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:05.990868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:05.996326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:05.999542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:06.000382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:06.001008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:06.060083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:06.081013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:06.087043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:06.088803 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebcde012-7fd4-443f-a2c8-0f86444c5bc2 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.408062 Aug 29 10:55:06.095797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2297/4602] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:05 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:06.439686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:06.459968 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4426e719-8f74-40ef-b5cc-7d4dd00950de tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.507959 Aug 29 10:55:06.480322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2306/4603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:05 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:06.506038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:06.506707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:06.515277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:06.517055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:06.517504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:06.521000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:06.521479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:06.521947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:06.818619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:06.829502 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa8e3292-8d5a-4c7b-b6c6-dfb10caeaa1e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.327198 Aug 29 10:55:06.847042 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2298/4604] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:06 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:07.126690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:07.127566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:07.143732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.146047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.152462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:07.153437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.154101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.160154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:07.318692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:07.343976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:07.345419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:07.350961 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-628bd247-3f38-4299-b5ed-784bcf75979a tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.228055 Aug 29 10:55:07.365732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2307/4605] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:07 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:07.495514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:07.496052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:07.508095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.516356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.518942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:07.520259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.522122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.523727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:07.857049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:07.858203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:07.870894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.871461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.871833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:07.872550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:07.873005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:07.883369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:08.275828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:08.299026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a303110d-1ccf-47f6-bbab-436cfb0e28e8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.445686 Aug 29 10:55:08.308463 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2308/4606] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:07 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:08.383945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:08.384843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:08.400690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:08.403881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:08.404479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:08.405356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:08.411184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:08.411797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:08.594561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:08.604876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d834b6a-83e8-4b5c-b1c3-98aeb8523631 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 1.114220 Aug 29 10:55:08.613470 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2299/4607] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:07 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:08.673656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:08.690465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:08.692362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:08.698994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f810820-688a-4c21-9dda-21936a3bf816 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.319998 Aug 29 10:55:08.700400 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2309/4608] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:08 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:09.336598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:09.337371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:09.375516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.376537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.377479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.379645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.380539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.382886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.592954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-plugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:09.630035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.630694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.630928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.669157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] Creating event network-vif-plugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:55:09.686564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-765c4fd6-2b81-401d-917d-049c0ab99fff req-25ab9b81-a1c6-4ee6-8616-274523aff83f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.543294 Aug 29 10:55:09.695742 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2300/4609] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:09.710364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:09.711042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:09.772334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.773237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.774047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.775044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.782092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.782799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.916349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:09.929812 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-040383d4-dff6-488e-a42f-81590c41cd34 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.603009 Aug 29 10:55:09.932030 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2310/4610] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:09 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:09.947592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:09.948398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:09.965869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.966513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.967081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:09.968984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:09.969491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:09.972124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:10.278651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:10.293131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:10.294706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:10.295969 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-999ca7c7-d1ff-4dcf-ab24-6fe76238947c tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.362001 Aug 29 10:55:10.323548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2311/4611] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:09 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:10.337078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:10.346994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a8d34094-3269-4bab-bd01-e6f20a766184 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1363 microversion: 2.1 time: 0.642422 Aug 29 10:55:10.350427 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2301/4612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:09 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1363 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:10.951702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:10.952338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:10.968592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:10.969787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:10.970248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:10.971171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:10.971801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:10.972422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.325971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:11.326601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:11.343792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:11.345245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:11.346729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.349229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:11.349993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:11.350620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.635954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:11.664028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:11.668081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:11.673452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a60ed4cc-d379-4fe7-9cba-7bc38558e0d8 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1604 microversion: 2.32 time: 0.351610 Aug 29 10:55:11.674451 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2302/4613] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:11 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:55:11.704252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:11.705837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:11.709477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:11.723854 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61e4ba55-556a-4478-bed0-3c4e3b06024a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.773705 Aug 29 10:55:11.733789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2312/4614] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:10 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:11.735144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:11.741863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:11.742641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.743930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:11.746686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:11.749512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.758781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff68ddfe-ec77-4f72-879a-0506436d0357", "name": "network-vif-plugged", "status": "completed", "tag": "045f0bd4-f72c-43b9-b91f-799899f11286"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:11.783548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:11.784156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:11.784681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:11.824093 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] Creating event network-vif-plugged:045f0bd4-f72c-43b9-b91f-799899f11286 for instance ff68ddfe-ec77-4f72-879a-0506436d0357 on n-h1-854121-10 Aug 29 10:55:11.847580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f12115de-23fa-48cb-9798-ce6e5a2dff20 req-1569fb08-383d-49cd-aaf0-f4a188e9606a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093529 Aug 29 10:55:11.850507 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2313/4615] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:12.375181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:12.415338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33d60141-f7cf-4e83-8e95-9e7bcdf99c30 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1550 microversion: 2.1 time: 0.714223 Aug 29 10:55:12.416926 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2303/4616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:11 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1550 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:12.457145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:12.459166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:12.491198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.493694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.495438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.496636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.497336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.498167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.699670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:12.700570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:12.704499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:12.720387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.722250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.724548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.725634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.730451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.731279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.777650 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef863743-0df6-46f9-a664-9b90c411b28c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336823 Aug 29 10:55:12.779718 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2314/4617] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:55:12 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:12.793692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:12.794662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:12.809303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.811799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.812852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.814394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.817254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.817828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.841662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:12.842025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:12.842481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:12.854460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lazy-loading 'fault' on Instance uuid eb47083d-299b-4045-a28b-87945b3cb372 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:55:13.004818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:13.020086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:13.021540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49a766c739f647b1a3f0187f77519fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f057d6a6e36e46be8ea64b5cbf9a8075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:13.023352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35109df7-854d-4c51-9408-c9d70a9fd8bc tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 200 len: 1609 microversion: 2.32 time: 0.328124 Aug 29 10:55:13.039017 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2304/4618] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:12 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 1609 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:55:13.286262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:13.297988 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c7b6a4bf-0f0d-4433-826d-2f28342904d1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1308 microversion: 2.1 time: 0.516201 Aug 29 10:55:13.298625 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2315/4619] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:12 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:14.057823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:14.059096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:14.074474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.076177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.078084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.079106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.082836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.086816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.113422 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] HTTP exception thrown: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Request method failure captured: Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 HTTP/1.1 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJlrPF0xvNye84AJpP98IugBy-SpdcDWHNkD-q2BT5vXTopWeRpS_IdqerqNDbNgM2f3wER7k0nJCA3Rk-v-eQXe1m_JkfUKGbH-tS8VNbyDSXHjdzF_9XEnPT4CkfoB8-9olMSUgxjb3Bwuw7APMO4FhI4M7CfH8qUvaKLcYYM16_g Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 49a766c739f647b1a3f0187f77519fe5 Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'eb47083d-299b-4045-a28b-87945b3cb372'} Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:14.115443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:14.123894 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:14.125726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Returning 404 to user: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:14.126625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b5c05a7-29d1-4d58-8c61-54cd3a3a1549 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 404 len: 111 microversion: 2.32 time: 0.081022 Aug 29 10:55:14.127186 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2305/4620] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:14 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:55:14.135841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-713d7aa1-663b-40cf-8049-428413ef6655 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '.version_select at 0x7f66c6254d30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:14.164688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-713d7aa1-663b-40cf-8049-428413ef6655 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837590850" status: 204 len: 0 microversion: 2.32 time: 0.032421 Aug 29 10:55:14.169846 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2316/4621] 10.222.0.47 () {60 vars in 1259 bytes} [Mon Aug 29 10:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837590850 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 10:55:14.327992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:14.328617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:14.337392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.337932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.338589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.339470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.340269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.340849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.783533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:14.792784 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-839ebedb-f282-4b91-9a1c-2f1836656145 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1489 microversion: 2.1 time: 0.468618 Aug 29 10:55:14.799067 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2306/4622] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:14 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1489 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:14.823275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-164838812"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:14.826102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:14.834713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.836102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.837555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.838528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:14.839192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:14.840199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:14.969453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c6c37fe-ee34-4c02-9fd8-b925eaf2dd2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "PUT /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1074 microversion: 2.1 time: 0.150426 Aug 29 10:55:14.982906 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2317/4623] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:55:14 2022] PUT /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1074 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:14.992118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:14.994061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:15.002169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:15.003617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:15.004278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:15.005351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:15.006253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:15.006967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:15.343744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:15.360842 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7cafb0fb-8ce1-40bc-b639-e7dbfe76f60e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1500 microversion: 2.1 time: 0.377099 Aug 29 10:55:15.367723 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2307/4624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:14 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:15.384104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:15.384728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:15.401777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:15.404753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:15.405382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:15.406791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:15.407717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:15.408462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:15.865024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:15.877053 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ac9f1b7-0803-4ced-9384-721eb8f24a07 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1500 microversion: 2.1 time: 0.497292 Aug 29 10:55:15.879052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2318/4625] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:15 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1500 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:15.904456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:15.924878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:15.925520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:15.926030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:16.000380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Going to try to stop instance {{(pid=128682) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:55:16.076306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:16.097135 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10f929ab-2ce5-4ede-a08b-8ad83624454a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "POST /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357/action" status: 202 len: 0 microversion: 2.1 time: 0.197446 Aug 29 10:55:16.098652 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2308/4626] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:55:15 2022] POST /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:55:16.110888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:16.112357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:16.121849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:16.125362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:16.128239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:16.128790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:16.130615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:16.132488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:16.133766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:16.145465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:16.585947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:16.602363 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f80cd868-3541-4d5e-bd5b-000fe6f6aa55 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.495379 Aug 29 10:55:16.603668 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2319/4627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:16 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:16.812559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:16.835229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:16.838853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:16.840571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:16.860266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] Creating event network-changed:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:55:16.875382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d9e0ff36-5c65-4745-91d7-ffefebcb4bc9 req-5a94c406-548d-481a-808b-be142a0adcb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393096 Aug 29 10:55:16.881728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2309/4628] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:17.627527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:17.628712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:17.676454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:17.681875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:17.685155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:17.690880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:17.693493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:17.694949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:18.356445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:18.404802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-456bd6e2-c167-409d-8f38-886a5084870b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.783205 Aug 29 10:55:18.409551 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2320/4629] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:17 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:19.114330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-372839978", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:19.247678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] validate_networks() for [('98c0917f-76ac-4c1f-86c1-bef489f62319', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:55:19.431882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:19.434286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:19.447201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:19.447698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:19.448143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:19.452721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:19.454478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:19.456653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:20.025355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:20.070656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3aca0f46-9e35-4892-8365-895a2f76b6a1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.643684 Aug 29 10:55:20.071286 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2321/4630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:19 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:20.589164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:55:20.591049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:55:20.591739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:55:20.592264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:55:20.593740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:55:20.644030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:20.644629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:20.645154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:20.646171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:20.646988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:20.648249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:20.682868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Getting quotas for project 63f27b084a6846809e5ffc1b7b94b815. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:55:20.689505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Getting quotas for user a8db82f7f8094069a1f414a231ddd48f and project 63f27b084a6846809e5ffc1b7b94b815. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:55:20.722832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:55:20.728956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:55:20.795378 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-48b8c6e0-e1ab-4f1c-b8bd-11c39d6acb6b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915983 Aug 29 10:55:20.796381 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2310/4631] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:55:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:55:20.811080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b9f3448-b034-471a-8f59-68acde9fd059 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:20.811715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b9f3448-b034-471a-8f59-68acde9fd059 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:20.998077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b9f3448-b034-471a-8f59-68acde9fd059 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:21.008715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b9f3448-b034-471a-8f59-68acde9fd059 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1223 microversion: 2.1 time: 0.204040 Aug 29 10:55:21.009594 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2322/4632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:20 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1223 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:21.097968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:21.099481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:21.121581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:21.122183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:21.124736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:21.125471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:21.126020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:21.126482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:22.030028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:22.031217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:22.051130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:22.054767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:22.055445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:22.060830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:22.061527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:22.062176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:22.288896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:22.299804 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5bc78117-125a-4d18-af45-6ea14478ede6 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1227 microversion: 2.1 time: 0.273670 Aug 29 10:55:22.300401 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2323/4633] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:22 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1227 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:22.521413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:22.550213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ff13516-eb84-42ff-9fbe-6a92f74f3c2c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 1.456747 Aug 29 10:55:22.562305 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2311/4634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:21 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:22.961365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:22.962420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:22.970974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:22.971793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:22.972394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:22.973483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:22.994237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:22.994997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:23.172527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lazy-loading 'services' on Instance uuid b980d711-fd13-4285-8ee6-23599482ab10 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:55:23.283601 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83a107b2-edaf-44a1-900f-4985039c9d2d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments/b9bbd1d9-ab61-4938-bef0-8313deed8a2a" status: 202 len: 0 microversion: 2.1 time: 0.326762 Aug 29 10:55:23.284572 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2324/4635] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:55:22 2022] DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments/b9bbd1d9-ab61-4938-bef0-8313deed8a2a => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:55:23.321401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:23.322314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:23.340105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:23.342848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:23.343810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:23.346242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:23.348518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:23.350338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:23.573486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:23.574293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:23.586758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:23.587511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:23.588202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:23.590840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:23.591511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:23.593877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:23.775202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:23.783800 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e66f355d-2fbd-419d-ae1e-195f55112403 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1275 microversion: 2.1 time: 0.466918 Aug 29 10:55:23.797492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2312/4636] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:23 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:24.261188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:24.269476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb87c8a9-305b-403b-908a-771c6fa1aef6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.700711 Aug 29 10:55:24.272139 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2325/4637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:23 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:24.807223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:24.808431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:24.823228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:24.823941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:24.830543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:24.831354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:24.831844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:24.832292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.045150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:25.055662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23e9ee46-171e-4559-b2c8-1a2823493147 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1281 microversion: 2.1 time: 0.252269 Aug 29 10:55:25.074132 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2313/4638] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:24 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:25.124277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:25.125243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:25.135062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.135959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.137214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.142116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.143246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.144624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.168768 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] HTTP exception thrown: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Request method failure captured: Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 HTTP/1.1 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJlrPF0xvNye84AJpP98IugBy-SpdcDWHNkD-q2BT5vXTopWeRpS_IdqerqNDbNgM2f3wER7k0nJCA3Rk-v-eQXe1m_JkfUKGbH-tS8VNbyDSXHjdzF_9XEnPT4CkfoB8-9olMSUgxjb3Bwuw7APMO4FhI4M7CfH8qUvaKLcYYM16_g Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 49a766c739f647b1a3f0187f77519fe5 Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'eb47083d-299b-4045-a28b-87945b3cb372'} Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:25.171145 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.175997 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.180978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Returning 404 to user: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:25.182380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1eabdc4-8e95-42ca-9d52-8109d456cb23 tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 404 len: 111 microversion: 2.32 time: 0.062461 Aug 29 10:55:25.183691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2326/4639] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 10:55:25 2022] DELETE /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:55:25.191325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:25.191947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] [instance: eb47083d-299b-4045-a28b-87945b3cb372] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:25.207310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.207834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.208271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.208996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.209460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.210466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.251398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] HTTP exception thrown: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Request method failure captured: Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 HTTP/1.1 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJlrPF0xvNye84AJpP98IugBy-SpdcDWHNkD-q2BT5vXTopWeRpS_IdqerqNDbNgM2f3wER7k0nJCA3Rk-v-eQXe1m_JkfUKGbH-tS8VNbyDSXHjdzF_9XEnPT4CkfoB8-9olMSUgxjb3Bwuw7APMO4FhI4M7CfH8qUvaKLcYYM16_g Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f057d6a6e36e46be8ea64b5cbf9a8075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f057d6a6e36e46be8ea64b5cbf9a8075 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TaggedBootDevicesTest-175661101 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 49a766c739f647b1a3f0187f77519fe5 Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TaggedBootDevicesTest-175661101-project Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'eb47083d-299b-4045-a28b-87945b3cb372'} Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:25.253130 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] Returning 404 to user: Instance eb47083d-299b-4045-a28b-87945b3cb372 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:25.257163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee4b1d15-7c2d-4b04-b7f6-8f8f00a519fb tempest-TaggedBootDevicesTest-175661101 tempest-TaggedBootDevicesTest-175661101-project] 10.222.0.47 "GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372" status: 404 len: 111 microversion: 2.32 time: 0.067205 Aug 29 10:55:25.258612 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2314/4640] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:55:25 2022] GET /compute/v2.1/servers/eb47083d-299b-4045-a28b-87945b3cb372 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:55:25.295854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:25.297227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:25.306448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.307185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.308103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.308985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:25.309606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:25.310374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:25.781383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:25.792847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83f86bcd-f1ca-4891-8538-c1ad0997b319 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.502665 Aug 29 10:55:25.806044 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2327/4641] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:25 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:26.089341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:26.090153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:26.119940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:26.120971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:26.123051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:26.127937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:26.128817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:26.129848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:26.814897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:26.815526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:26.828510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:26.829017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:26.829469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:26.830501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:26.830971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:26.831409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:27.016259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:27.027557 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a2ea177-3263-46a7-9616-a5270c598a70 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.943928 Aug 29 10:55:27.028428 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2315/4642] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:26 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:27.340697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:27.349154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c536eba-400e-415c-b075-a3c4803ec7d8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.538012 Aug 29 10:55:27.350218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2328/4643] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:26 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:27.848025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4705403-193c-46c1-a9e6-380b513c7b48", "tag": "271205d5-fb3b-4157-9d87-5e16c022b450"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:27.867119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:27.870329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:27.870780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:27.894371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] Creating event network-changed:271205d5-fb3b-4157-9d87-5e16c022b450 for instance f4705403-193c-46c1-a9e6-380b513c7b48 on n-h1-854121-10 Aug 29 10:55:27.900072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c0c8cf4d-6f32-4068-b64f-b0cb4feeafd3 req-5422de39-60cf-40bd-a3de-0ef32384c5ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055459 Aug 29 10:55:27.901777 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2316/4644] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:28.048958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:28.049577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:28.061620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:28.062152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:28.062593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:28.063302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:28.063774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:28.064200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:28.370619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:28.371631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:28.378045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:28.378741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:28.379345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:28.380206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:28.381038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:28.382220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:28.446257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:28.459275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1dbec01d-e7db-49e3-a4b0-67fe704c71fc tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.413939 Aug 29 10:55:28.461354 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2329/4645] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:28 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:28.689241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:28.699178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23802040-0d13-49f5-bc1d-ac73fd530c36 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.332660 Aug 29 10:55:28.704578 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2317/4646] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:28 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:29.481577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:29.482239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:29.502479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:29.502977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:29.517563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:29.518507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:29.518993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:29.519602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:29.726316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:29.727033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:29.742784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:29.743290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:29.743916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:29.744814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:29.745528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:29.745999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:30.308066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:30.316029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58ba4803-8df1-47a2-83fc-22932fac8319 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.838916 Aug 29 10:55:30.329783 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2330/4647] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:29 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:30.442799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:30.454393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8a01b0f-5ca9-471b-8ca7-b11519696afc tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.732572 Aug 29 10:55:30.455683 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2318/4648] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:29 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:31.167039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:31.169800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:31.184352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.185141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.185768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.240357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:55:31.328439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-64aa8591-aa8b-4ec1-a2f8-8d54fd298c72 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action" status: 202 len: 0 microversion: 2.1 time: 0.165356 Aug 29 10:55:31.329853 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2331/4649] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:55:31 2022] POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:55:31.338973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:31.345005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:31.346326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:31.352480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:31.356953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:31.358481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:31.366469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.368625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.369825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.370454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.371742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.372436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.373039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.374215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.374619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.375281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.375932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.379988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.655351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:31.664398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68c83cc3-d977-40af-98c4-0c4151ce73aa tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.330255 Aug 29 10:55:31.671546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2319/4650] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:31 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:31.676746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:31.684787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:31.693285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.697495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.698131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.699019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:31.699562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:31.700066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:31.712053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:31.735709 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d8c2cd45-7bf9-4d18-a339-c25f1938cd47 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.394538 Aug 29 10:55:31.744723 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2332/4651] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:31 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:31.972074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:31.981346 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f1b89828-e1bc-43b4-914a-d81a64d798b6 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.308366 Aug 29 10:55:31.987362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2320/4652] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:31 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:32.692769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:32.693771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:32.719676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:32.731406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:32.737506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:32.740126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:32.742482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:32.744158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:32.767774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:32.768399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:32.780574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:32.791975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:32.794751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:32.796446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:32.802002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:32.803175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:33.151284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:33.159504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b01aa717-ae16-4747-b86a-784e7d3ad73b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.395633 Aug 29 10:55:33.176113 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2321/4653] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:32 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:33.178355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:33.181146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:33.181800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:33.186913 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0686f53-faab-4b18-925d-6d84ba31147a tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.498248 Aug 29 10:55:33.191929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2333/4654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:32 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:33.214615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:33.215320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:33.215771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:33.216497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:33.216958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:33.217391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:33.486435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:33.497483 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f70dd44-b3da-4eab-9890-f0b43a79961a tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.320159 Aug 29 10:55:33.498122 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2322/4655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:33 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:34.186276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:34.187648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:34.215129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:34.217409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:34.221953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.222729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.223404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.231888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.240690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.244792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.247005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.247609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.248135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.250911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.262800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.263480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.683605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:34.691605 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fe87e9e-fe6f-4abb-8f52-01eaf18a2621 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.510730 Aug 29 10:55:34.692184 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2334/4656] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:34 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:34.701284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:34.701948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:34.731756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.732259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.732694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.733402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.733896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.734326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.878939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:34.898631 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ec75e12-483e-4330-9b6f-77235d5e7e3d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.693777 Aug 29 10:55:34.899257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2323/4657] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:34 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:34.911372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4705403-193c-46c1-a9e6-380b513c7b48", "name": "network-vif-plugged", "status": "completed", "tag": "271205d5-fb3b-4157-9d87-5e16c022b450"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:34.932895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:34.933651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:34.934857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:34.951199 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] Creating event network-vif-plugged:271205d5-fb3b-4157-9d87-5e16c022b450 for instance f4705403-193c-46c1-a9e6-380b513c7b48 on n-h1-854121-10 Aug 29 10:55:34.958822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2560541d-d91e-4d5d-bc58-f14b9bbfcbe5 req-250ae316-e1a8-4b9a-a0e7-c59eeea8e32d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058260 Aug 29 10:55:34.959766 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2324/4658] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:35.157449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:35.162532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:35.178754 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c8201a0-1730-423a-9449-0131fa3648fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.484852 Aug 29 10:55:35.181045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2335/4659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:34 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:35.717394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:35.718260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:35.754442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:35.755809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:35.763200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:35.764747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:35.765934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:35.768488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:35.920714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:35.921432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:35.936818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:35.937287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:35.937758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:35.938488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:35.938952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:35.939392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:36.292053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:36.304172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6695101e-99c3-495c-9179-9946b409b344 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.594210 Aug 29 10:55:36.306420 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2325/4660] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:35 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:36.317396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:36.320707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:36.334544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:36.335292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:36.336049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:36.343630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:36.344402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:36.345030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:36.394583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:36.406023 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea158e75-5633-412c-bbd6-c56eeead261d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1323 microversion: 2.1 time: 0.489267 Aug 29 10:55:36.406626 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2336/4661] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:35 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:36.641984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:36.652306 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da34e875-da44-467b-92b0-dfc2f8bf9c5e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.341144 Aug 29 10:55:36.654396 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2326/4662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:36 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:37.327468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:37.328271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:37.344710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.345472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.346211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:37.347076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.347694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.348264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:37.428593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:37.429234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:37.446806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.448013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.449166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:37.454005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.454853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.456498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:37.785953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:37.803878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7c68337d-1d7c-419c-ad64-fe533ae3524f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.478979 Aug 29 10:55:37.806422 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2337/4663] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:37 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:37.837869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:37.838776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:37.862257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.864041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.864516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:37.868448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:37.871339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:37.871803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:38.180633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:38.205312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c145447a-83c3-4d6e-a9c6-66b8cae811b7 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1519 microversion: 2.1 time: 0.780842 Aug 29 10:55:38.230205 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2327/4664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:37 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1519 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:38.304729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:38.318022 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6c871421-b29c-49e8-8922-836144f5dbde tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.510049 Aug 29 10:55:38.320380 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2338/4665] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:37 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:38.485614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41273868-8971-4831-88e7-6c6fa8734d51 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-745602607", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41273868-8971-4831-88e7-6c6fa8734d51 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 242 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-745602607", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-745602607', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '98c0917f-76ac-4c1f-86c1-bef489f62319'}]}}} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:38.488139 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41273868-8971-4831-88e7-6c6fa8734d51 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:38.493598 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41273868-8971-4831-88e7-6c6fa8734d51 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011359 Aug 29 10:55:38.504277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:38.505889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: ce2185f1-505a-447a-96bb-b7cc5485c754] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:38.510244 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2328/4666] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:55:38 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:55:38.515918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] HTTP exception thrown: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/ce2185f1-505a-447a-96bb-b7cc5485c754/metadata HTTP/1.1 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': 'ce2185f1-505a-447a-96bb-b7cc5485c754'} Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.526456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.530304 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:38.530304 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:38.530304 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. Aug 29 10:55:38.530304 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.530304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 404 to user: Instance ce2185f1-505a-447a-96bb-b7cc5485c754 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:38.532686 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6c9e6fd8-7b12-4e37-ac8d-3e490b3fa68f tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/ce2185f1-505a-447a-96bb-b7cc5485c754/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025684 Aug 29 10:55:38.533871 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2339/4667] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:55:38 2022] GET /compute/v2.1/servers/ce2185f1-505a-447a-96bb-b7cc5485c754/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:38.752838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6435571b-f877-4535-8623-3f2a32d40564 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2144511355", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6435571b-f877-4535-8623-3f2a32d40564 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 499 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2144511355", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2144511355', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98c0917f-76ac-4c1f-86c1-bef489f62319'}]}}} Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:55:38.765741 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.770672 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.776788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6435571b-f877-4535-8623-3f2a32d40564 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:38.779615 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6435571b-f877-4535-8623-3f2a32d40564 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.029472 Aug 29 10:55:38.780437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2329/4668] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:55:38 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 10:55:38.836591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:38.837430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:38.853448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:38.853984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:38.854433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:38.855161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:38.855625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:38.870457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:38.900512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8706f6ab-c695-4825-b5bf-4eb3cedfa480 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-147807967", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8706f6ab-c695-4825-b5bf-4eb3cedfa480 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 499 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-147807967", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-147807967', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98c0917f-76ac-4c1f-86c1-bef489f62319'}]}}} Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:55:38.909694 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8706f6ab-c695-4825-b5bf-4eb3cedfa480 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8706f6ab-c695-4825-b5bf-4eb3cedfa480 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015208 Aug 29 10:55:38.913724 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2330/4669] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:55:38 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 10:55:39.095790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb5923a7-6710-49a0-98e3-2352c59dcace tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943304885", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb5923a7-6710-49a0-98e3-2352c59dcace tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 753 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943304885", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-943304885', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98c0917f-76ac-4c1f-86c1-bef489f62319'}]}}} Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:55:39.103886 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:55:39.107052 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:55:39.110413 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.110413 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.112102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb5923a7-6710-49a0-98e3-2352c59dcace tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:39.113245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb5923a7-6710-49a0-98e3-2352c59dcace tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023254 Aug 29 10:55:39.114492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2331/4670] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:55:39 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 29 10:55:39.176661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:39.186860 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e5173832-d0a8-4ed1-bf40-0f75eaaf0789 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.356706 Aug 29 10:55:39.187712 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2340/4671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:38 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:39.227374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90e7de95-9b02-4525-9151-6395745b818e tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-259583501", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90e7de95-9b02-4525-9151-6395745b818e tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 1265 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-259583501", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98c0917f-76ac-4c1f-86c1-bef489f62319"}]}} Aug 29 10:55:39.232206 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-259583501', 'imageRef': '2f170d57-7e4d-481e-9b6b-0fb69678ffde', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98c0917f-76ac-4c1f-86c1-bef489f62319'}]}}} Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.234807 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 10:55:39.236426 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 10:55:39.239504 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 10:55:39.239504 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.239504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90e7de95-9b02-4525-9151-6395745b818e tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:39.239504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90e7de95-9b02-4525-9151-6395745b818e tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013083 Aug 29 10:55:39.239504 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2332/4672] 10.222.0.47 () {60 vars in 1148 bytes} [Mon Aug 29 10:55:39 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 29 10:55:39.248860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:39.249367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:39.256065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] HTTP exception thrown: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1/metadata/test2 HTTP/1.1 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1', 'id': 'test2'} Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:39.260925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 404 to user: Instance 5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-914c7d1f-6e0a-4b8a-8e73-9f2a22b3608d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018140 Aug 29 10:55:39.265614 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2341/4673] 10.222.0.47 () {58 vars in 1281 bytes} [Mon Aug 29 10:55:39 2022] GET /compute/v2.1/servers/5c51ef1b-cd20-4ac9-a2c8-b48b16786ee1/metadata/test2 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:39.280634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:39.280825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:39.290290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.291255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.291977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.294308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.295362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.298709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.342297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:55:39.353640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:39.357117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:39.357860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:39.384914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.387285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.388367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.393905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.395465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.398155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.471289 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f5c9971-958f-4feb-9ee6-58e2b2815e33 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 204 len: 0 microversion: 2.1 time: 0.194568 Aug 29 10:55:39.472018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2333/4674] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:39 2022] DELETE /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:55:39.484012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:39.484754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:39.493589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.494195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.494543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.495355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:39.495818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:39.496479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:39.798488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:39.807782 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9829dc6c-1b45-4f35-b3d0-57223e5f6709 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.457893 Aug 29 10:55:39.808573 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2342/4675] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:39 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:39.877269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:39.890086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c73cee8e-f4ea-48cd-a44a-53cdd0e6bb67 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1525 microversion: 2.1 time: 0.412608 Aug 29 10:55:39.891249 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2334/4676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:39 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1525 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:40.208768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:40.209613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:40.230021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.230636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.231189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:40.232156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.232801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.233297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:40.486961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:40.502563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1739b70c-b2f4-44f7-838a-151532a8ffe6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 0.297896 Aug 29 10:55:40.511139 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2343/4677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:40 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:40.830847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:40.831412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:40.838266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.838764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.839207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:40.839918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.840373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.849166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:40.918374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:40.919002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:40.935475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.936291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.937488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:40.939889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:40.940581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:40.941810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:41.575874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:41.590646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-afe9c575-e00c-4b71-adb0-c3a7f5aae414 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.763750 Aug 29 10:55:41.593103 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2335/4678] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:40 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:41.606867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:41.607833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:41.621139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:41.622154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:41.622762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:41.623945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:41.627598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:41.628250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:41.773864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:41.788759 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb24b6da-1fca-49be-a34b-72820baaa29d tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1525 microversion: 2.1 time: 0.878704 Aug 29 10:55:41.791122 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2344/4679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:40 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1525 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:42.619864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:42.620731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:42.634580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:42.654420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:42.655600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:42.659118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:42.659727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:42.660699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:42.723191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:42.744119 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f93809f5-c45b-42bd-b33e-162c34363c67 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1674 microversion: 2.1 time: 1.149375 Aug 29 10:55:42.746116 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2336/4680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:41 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1674 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:42.811584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:42.812643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:42.831394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:42.832860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:42.833476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:42.834628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:42.835260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:42.835858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:43.072983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:43.085308 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e4a43df9-cfa8-468a-ac39-e9c81c4f2c28 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.470483 Aug 29 10:55:43.103826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2345/4681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:42 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:43.251506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:43.264475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c7a5d34-096b-476f-b530-18be277171f2 tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1525 microversion: 2.1 time: 0.457700 Aug 29 10:55:43.268224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2337/4682] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:42 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1525 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:43.401363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4705403-193c-46c1-a9e6-380b513c7b48", "name": "network-vif-deleted", "tag": "271205d5-fb3b-4157-9d87-5e16c022b450"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:43.433580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:43.434875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:43.435308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:43.483481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] Creating event network-vif-deleted:271205d5-fb3b-4157-9d87-5e16c022b450 for instance f4705403-193c-46c1-a9e6-380b513c7b48 on n-h1-854121-10 Aug 29 10:55:43.513327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5efa7f03-02d9-426e-afad-1a5c297dfaf0 req-66ae1ae2-68d3-4d7f-9b9e-2ccda55ead00 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117865 Aug 29 10:55:43.513983 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2346/4683] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:43.770570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:43.772064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:43.783421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:43.786184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:43.789105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:43.790642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:43.792933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:43.795087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:43.795907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.131939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:44.132778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:44.145989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.146516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.147609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.148383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.155114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.155791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.290703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:44.298907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d31fc29-047e-448c-bcb9-2ecaa5a028cb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1651 microversion: 2.1 time: 0.534138 Aug 29 10:55:44.304852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2338/4684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:43 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1651 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:44.317000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:44.318099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:44.333808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.338406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.339089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.340063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.340744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.341407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.439098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.439704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.440209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.440682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lazy-loading 'fault' on Instance uuid f4705403-193c-46c1-a9e6-380b513c7b48 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:55:44.593118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8db82f7f8094069a1f414a231ddd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f27b084a6846809e5ffc1b7b94b815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:44.601121 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be958acc-6862-49a8-8b74-fc3b18c7f8db tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 200 len: 1313 microversion: 2.1 time: 0.295129 Aug 29 10:55:44.604525 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2339/4685] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:44 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:44.615416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:44.629582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.630342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.630975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.716025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Going to try to start instance {{(pid=128682) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 10:55:44.750128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:44.763680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51f2ecf0-1eeb-4efd-b42f-ff7b65ac7f79 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.643719 Aug 29 10:55:44.764333 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2347/4686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:44 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:44.787222 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f509a2a5-cfbb-4e7f-877a-1e7d6f94f4f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action" status: 202 len: 0 microversion: 2.1 time: 0.181201 Aug 29 10:55:44.788509 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2340/4687] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:55:44 2022] POST /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:55:44.810626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:44.812511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:44.831279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.832139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.834141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:44.837131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:44.838260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:44.840170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:45.624865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:45.625575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] [instance: f4705403-193c-46c1-a9e6-380b513c7b48] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:45.642920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:45.643503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:45.643994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:45.644737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:45.645196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:45.662264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:45.692794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] HTTP exception thrown: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. Aug 29 10:55:45.697372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:45.708188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-168a4916-1339-413e-afb0-c6846621dbd9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1660 microversion: 2.1 time: 0.914589 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Request method failure captured: Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 HTTP/1.1 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJsW8g9DbDXcpz9JWlw2ZuQk3qV3gLMpTQDsM2OSvxubCjDUJT8iEKbYnMyOcyKPgoYKcOS6QAqbobvbIaM9a1x3fegvnrpe6iikBKnxKJQCfu_DVagiAOjZJFzB9UoujxiIoZVIDVNFstEwAWbHHuvsfypFfvxQWEiBnpurwdcLRX4 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/63f27b084a6846809e5ffc1b7b94b815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 63f27b084a6846809e5ffc1b7b94b815 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1081323490 Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8db82f7f8094069a1f414a231ddd48f Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1081323490-project Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f4705403-193c-46c1-a9e6-380b513c7b48'} Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:45.711164 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:45.715178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] Returning 404 to user: Instance f4705403-193c-46c1-a9e6-380b513c7b48 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:45.717020 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2348/4688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:44 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1660 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:45.727611 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ca64132-937c-42e3-9b44-ecc43da65e7b tempest-ServerMetadataNegativeTestJSON-1081323490 tempest-ServerMetadataNegativeTestJSON-1081323490-project] 10.222.0.47 "GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48" status: 404 len: 111 microversion: 2.1 time: 0.107698 Aug 29 10:55:45.745588 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2341/4689] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:45 2022] GET /compute/v2.1/servers/f4705403-193c-46c1-a9e6-380b513c7b48 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:55:45.787128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:45.788465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:45.809930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:45.810344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:45.810851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:45.811926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:45.812083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:45.812515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:46.473000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:46.481347 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a9eccf6-f59b-4125-ae6d-407b7c923793 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1510 microversion: 2.1 time: 0.698116 Aug 29 10:55:46.484447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2349/4690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:45 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1510 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:46.744713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:46.746524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:46.763940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:46.764448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:46.768812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:46.769934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:46.771132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:46.773003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:47.505218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:47.508051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:47.516306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=64 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:47.529080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:47.531722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:47.533060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:47.548667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:47.549963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:47.550984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:47.719758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:47.756469 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e8796f6-f7b0-49a8-b7be-2be5efd07387 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1660 microversion: 2.1 time: 1.014150 Aug 29 10:55:47.760036 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2342/4691] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:46 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1660 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:48.248875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:48.258101 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b494ebf9-68c9-4bdd-857f-0ffd905ae190 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1487 microversion: 2.1 time: 0.758858 Aug 29 10:55:48.259210 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2350/4692] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:47 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1487 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:48.282512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1057893492"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:48.285431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:48.295848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.298348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.303732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.306190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.307914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.308560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.435497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-774f0870-3c2f-4db1-a05b-6d1816ed443d tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "PUT /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1061 microversion: 2.1 time: 0.156991 Aug 29 10:55:48.436632 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2343/4693] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 10:55:48 2022] PUT /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1061 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:48.455626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:48.456612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:48.465173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.466013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.466904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.467769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.468379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.469030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.797861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:48.802858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:48.821598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:48.852453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b6b31186-e085-482c-a469-67ab49fb10da tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1488 microversion: 2.1 time: 0.401324 Aug 29 10:55:48.863700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.865072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.870026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2351/4694] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:48 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1488 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:48.872260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.884802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.893474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.896282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.900543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:48.903238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:48.952946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.953455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.956238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:48.957155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:48.963118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:48.963798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:49.360617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:49.371624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:49.395891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca2dbdb2-f3df-4488-938b-f10923235f83 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1488 microversion: 2.1 time: 0.513086 Aug 29 10:55:49.397583 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2352/4695] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:48 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1488 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:49.402883 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2756d14-3694-478f-a47c-56ec52fcafbb tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1664 microversion: 2.1 time: 0.624286 Aug 29 10:55:49.404361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2344/4696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:48 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1664 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:49.421756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:49.422262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:49.429889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:49.430830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:49.431500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:49.432462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:49.433186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:49.433890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:49.471976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:55:49.544443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:49.591861 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c801c7a-4363-4149-9d1a-2440eceb8372 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 204 len: 0 microversion: 2.1 time: 0.177559 Aug 29 10:55:49.593219 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2353/4697] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:49 2022] DELETE /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:55:49.601330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:49.601944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:49.608342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:49.608838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:49.609456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:49.610388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:49.610997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:49.611587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:49.832192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:49.844183 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-15bb8a9b-302e-423b-8d3c-5ba737ae636e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1494 microversion: 2.1 time: 0.246756 Aug 29 10:55:49.845584 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2345/4698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:49 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:50.039145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:50.039960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:50.054095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.056728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.057267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.058127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.059808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.060366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.311711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:50.320026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e307cfd8-628b-4add-b216-cfe6f8f6178b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.286441 Aug 29 10:55:50.320998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2354/4699] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:50 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:50.341472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:50.342129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:50.352618 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 10:55:50.352823 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 10:55:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac (ip 10.222.0.47) !!! Aug 29 10:55:50.357044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.357548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.358027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.371958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.374401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.374964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.568106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:50.580661 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8a07a4e5-9bc6-4986-b494-e63c912b4b43 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.242970 Aug 29 10:55:50.599156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2346/4700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:50 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:50.602762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:50.603670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:50.620863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.622356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.623400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.625102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.625595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.626152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.823675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:50.832241 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-76bc24f7-a4de-426c-b13e-58c99e597902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.234244 Aug 29 10:55:50.832826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2355/4701] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:50 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:55:50.856261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-112250408"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:50.859056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:50.871641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.874804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:50.875490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.876843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.877431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:50.879772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.881793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.884892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.895346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.898031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.901172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.901959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:50.908318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:50.908763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:50.936925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:55:51.218487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e13d062-ee52-4e08-8f92-248ca26f84a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.365850 Aug 29 10:55:51.247370 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2347/4702] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:55:50 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 10:55:51.827883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:51.842284 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8e6315b-0741-4060-b5e3-645c17c0b8fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1494 microversion: 2.1 time: 0.977370 Aug 29 10:55:51.844645 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2356/4703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:50 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1494 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:52.237588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff68ddfe-ec77-4f72-879a-0506436d0357", "name": "network-vif-deleted", "tag": "045f0bd4-f72c-43b9-b91f-799899f11286"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:52.300206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:52.302692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:52.307225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:52.358192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] Creating event network-vif-deleted:045f0bd4-f72c-43b9-b91f-799899f11286 for instance ff68ddfe-ec77-4f72-879a-0506436d0357 on n-h1-854121-10 Aug 29 10:55:52.380694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8b811a94-e88e-4977-bac0-d649272e6660 req-cf49c176-750b-463d-9fdb-9f858c14a1f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155517 Aug 29 10:55:52.381538 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2348/4704] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:52.870178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:52.871402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:52.883777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:52.884824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:52.885439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:52.886408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:52.887871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:52.889105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:52.952765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:52.953602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:52.954338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:52.955416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lazy-loading 'fault' on Instance uuid ff68ddfe-ec77-4f72-879a-0506436d0357 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:55:53.039016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:53.053324 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a560c31f-eea5-4e22-be81-594ae08d551e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 200 len: 1310 microversion: 2.1 time: 0.191018 Aug 29 10:55:53.055848 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2357/4705] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:52 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:54.077266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.079586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.100645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.101241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.101598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.111685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.113580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.116419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.173206 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 HTTP/1.1 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ff68ddfe-ec77-4f72-879a-0506436d0357'} Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.176997 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.184879 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-821289f5-f184-4b03-be54-93e5581c144c tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 404 len: 111 microversion: 2.1 time: 0.108805 Aug 29 10:55:54.207739 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2349/4706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.216822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.218150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.238970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.242247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.243108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.244020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.244433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.244871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.287652 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 HTTP/1.1 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ff68ddfe-ec77-4f72-879a-0506436d0357'} Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.294567 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.299260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c460c1f0-d6ad-4b1c-aee4-4cd6428fa7b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 404 len: 111 microversion: 2.1 time: 0.085272 Aug 29 10:55:54.306148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.306778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ff68ddfe-ec77-4f72-879a-0506436d0357] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.317990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.319176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.319838 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2358/4707] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:54 2022] DELETE /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.322958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.324562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.325056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.328325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.352311 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 HTTP/1.1 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ff68ddfe-ec77-4f72-879a-0506436d0357'} Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.354019 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. Aug 29 10:55:54.358786 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.359949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ff68ddfe-ec77-4f72-879a-0506436d0357 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.360978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd1b1f2c-20c3-4880-9174-6c938cd4c193 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357" status: 404 len: 111 microversion: 2.1 time: 0.059469 Aug 29 10:55:54.366345 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2350/4708] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/ff68ddfe-ec77-4f72-879a-0506436d0357 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.378645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.379460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.394420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.395219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.398688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.401616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.403929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.405484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.448072 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c HTTP/1.1 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3bf95a48-30a4-4c34-9d17-a05ed95bfd8c'} Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.456737 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.461719 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.465468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.479433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38741041-a4ae-48ce-baf7-153692ce67fd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 404 len: 111 microversion: 2.1 time: 0.111039 Aug 29 10:55:54.482437 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2359/4709] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:54 2022] DELETE /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.491683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.492379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.504588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.510576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.513046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.513954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.514515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.515429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.549273 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c HTTP/1.1 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3bf95a48-30a4-4c34-9d17-a05ed95bfd8c'} Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.550983 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.556086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 3bf95a48-30a4-4c34-9d17-a05ed95bfd8c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.560550 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2713a67-1dbf-497d-9c56-37d8acc340dd tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c" status: 404 len: 111 microversion: 2.1 time: 0.067177 Aug 29 10:55:54.561174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2351/4710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/3bf95a48-30a4-4c34-9d17-a05ed95bfd8c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:55:54.571607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.572122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.582261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.582974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.583497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.584824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.585367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.585970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.607631 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 HTTP/1.1 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '02d8be8b-7e45-4c98-b621-f1186134a809'} Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.607836 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.613134 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1bf79393-b4fa-4129-b6c2-5901fe9e036f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 404 len: 111 microversion: 2.1 time: 0.043675 Aug 29 10:55:54.614343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2360/4711] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:54 2022] DELETE /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.620432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.621123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 02d8be8b-7e45-4c98-b621-f1186134a809] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.631665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.632167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.632614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.633330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.633817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.634252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.692543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 HTTP/1.1 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '02d8be8b-7e45-4c98-b621-f1186134a809'} Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.694228 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 02d8be8b-7e45-4c98-b621-f1186134a809 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da8a70ee-7f0d-48d6-8bfb-effa9d00aea8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809" status: 404 len: 111 microversion: 2.1 time: 0.079347 Aug 29 10:55:54.698554 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2352/4712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/02d8be8b-7e45-4c98-b621-f1186134a809 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.718711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.719367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.738621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.739230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.740890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.743615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.744542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.747928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.782925 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 HTTP/1.1 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1'} Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.796482 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.801292 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.803057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.804095 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5787861a-75bc-458d-9916-5bf23f92daa7 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 404 len: 111 microversion: 2.1 time: 0.101069 Aug 29 10:55:54.805332 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2361/4713] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:54 2022] DELETE /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.813054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.813647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.820469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.821184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.821800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.822659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.823304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.823884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.857809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 HTTP/1.1 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1'} Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.865601 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. Aug 29 10:55:54.870152 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.873151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.874243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-08175b5f-2aff-4911-a664-50a026b0cdc8 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1" status: 404 len: 111 microversion: 2.1 time: 0.065151 Aug 29 10:55:54.878558 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2353/4714] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/ed2e7bfa-5cd8-4660-b94e-44f38c6cc3b1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.886115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.886617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:54.894662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.895164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.895609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.896322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:54.906454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:54.906994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:54.933428 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c HTTP/1.1 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd594e5c2-99a5-4757-ae5f-477a00f5684c'} Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:54.947925 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:54.952678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c031ca35-2436-4e0e-a6ea-fad06e30184e tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 404 len: 111 microversion: 2.1 time: 0.067170 Aug 29 10:55:54.962111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2362/4715] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:54 2022] DELETE /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:54.972520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:54.993067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: d594e5c2-99a5-4757-ae5f-477a00f5684c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.001398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.002812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.003666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.004588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.005169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.007165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.031169 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c HTTP/1.1 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd594e5c2-99a5-4757-ae5f-477a00f5684c'} Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.033344 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.038482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance d594e5c2-99a5-4757-ae5f-477a00f5684c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:55.041969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e09109b-5afc-423d-a2f2-e1d97b3e4d2f tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c" status: 404 len: 111 microversion: 2.1 time: 0.072351 Aug 29 10:55:55.052045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.052901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.058973 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2354/4716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:54 2022] GET /compute/v2.1/servers/d594e5c2-99a5-4757-ae5f-477a00f5684c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:55.066708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.067505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.068258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.071140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.071948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.074120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.120107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 HTTP/1.1 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a415ef80-fef1-40d7-a4a0-da875e7b0c35'} Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:55.126108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:55.132629 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0960f03b-cc80-492e-9eac-2fade9180a71 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 404 len: 111 microversion: 2.1 time: 0.080456 Aug 29 10:55:55.136531 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2363/4717] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:55 2022] DELETE /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:55.148689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.150393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a415ef80-fef1-40d7-a4a0-da875e7b0c35] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.167462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.169293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.169995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.172105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.174194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.174803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.221760 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 HTTP/1.1 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a415ef80-fef1-40d7-a4a0-da875e7b0c35'} Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.225863 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.230841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a415ef80-fef1-40d7-a4a0-da875e7b0c35 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:55.232443 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a70fd00-391d-43cf-b838-92f84b9d7fc1 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35" status: 404 len: 111 microversion: 2.1 time: 0.092109 Aug 29 10:55:55.234615 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2355/4718] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:55 2022] GET /compute/v2.1/servers/a415ef80-fef1-40d7-a4a0-da875e7b0c35 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:55:55.244514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.245066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.258485 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 HTTP/1.1 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a202234f-0dc0-4bcc-a9b8-202746e680a2'} Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.265294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.270238 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.272118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:55.277388 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-681f454d-1edc-4a39-bb82-9e5a99acec33 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2" status: 404 len: 111 microversion: 2.1 time: 0.038440 Aug 29 10:55:55.281368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2364/4719] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:55 2022] DELETE /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:55.287456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.288087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: a202234f-0dc0-4bcc-a9b8-202746e680a2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.301380 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 HTTP/1.1 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a202234f-0dc0-4bcc-a9b8-202746e680a2'} Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:55:55.304579 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:55:55.309324 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:55:55.309324 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:55:55.309324 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. Aug 29 10:55:55.309324 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:55:55.309324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance a202234f-0dc0-4bcc-a9b8-202746e680a2 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:55:55.317875 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a89c1b35-3609-4255-bacb-6bd17ceb046b tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2" status: 404 len: 111 microversion: 2.1 time: 0.023749 Aug 29 10:55:55.321406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2356/4720] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:55 2022] GET /compute/v2.1/servers/a202234f-0dc0-4bcc-a9b8-202746e680a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:55:55.328295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.331649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.355429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.356033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.356804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.360300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.363698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.364398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.479389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:55:55.688697 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69e58bc5-2af9-45a9-b4ec-cfa0247758b5 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 204 len: 0 microversion: 2.1 time: 0.365621 Aug 29 10:55:55.689976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2365/4721] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:55:55 2022] DELETE /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:55:55.698804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:55.699669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:55.719151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.719917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.720658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:55.721574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:55.722340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:55.722998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:56.289284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:56.301433 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6784485c-52c9-4a00-a80a-ff1c11cf5407 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1480 microversion: 2.1 time: 0.605242 Aug 29 10:55:56.318875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2357/4722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:55 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1480 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:57.331421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:57.342029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:57.375958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:57.388967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:57.389849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:57.394433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:57.395157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:57.402335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:58.349941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:58.374989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-982bd801-13c5-4f54-a1f2-552121b952d0 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1480 microversion: 2.1 time: 1.048699 Aug 29 10:55:58.374989 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2366/4723] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:57 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1480 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:55:58.773753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-plugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:58.796762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:58.797256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:58.797680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:58.848614 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] Creating event network-vif-plugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:55:58.885907 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6edb6b3d-5031-4075-be4e-62196e49cd6a req-b400dac0-2ecc-4522-b54b-87a600444ad8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114104 Aug 29 10:55:58.888866 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2358/4724] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:59.359938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b175d3a-6e83-4647-a628-99269c76a55a", "name": "network-vif-deleted", "tag": "0ea13926-7cd9-4fa3-b068-d0438caecf4b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:55:59.373570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:59.374545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:59.375134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:59.391006 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] Creating event network-vif-deleted:0ea13926-7cd9-4fa3-b068-d0438caecf4b for instance 4b175d3a-6e83-4647-a628-99269c76a55a on n-h1-854121-10 Aug 29 10:55:59.394699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:55:59.395532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:55:59.399042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8f003f7e-225a-4706-a314-cbfc7d893abe req-70163f8f-04eb-48fd-a0fc-1dbe004ad733 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055915 Aug 29 10:55:59.400587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2367/4725] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:55:59.420967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:59.426882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:59.426882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:59.427477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:55:59.428377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:55:59.429142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:55:59.809629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e18b3218b242b395b40f47b805ecba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171770ebf8df4976a71ea87cfb51e023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:55:59.829050 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff744b56-553b-4902-b5d3-88b72337c577 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 200 len: 1277 microversion: 2.1 time: 0.438899 Aug 29 10:55:59.841235 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2359/4726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:55:59 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 1277 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:00.862821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:00.863535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] [instance: 4b175d3a-6e83-4647-a628-99269c76a55a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:00.879543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:00.883528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:00.885919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:00.888768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:00.890251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:00.895779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:00.953513 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] HTTP exception thrown: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Request method failure captured: Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a HTTP/1.1 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJpEDWLW_vQpnvAyvatk6dCCXJReoi26hM4zWivGNWc16xPiZNJ-vWqR2zq67rl0cnN-BkwlPMxJZudU2ngga1coLM63dCMWMcIdn3rgTHrXhLau54amNfKXnrl_GTjMNoQ-PK-Ig_HPSZjSmP64_2OlnKrGuxcsyVkukF2Hk-kCBrI Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersTestJSON-588861715 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/171770ebf8df4976a71ea87cfb51e023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersTestJSON-588861715 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 171770ebf8df4976a71ea87cfb51e023 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersTestJSON-588861715 Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersTestJSON-588861715-project Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 08e18b3218b242b395b40f47b805ecba Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersTestJSON-588861715-project Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '4b175d3a-6e83-4647-a628-99269c76a55a'} Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:00.955688 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. Aug 29 10:56:00.960987 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:00.962556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] Returning 404 to user: Instance 4b175d3a-6e83-4647-a628-99269c76a55a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:56:00.963612 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52bd01f6-ba6e-4122-81ef-db203a35c424 tempest-ServersTestJSON-588861715 tempest-ServersTestJSON-588861715-project] 10.222.0.47 "GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a" status: 404 len: 111 microversion: 2.1 time: 0.104883 Aug 29 10:56:00.968472 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2360/4727] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:00 2022] GET /compute/v2.1/servers/4b175d3a-6e83-4647-a628-99269c76a55a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:56:01.093205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fe5ddffa-ec8a-4379-80fb-d28a99cc0cb2 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Action: 'create', calling method: .version_select at 0x7f66cb12b0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2136151938", "metadata": {"Type": "work"}}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:02.073904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fe5ddffa-ec8a-4379-80fb-d28a99cc0cb2 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.410223 Aug 29 10:56:02.074946 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2368/4728] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 29 10:56:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1413 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 10:56:02.090341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75966620-60cb-497a-a51e-9dd8e2d0ff5a tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c63e65e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:02.257047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75966620-60cb-497a-a51e-9dd8e2d0ff5a tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.172201 Aug 29 10:56:02.258196 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2361/4729] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:02 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:03.276595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-828c1c0f-1ae9-4a3e-8428-8a30e601da55 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c5f8e3a0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:03.583167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-828c1c0f-1ae9-4a3e-8428-8a30e601da55 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.312932 Aug 29 10:56:03.585847 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2369/4730] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:03 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:04.612936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e18475e-1bb5-4b0c-9fd1-afee0cb86ec3 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c6373e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:04.742633 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e18475e-1bb5-4b0c-9fd1-afee0cb86ec3 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 354 microversion: 2.1 time: 0.135046 Aug 29 10:56:04.743476 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2362/4731] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:04 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:04.758478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbace056-2d8a-4ca2-9c22-acbe11a42db3 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c5e31dc0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:04.900722 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbace056-2d8a-4ca2-9c22-acbe11a42db3 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 354 microversion: 2.1 time: 0.149238 Aug 29 10:56:04.901586 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2370/4732] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:04 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:04.915562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f82ec0a7-38a2-4a23-ac22-93548b640609 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c5e02ee0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:05.071497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f82ec0a7-38a2-4a23-ac22-93548b640609 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 202 len: 0 microversion: 2.1 time: 0.161296 Aug 29 10:56:05.072965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2363/4733] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:56:04 2022] DELETE /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:56:05.081028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-605d555e-f90e-4fa7-b86b-3282491d621a tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c5bc6a60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:05.214787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-605d555e-f90e-4fa7-b86b-3282491d621a tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.138288 Aug 29 10:56:05.223373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2371/4734] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:05 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:06.230526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-840d62b0-fdbd-47fa-98f9-c93feead9b00 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c63c6af0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:06.474382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-840d62b0-fdbd-47fa-98f9-c93feead9b00 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.248657 Aug 29 10:56:06.475178 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2364/4735] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:06 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:07.488195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dde96360-69ce-4d8f-82df-236719445eba tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66cb12bd30>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:07.652699 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dde96360-69ce-4d8f-82df-236719445eba tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.169216 Aug 29 10:56:07.653285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2372/4736] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:07 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:08.667184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c299fa2-5176-4c79-bac1-690a0e8c0868 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c63cc700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:08.800682 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c299fa2-5176-4c79-bac1-690a0e8c0868 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.137505 Aug 29 10:56:08.802231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2365/4737] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:08 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:09.815637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:09.816414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:09.830441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1939bf33-004c-46f9-9c42-16c2ecb82785 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c6e079d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:10.000678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1939bf33-004c-46f9-9c42-16c2ecb82785 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 200 len: 353 microversion: 2.1 time: 0.186592 Aug 29 10:56:10.001293 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2373/4738] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:09 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:11.018934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=47 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:11.020367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:11.026931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1a2c96d-e732-485b-948d-62c42b7ecfb0 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '.version_select at 0x7f66c64a55e0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:11.177211 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a1a2c96d-e732-485b-948d-62c42b7ecfb0 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] HTTP exception thrown: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1a2c96d-e732-485b-948d-62c42b7ecfb0 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Request method failure captured: Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 HTTP/1.1 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJtAfBSe8qQUeAeyEv_VQyRhy5lIUF_jy8LC6hy6juvvtP10kpgWPm9vRuSh7hFGNq3vyDZF_y09OvqptLBT3oPLj505dn09hOx7tq7qJTvVhDcL5_RZYEJF3yoUK9oE_OvFuBmZwKqUSJyLR6Jfbc4FEUBNhh5eActQ1p8KCdkFeyY Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 9559aa68266e42c6ae12ede8b40b58f1 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesGetTestJSON-672415946 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559aa68266e42c6ae12ede8b40b58f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9559aa68266e42c6ae12ede8b40b58f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9559aa68266e42c6ae12ede8b40b58f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9559aa68266e42c6ae12ede8b40b58f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesGetTestJSON-672415946 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 9559aa68266e42c6ae12ede8b40b58f1 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesGetTestJSON-672415946 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesGetTestJSON-672415946-project Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 7d13d5029a764a8c8bd2006db009d769 Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesGetTestJSON-672415946-project Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: method: Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: exception: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '02808f2c-5965-430a-a49b-7535271c64d9'} Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. (HTTP 404) (Request-ID: req-7edab6b7-aa43-448a-9435-8478ae317f67) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 10:56:11.180823 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. Aug 29 10:56:11.186767 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:56:11.193596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1a2c96d-e732-485b-948d-62c42b7ecfb0 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Returning 404 to user: Volume 02808f2c-5965-430a-a49b-7535271c64d9 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:56:11.196227 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1a2c96d-e732-485b-948d-62c42b7ecfb0 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9" status: 404 len: 109 microversion: 2.1 time: 0.178936 Aug 29 10:56:11.203450 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2366/4739] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:11 2022] GET /compute/v2.1/os-volumes/02808f2c-5965-430a-a49b-7535271c64d9 => generated 109 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:56:20.140157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1939bf33-004c-46f9-9c42-16c2ecb82785 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:20.141239 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1939bf33-004c-46f9-9c42-16c2ecb82785 tempest-VolumesGetTestJSON-672415946 tempest-VolumesGetTestJSON-672415946-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001413 Aug 29 10:56:20.141575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2374/4740] 10.222.0.47 () {56 vars in 886 bytes} [Mon Aug 29 10:56:20 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 10:56:22.406470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-236bcda7-2b20-40f7-b45a-056dcf3cc8f3 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c66fd940>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:22.623045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:22.626010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:22.647331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:22.647859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:22.648394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:22.649143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:22.649738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:22.670192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:22.713495 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-236bcda7-2b20-40f7-b45a-056dcf3cc8f3 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/09c4406b-7473-490d-83d3-4ecfdae2d2f1" status: 200 len: 351 microversion: 2.1 time: 0.311632 Aug 29 10:56:22.714566 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2367/4741] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:22 2022] GET /compute/v2.1/os-volumes/09c4406b-7473-490d-83d3-4ecfdae2d2f1 => generated 351 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:22.770084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-add81c97-8e2f-4ed4-8134-4f2f765c6520 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151501 Aug 29 10:56:22.770739 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2375/4742] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:56:22 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:56:23.293321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:23.293912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:23.323297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:23.324067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:23.324526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:23.325259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:23.325757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:23.326216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:23.433896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:56:23.684477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c7967bf-309f-49eb-ac2e-f113ecb01b9b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 204 len: 0 microversion: 2.1 time: 0.394848 Aug 29 10:56:23.690687 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2368/4743] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:56:23 2022] DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:56:23.703064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:23.704175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:23.741491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:23.743987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:23.744966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:23.746087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:23.746991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:23.747674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:24.278263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:24.287591 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41fa2326-9ada-4281-b430-bd2e22cb1751 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1670 microversion: 2.1 time: 0.596722 Aug 29 10:56:24.300954 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2376/4744] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:23 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1670 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:25.329430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:25.331967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:25.348483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:25.370062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:25.373021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:25.374868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:25.376401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:25.384421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:26.019061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:26.028671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2da1b45-44c5-4965-9ca2-77de02c15fdd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1670 microversion: 2.1 time: 0.703643 Aug 29 10:56:26.033245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2369/4745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:25 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1670 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:26.484064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6d5d00f-7f0c-41de-b6e4-f5e11f747942 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] Calling method '.version_select at 0x7f66c5b77820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:26.840904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e6d5d00f-7f0c-41de-b6e4-f5e11f747942 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939/defaults" status: 200 len: 371 microversion: 2.1 time: 1.315990 Aug 29 10:56:26.842080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2377/4746] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:56:25 2022] GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939/defaults => generated 371 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:26.854188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ceca076c-b538-4714-b561-5225c697d725 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] Calling method '.version_select at 0x7f66c6e97e50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:27.064528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:27.067412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:27.091183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:27.093182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:27.095465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:27.099134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:27.101019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:27.105204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:27.356215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ceca076c-b538-4714-b561-5225c697d725 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939" status: 200 len: 371 microversion: 2.1 time: 0.505886 Aug 29 10:56:27.356825 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2370/4747] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:56:26 2022] GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939 => generated 371 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:27.384772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b656514-46fb-4ab4-9c5e-9c2d0b760a8b tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c5dbb8b0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:27.526459 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b656514-46fb-4ab4-9c5e-9c2d0b760a8b tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0c81b8a3-4db0-47fd-8899-27740f9a5918" status: 200 len: 349 microversion: 2.1 time: 0.151592 Aug 29 10:56:27.527775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2371/4748] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:27 2022] GET /compute/v2.1/os-volumes/0c81b8a3-4db0-47fd-8899-27740f9a5918 => generated 349 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:27.532774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af57aea0-181b-4381-9211-03bd3f61c760 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] Calling method '.version_select at 0x7f66c5bd09d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:27.596802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:27.609990 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fed6a779-684d-452d-90b3-4d20d1022aec tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1670 microversion: 2.1 time: 0.552314 Aug 29 10:56:27.611048 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2378/4749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:27 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1670 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:27.713279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af57aea0-181b-4381-9211-03bd3f61c760 tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939/defaults" status: 200 len: 371 microversion: 2.1 time: 0.184128 Aug 29 10:56:27.713907 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2372/4750] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 10:56:27 2022] GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939/defaults => generated 371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:27.735118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7fdd5c2d-ab8b-4c2b-816e-6547bb4a8a4a tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] Calling method '.version_select at 0x7f66c5f8eaf0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:27.948297 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7fdd5c2d-ab8b-4c2b-816e-6547bb4a8a4a tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939" status: 200 len: 371 microversion: 2.1 time: 0.221434 Aug 29 10:56:27.949428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2379/4751] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 10:56:27 2022] GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939 => generated 371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:27.968229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4eff3f7a-d7a0-47a5-a233-d17016542bfb tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] Calling method '.version_select at 0x7f66c6e974c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:28.124661 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4eff3f7a-d7a0-47a5-a233-d17016542bfb tempest-QuotasTestJSON-2031179892 tempest-QuotasTestJSON-2031179892-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939?user_id=cabdce47a29845afa4e24446b6df5cf3" status: 200 len: 371 microversion: 2.1 time: 0.167280 Aug 29 10:56:28.136161 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2373/4752] 10.222.0.47 () {58 vars in 1323 bytes} [Mon Aug 29 10:56:27 2022] GET /compute/v2.1/os-quota-sets/b8a6ac9182334e128e2c99ba632a2939?user_id=cabdce47a29845afa4e24446b6df5cf3 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:28.269932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:28.271128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:28.282013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:28.282536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:28.282993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:28.285905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:28.287393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:28.290299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:28.636201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:28.636906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:28.651376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:28.652093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:28.653420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:28.654528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:28.655907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:28.656589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:29.367297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:29.376110 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c59d438a-d965-4ed0-be4f-593ccfd6a3b9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1604 microversion: 2.1 time: 0.747875 Aug 29 10:56:29.386479 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2374/4753] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:28 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1604 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:29.837401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:29.848369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78541e3e-e3ed-42c1-b35b-bb762b60802c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 1.582413 Aug 29 10:56:29.852091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2380/4754] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:28 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:30.297861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b980d711-fd13-4285-8ee6-23599482ab10", "name": "network-vif-deleted", "tag": "5bfdccf5-c446-4730-8e8f-cf0f867c5a1d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:30.320351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.322653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.324735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.360640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] Creating event network-vif-deleted:5bfdccf5-c446-4730-8e8f-cf0f867c5a1d for instance b980d711-fd13-4285-8ee6-23599482ab10 on n-h1-854121-10 Aug 29 10:56:30.374071 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-acdda105-f032-4155-8159-a83a6e8da0d7 req-3c65f234-e28b-4a36-821b-d248de1035f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080697 Aug 29 10:56:30.374761 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2375/4755] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:56:30.410416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:30.411575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:30.435310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.437412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.439334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.443754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.444261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.444715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.567019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.569223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.571547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.574335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lazy-loading 'fault' on Instance uuid b980d711-fd13-4285-8ee6-23599482ab10 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:56:30.589356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a134286-7b35-4068-8aa8-add6515122a6 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c63e6ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:30.676658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:30.691828 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6d245087-0435-4687-991f-03bdae9684dc tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 200 len: 1326 microversion: 2.1 time: 0.286483 Aug 29 10:56:30.708491 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2381/4756] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:30 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 1326 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:30.709020 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a134286-7b35-4068-8aa8-add6515122a6 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f4f47511-2d3e-448c-85ea-6f8e437cadc0" status: 200 len: 351 microversion: 2.1 time: 0.123934 Aug 29 10:56:30.717056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2376/4757] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 29 10:56:30 2022] GET /compute/v2.1/os-volumes/f4f47511-2d3e-448c-85ea-6f8e437cadc0 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:56:30.722190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9f3401ef-627f-4b94-968b-07180223d1f1 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c6e37700>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:30.790920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-unplugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:30.812166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.814304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.818601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.843910 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] Creating event network-vif-unplugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:56:30.876645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4cda1d97-d045-48e8-9593-d5e6b977a9f2 req-fa838fe9-cb0d-4bff-a415-4448d189d39a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090528 Aug 29 10:56:30.881206 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2377/4758] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:30.895397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:30.896643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:30.915003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.918369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.919613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:30.923063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:30.925035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:30.930769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:31.019645 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9f3401ef-627f-4b94-968b-07180223d1f1 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.301463 Aug 29 10:56:31.021456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2382/4759] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 29 10:56:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:31.036257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0ca0d811-e007-4ddd-9b91-c07fb659c76f tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c6268310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:31.224914 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0ca0d811-e007-4ddd-9b91-c07fb659c76f tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.192598 Aug 29 10:56:31.225955 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2383/4760] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 29 10:56:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:56:31.246427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b706e02-e22a-4021-9d79-bb6e883ddb68 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c628be50>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:31.369769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:31.379707 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cdfe8b55-d11f-4bc7-bed0-af0d11fc88e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.496392 Aug 29 10:56:31.399143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2378/4761] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:30 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:31.428820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-17778674"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:31.439345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:31.457554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:31.463749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:31.464273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:31.465191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:31.465500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:31.470076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:31.489427 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b706e02-e22a-4021-9d79-bb6e883ddb68 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.247131 Aug 29 10:56:31.490053 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2384/4762] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 29 10:56:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:31.503631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee99b268-5acb-4436-9cbb-c96eef045972 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c6bebb80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:31.692049 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee99b268-5acb-4436-9cbb-c96eef045972 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.192111 Aug 29 10:56:31.693249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2385/4763] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 29 10:56:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:56:31.713632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-414d88f1-8c32-404c-a8da-4ec287b49ab2 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66cafd09d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:31.935760 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-414d88f1-8c32-404c-a8da-4ec287b49ab2 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.227687 Aug 29 10:56:31.937692 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2386/4764] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 29 10:56:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:31.946489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:31.947378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:31.965459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:31.966012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:31.966467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:31.967196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:31.967667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:31.968177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:32.005531 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 HTTP/1.1 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b980d711-fd13-4285-8ee6-23599482ab10'} Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:56:32.008496 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:56:32.013511 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:56:32.029210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:56:32.034308 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed3e105c-7756-4b17-b101-e1a7febd939f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 404 len: 111 microversion: 2.1 time: 0.095379 Aug 29 10:56:32.043221 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2387/4765] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:31 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:56:32.059482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed1c049c-eacd-419f-bd5b-ff8b6266aa22 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66cafd0310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:32.109820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b821675a-bec5-4e9b-9579-a8eed1defca5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.700935 Aug 29 10:56:32.116295 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2379/4766] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:56:31 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 10:56:32.144208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-589cc636-f19f-40cc-8920-9f8e81324733 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '.version_select at 0x7f66c6427280>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:32.226217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-589cc636-f19f-40cc-8920-9f8e81324733 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274043270" status: 202 len: 0 microversion: 2.1 time: 0.108253 Aug 29 10:56:32.226914 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2380/4767] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 10:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274043270 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:56:32.266366 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed1c049c-eacd-419f-bd5b-ff8b6266aa22 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.221599 Aug 29 10:56:32.267085 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2388/4768] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:56:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:32.280766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68365ac2-c163-4ebd-987d-deec8286ab3e tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c63e6310>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:32.433185 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68365ac2-c163-4ebd-987d-deec8286ab3e tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.156468 Aug 29 10:56:32.434097 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2381/4769] 10.222.0.47 () {58 vars in 1188 bytes} [Mon Aug 29 10:56:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:32.448461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-22ac1942-3854-4599-af72-31900cb80795 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] Calling method '.version_select at 0x7f66c65d55e0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:32.806739 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-22ac1942-3854-4599-af72-31900cb80795 tempest-VolumesTestJSON-1226138850 tempest-VolumesTestJSON-1226138850-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.362428 Aug 29 10:56:32.806873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2389/4770] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 10:56:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:34.507293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7a622f1f-d8fb-40da-9b1f-c08b0738dd63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: .version_select at 0x7f66c5dbb8b0>, body: {"keypair": {"name": "tempest-keypair-1871729211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSPZkt+Qd9iOisTtMCFGKGQDdQfEiJJYO4gEhtnyzBLogDeGLLh88fts/x7dgHw/xLQdllORKf895F6C5KWnN8hu7MHdpSaW2FwHcxCg0bpIL1PrrnC/A32DzehCifxCg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:34.548307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7a622f1f-d8fb-40da-9b1f-c08b0738dd63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:56:34.560163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7a622f1f-d8fb-40da-9b1f-c08b0738dd63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for user d2437d037d844ce2aa3bbceaf369f908 and project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:56:34.595778 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7a622f1f-d8fb-40da-9b1f-c08b0738dd63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097762 Aug 29 10:56:34.603077 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2382/4771] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 10:56:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:37.940999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:38.162350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1431551318", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3780e7dc-efdd-4ed1-a3ce-6d75aac4ed83"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:38.321048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] validate_networks() for [('3780e7dc-efdd-4ed1-a3ce-6d75aac4ed83', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:56:40.770754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-612599035", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6799f4e-b262-4ef1-9b11-9920ad0bd3f8"}], "security_groups": [{"name": "tempest-securitygroup--554424820"}], "key_name": "tempest-keypair-1871729211", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:41.247137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:56:41.247692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:56:41.248233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:56:41.248779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:56:41.249629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:56:41.261492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] validate_networks() for [('e6799f4e-b262-4ef1-9b11-9920ad0bd3f8', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:56:41.280626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:41.299967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:41.302125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:41.304135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:41.312017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:41.321159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:41.429964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Getting quotas for project 123f9948b231469993765692f81a0dec. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:56:41.462446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Getting quotas for user 3d663c1f1b9c43659641ec4f29d9c817 and project 123f9948b231469993765692f81a0dec. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:56:41.522498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Going to run 2 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:56:41.531949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:56:41.658274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:56:41.847006 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d13fd7ea-4ed1-45e3-a3d1-df86f3f386e0 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.227252 Aug 29 10:56:41.847716 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2390/4772] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:56:41.862753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:41.874139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:41.874838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Searching by: {'deleted': False, 'project_id': '123f9948b231469993765692f81a0dec'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:56:41.937640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:41.938177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:41.938702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:41.940469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:41.941067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:41.941519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:41.972245 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c550c39-8e0c-4c53-92c2-365954360322 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.116816 Aug 29 10:56:41.974532 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2391/4773] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:56:41 2022] GET /compute/v2.1/servers => generated 677 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:41.999888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5789bebc-3522-403d-a41c-ea46792e8f82 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:42.002829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5789bebc-3522-403d-a41c-ea46792e8f82 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:42.082101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:42.293492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5789bebc-3522-403d-a41c-ea46792e8f82 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:42.310606 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5789bebc-3522-403d-a41c-ea46792e8f82 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1220 microversion: 2.1 time: 0.321685 Aug 29 10:56:42.313141 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2392/4774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:41 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1220 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:42.332286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-plugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:42.412416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:42.413692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:42.421291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:42.475290 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] Creating event network-vif-plugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:56:42.495077 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4ec1c7c3-47bb-4077-8613-b98059459659 req-3cac9ed8-136c-45d1-aac7-16292c23611c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180363 Aug 29 10:56:42.499731 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2393/4775] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:42.734817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:56:42.735765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:56:42.736508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:56:42.737110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:56:42.737929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:56:42.762097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:42.764060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:42.771276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:42.774171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:42.777483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:42.779765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:42.887898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:56:42.903482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Getting quotas for user d2437d037d844ce2aa3bbceaf369f908 and project 7cd4e0de46fe4695a27284a6c417ad45. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:56:42.983175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:56:42.995973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:56:43.218244 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a7d213e-f19d-4a9b-ad24-70dcb3125d9e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.453624 Aug 29 10:56:43.227375 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2383/4776] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:56:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:56:43.237492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0eb7949e-d73f-42b0-8354-7794bca756a6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:43.238254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0eb7949e-d73f-42b0-8354-7794bca756a6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:43.335424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a05723a-8a5a-4b23-8e26-ca0912124856 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:43.336114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a05723a-8a5a-4b23-8e26-ca0912124856 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:43.840716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0eb7949e-d73f-42b0-8354-7794bca756a6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:43.853718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0eb7949e-d73f-42b0-8354-7794bca756a6 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1237 microversion: 2.1 time: 0.624922 Aug 29 10:56:43.855138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2394/4777] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:43 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1237 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:44.594420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a05723a-8a5a-4b23-8e26-ca0912124856 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:44.619074 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a05723a-8a5a-4b23-8e26-ca0912124856 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1220 microversion: 2.1 time: 1.282178 Aug 29 10:56:44.625851 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2384/4778] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:43 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1220 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:44.877020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:44.877646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:44.915739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:44.916860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:44.921811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:44.922780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:44.923274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:44.923826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:45.444670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:45.462334 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d39bb8d-9f3e-47c1-b2c9-f6192702a579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1241 microversion: 2.1 time: 0.588127 Aug 29 10:56:45.477276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2395/4779] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:44 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1241 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:45.646319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:45.647123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:45.681525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:45.682985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:45.688459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:45.693497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:45.698974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:45.699798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:46.352262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:46.367137 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c1bbafe-cc20-4d94-be56-3d9535ef4dd6 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1272 microversion: 2.1 time: 0.726432 Aug 29 10:56:46.378227 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2385/4780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:45 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1272 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:46.485534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:46.486272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:46.528661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:46.535111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:46.535639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:46.549486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:46.550035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:46.550487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:47.392116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:47.398854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:47.416280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:47.416786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:47.417239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:47.431636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:47.432239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:47.432705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:48.729184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:48.738525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9281aa54-864d-49e2-9f64-749505a2034f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1290 microversion: 2.1 time: 1.350392 Aug 29 10:56:48.778967 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2386/4781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:47 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1290 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:49.089739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:49.102075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51d2b833-5112-43ec-9a2c-1d483f1c741b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1289 microversion: 2.1 time: 2.620960 Aug 29 10:56:49.102689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2396/4782] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:46 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1289 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:49.761393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:49.762054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:49.791619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:49.792128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:49.792577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:49.793310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:49.803264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:49.803941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:50.124281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:50.124934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:50.143870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:50.144629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:50.157563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:50.158409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:50.158898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:50.159336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:50.241267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:50.258708 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b605df01-bee6-4d5a-98dd-cc9e65bb3d43 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1278 microversion: 2.1 time: 0.501139 Aug 29 10:56:50.281412 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2387/4783] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:49 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1278 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:50.927125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:50.949310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cce96e1f-eecc-43ae-9b5c-ca1d427f16b5 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1295 microversion: 2.1 time: 0.829325 Aug 29 10:56:50.970835 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2397/4784] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:50 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1295 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:56:51.286431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:51.287774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:51.314490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:51.315003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:51.323200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:51.326291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:51.326802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:51.327265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:51.668071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:51.684487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a29fc494-7397-474e-bb25-4c5269a8093a tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1278 microversion: 2.1 time: 0.404109 Aug 29 10:56:51.685100 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2388/4785] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:51 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:51.974864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:51.982714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:51.996324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:52.004776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:52.006190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:52.007396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:52.012554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:52.013518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:52.016444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:52.324314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:52.369890 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9058597-f024-4e1e-9542-0f7ad20bb0f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1295 microversion: 2.1 time: 0.399302 Aug 29 10:56:52.388950 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2398/4786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:51 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1295 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:52.705046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:52.705783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:52.708933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:52.726783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:52.732252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:52.733765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:52.741092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:52.742893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:52.746216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:52.847097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:52.998633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:53.009640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1965e270-b30d-4560-b422-2a5112b10179 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1278 microversion: 2.1 time: 0.308894 Aug 29 10:56:53.010920 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2389/4787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:52 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:53.396985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:53.397614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:53.407536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:53.413975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:53.414504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:53.415383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:53.420091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:53.420621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:53.422067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:53.445509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=65 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:53.709337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:53.722643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-13aa614a-0af5-4836-8781-33c39f853c51 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1295 microversion: 2.1 time: 0.330043 Aug 29 10:56:53.724597 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2399/4788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:53 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1295 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:54.039612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:54.040244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:54.064965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:54.074623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:54.075306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:54.077761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:54.081119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:54.083875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:54.504705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:54.514704 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c480c9e-9646-4ab0-819c-7e15258e74b8 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 0.486502 Aug 29 10:56:54.528510 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2390/4789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:54 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:54.747393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:54.747994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:54.750000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:54.761218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:54.765923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:54.766791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:54.770305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:54.773183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:54.773932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:54.938668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:54.949672 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f6d1be15-d466-4f02-9543-7ddf3e881c9f tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1295 microversion: 2.1 time: 0.206533 Aug 29 10:56:54.955676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2400/4790] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:54 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1295 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:55.538871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:55.540176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:55.542936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=18 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:56:55.569850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:55.570349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:55.573307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:55.577813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:55.580236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:55.580862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:56.328698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d209029a-578f-4e2d-82bc-7588701c6650 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: .version_select at 0x7f66c6ccbd30>, body: {"keypair": {"name": "tempest-keypair-1358544637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWggJRQuaXu6TaFR+Q/iWkOfCHYA+rLuFvkCG4Cc5g4xdLJNN97eDHWIWmkN/RhuRjVyVdqEo0evROkr10k4EolFCoZUhwM1E5o0HNPtFwuqB/r9dOxef4aF8rGPMGohw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:56.406590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d209029a-578f-4e2d-82bc-7588701c6650 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:56:56.424758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d209029a-578f-4e2d-82bc-7588701c6650 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for user b7521435d76b4ad49b2810bee5f177e5 and project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:56:56.489239 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d209029a-578f-4e2d-82bc-7588701c6650 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.733634 Aug 29 10:56:56.490541 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2401/4791] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 10:56:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 736 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 10:56:56.500620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:56.502765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:56.532773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:56.535141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:56.538401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:56.543149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:56.545996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:56.547728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:57.376206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:57.398966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f8fdfd9-aaab-4d41-b2f8-e6d291500629 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.904476 Aug 29 10:56:57.417371 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2402/4792] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:56 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:57.433462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1", "tag": "5b4c2aff-d173-4c6c-a8e7-0e4f829a6763"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:57.458309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:57.458869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:57.459325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:57.495902 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] Creating event network-changed:5b4c2aff-d173-4c6c-a8e7-0e4f829a6763 for instance ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1 on n-h1-854121-10 Aug 29 10:56:57.505338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-76d2ad61-3e97-49fa-8c2c-4480a5146d49 req-25c26f43-0fb6-4f7a-8263-e96e0ade431c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086363 Aug 29 10:56:57.506598 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2403/4793] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:57.515690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:57.529878 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df9dd431-eeae-46b7-beae-b3926c25236e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 1.997497 Aug 29 10:56:57.547897 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2391/4794] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:55 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:56:57.967093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be", "tag": "13cc1b4f-2803-41ca-b241-f4126ae71098"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:56:58.011486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:58.011970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:58.012430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:58.072253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] Creating event network-changed:13cc1b4f-2803-41ca-b241-f4126ae71098 for instance 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be on n-h1-854121-10 Aug 29 10:56:58.088454 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-abc759c2-6d05-4a36-a24a-4b07b5102b9a req-aa31b9e9-4e61-403c-95ed-9685346f5bcc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133345 Aug 29 10:56:58.090811 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2404/4795] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:56:58.427813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:58.428501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:58.450816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:58.451302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:58.455218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:58.461339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:58.463819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:58.466752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:58.559719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:56:58.561049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:56:58.596128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:58.597117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:58.602985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:58.605311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:56:58.606336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:56:58.606336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:56:59.522195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:56:59.590820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7fcfd6ec-8e02-4923-8db7-51132fa1077e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 1.038052 Aug 29 10:56:59.604391 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2405/4796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:58 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:00.372989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:00.386528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a13b85d-54c8-4409-b346-f971098bb515 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 1.963002 Aug 29 10:57:00.387123 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2392/4797] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:56:58 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:00.614464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:00.617676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:00.648736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:00.649281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:00.650846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:00.654590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:00.656633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:00.659465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:01.413748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:01.415568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:01.433829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:01.434947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:01.438303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:01.443593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:01.445330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:01.447415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:01.454615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:01.481220 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b041ed30-898a-43bb-a60c-52c64ef33865 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 0.872712 Aug 29 10:57:01.485284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2406/4798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:00 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:01.883660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:01.897672 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e31cfadc-9839-468f-9d9e-53d6e19bcdba tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.492553 Aug 29 10:57:01.912627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2393/4799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:01 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:02.510363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:02.511147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:02.525911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:02.526809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:02.527490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:02.528521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:02.529269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:02.529976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:02.798372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef687dd3-0846-451a-a3d0-3c3469335a17", "tag": "52a6b37f-9cce-41de-bbda-974863d4683e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:02.838672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:02.842213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:02.843152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:02.876191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] Creating event network-changed:52a6b37f-9cce-41de-bbda-974863d4683e for instance ef687dd3-0846-451a-a3d0-3c3469335a17 on n-h1-854121-10 Aug 29 10:57:02.887556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b11cd824-f244-47ac-aba5-9eef1571acfc req-0e2c4ff1-c8a6-4561-90fc-5068728a7cc6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094222 Aug 29 10:57:02.892587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2394/4800] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:02.922902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:02.923981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:02.932670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:02.933842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:02.934712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:02.935882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:02.936751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:02.937499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:03.777281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:03.789856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7386e14d-4359-4bc6-a518-1eecf6a13a99 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 1.283145 Aug 29 10:57:03.795929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2407/4801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:02 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:03.856234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:03.871465 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f85cb8df-c30e-440d-8c9d-518e15ade636 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.954155 Aug 29 10:57:03.875112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2395/4802] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:02 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:04.815022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:04.815951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:04.819489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1", "name": "network-vif-plugged", "status": "completed", "tag": "5b4c2aff-d173-4c6c-a8e7-0e4f829a6763"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:04.834174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:04.834174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:04.836634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:04.838775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:04.841116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:04.843130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:04.850306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:04.851065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:04.851660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:04.893543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] Creating event network-vif-plugged:5b4c2aff-d173-4c6c-a8e7-0e4f829a6763 for instance ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1 on n-h1-854121-10 Aug 29 10:57:04.901113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8dd4dbdb-cbae-4da5-a7f4-c9b194eb16cc req-12c2496a-da7c-4fb0-8fff-cfce2f0807ef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086744 Aug 29 10:57:04.902346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2396/4803] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:04.909555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:04.915417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:04.938971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:04.939540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:04.939918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:04.940630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:04.941088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:04.943249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:05.827395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:05.859749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a15c2362-0af0-4749-8084-691650c71ac1 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 1.049545 Aug 29 10:57:05.863381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2408/4804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:04 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:05.883661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1539133819", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5fcf898-805b-4b1f-8916-bfd24b2dec7d"}], "security_groups": [{"name": "tempest-securitygroup--307662350"}], "key_name": "tempest-keypair-1358544637", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:05.974768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:05.986605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a0bcaa0d-23d3-4112-980e-09b98c340ffd tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 1.082188 Aug 29 10:57:06.005006 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2397/4805] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:04 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:06.446853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:06.536230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] validate_networks() for [('b5fcf898-805b-4b1f-8916-bfd24b2dec7d', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:57:06.883801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:06.885036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:06.904878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:06.907915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:06.909267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:06.913281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:06.913952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:06.914767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:07.336467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:07.345979 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd4ad7ad-1452-4278-a1c5-6e916840788f tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 0.466278 Aug 29 10:57:07.348663 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2398/4806] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:06 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:07.371459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be", "name": "network-vif-plugged", "status": "completed", "tag": "13cc1b4f-2803-41ca-b241-f4126ae71098"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:07.398295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:07.399884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:07.402019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:07.445186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] Creating event network-vif-plugged:13cc1b4f-2803-41ca-b241-f4126ae71098 for instance 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be on n-h1-854121-10 Aug 29 10:57:07.463845 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1c0b2630-7270-43bc-ab9c-9a9ecf2197e2 req-764cc373-91a1-489e-83bc-eb52e8c50c61 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105498 Aug 29 10:57:07.470985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2399/4807] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:07.478569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:07.489121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:07.512304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:07.515188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:07.515784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:07.517733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:07.519928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:07.520600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:08.317681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:57:08.318328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:57:08.318581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:57:08.319207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:57:08.319788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:57:08.342903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:08.351278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:08.352560 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-06d12a92-b581-4bfd-936d-fb74274c0a3d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.879060 Aug 29 10:57:08.366561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:08.366561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:08.366561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:08.366852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2400/4808] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:07 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:08.370937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:08.371570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:08.381823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:08.382485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:08.408335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:08.408787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:08.409204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:08.411081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:08.411558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:08.411985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:08.446787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:57:08.466365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for user b7521435d76b4ad49b2810bee5f177e5 and project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:57:08.523723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:57:08.526098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:57:08.639546 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12c18f80-518b-4e90-a4cb-24dcf23a3880 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.774589 Aug 29 10:57:08.646695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2409/4809] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 10:57:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 10:57:08.651691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:08.654691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:08.772456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:08.780333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:08.791588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:08.792979 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56a5b690-6e6c-4c62-a0ee-91db521c723e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1282 microversion: 2.20 time: 0.145243 Aug 29 10:57:08.793743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2410/4810] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:08 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:08.924177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:08.940157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-970746e8-ac55-4100-8bcb-ede6023efd73 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1320 microversion: 2.1 time: 0.570199 Aug 29 10:57:08.962187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2401/4811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:08 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1320 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:09.376143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:09.376757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:09.386348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:09.386843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:09.391825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:09.393441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:09.395663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:09.398702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:09.820773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:09.821428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:09.834563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:09.864347 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d18c582-3996-4b65-b2c9-f39de3e3245e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.489149 Aug 29 10:57:09.885874 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2411/4812] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:09 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:09.962319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:09.963170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:09.974970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:09.986338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:09.988084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:09.989496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0c099c5-705c-496e-8a08-3705daac5141 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1282 microversion: 2.20 time: 0.175018 Aug 29 10:57:10.004188 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2402/4813] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:09 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:10.009531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.012268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.012775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:10.014626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.015134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.015571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:10.406781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:10.428473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6848dc21-344b-440b-844f-136d69fa72a2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 200 len: 1508 microversion: 2.1 time: 0.471527 Aug 29 10:57:10.430306 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2412/4814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:09 2022] GET /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:10.455079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:10.462658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:10.481576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.489808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.490547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:10.491564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.492364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.493142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:10.802789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:10.803600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:10.816501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.818993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.823508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:10.825299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:10.830512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:10.832222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.021991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.040559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ffa659d4-1ff3-422a-8a0b-f1dd1342acae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1" status: 200 len: 1508 microversion: 2.1 time: 0.590333 Aug 29 10:57:11.043871 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2403/4815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:10 2022] GET /compute/v2.1/servers/ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1 => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:11.060582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:11.061565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:11.083009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.104278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.104809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.105645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.107424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.108099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.226962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:11.245327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.259374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d7a01ee8-db4b-4099-a30b-e022f43d454e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.459203 Aug 29 10:57:11.262789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2413/4816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:10 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:11.279538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef687dd3-0846-451a-a3d0-3c3469335a17", "name": "network-vif-plugged", "status": "completed", "tag": "52a6b37f-9cce-41de-bbda-974863d4683e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:11.315473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.317617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.318312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.346714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] Creating event network-vif-plugged:52a6b37f-9cce-41de-bbda-974863d4683e for instance ef687dd3-0846-451a-a3d0-3c3469335a17 on n-h1-854121-10 Aug 29 10:57:11.358393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8134d4f0-379a-47c5-ba6b-ae0e36f3dca4 req-0d6c270c-db94-4bfc-8686-26851b8d784e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092714 Aug 29 10:57:11.359881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2414/4817] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:11.382237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:11.384512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:11.405136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.406971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.407588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.411465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.412226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.414342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.606795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.624117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.631179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.633864 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-089fca46-b28a-4354-997a-922b2226b46b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1342 microversion: 2.20 time: 0.272597 Aug 29 10:57:11.663935 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2415/4818] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:11 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:11.684730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:11.688050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:11.740407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.745490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.746654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.748012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:11.749118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:11.750810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:11.751263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:11.758449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0df41428-5b4b-4a84-b78e-b7c0ed51ccde tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.712407 Aug 29 10:57:11.764028 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2404/4819] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:11 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:11.848406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:57:12.037417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98d3c17f-7518-4c48-98ed-63064da46c15 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1" status: 204 len: 0 microversion: 2.1 time: 0.370572 Aug 29 10:57:12.044492 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2416/4820] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:57:11 2022] DELETE /compute/v2.1/servers/ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:57:12.051622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:12.052777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:12.073626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:12.074167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:12.074615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:12.089037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:12.089545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:12.095717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:12.155959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:57:12.285680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:12.287002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:12.301578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:12.302874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:12.306968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:12.309369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:12.311152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:12.312770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:12.376005 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52eb0c58-8478-4c4a-8025-d59547fd4fa2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be" status: 204 len: 0 microversion: 2.1 time: 0.329716 Aug 29 10:57:12.376614 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2405/4821] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:57:12 2022] DELETE /compute/v2.1/servers/6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:57:12.624810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-297634418", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3780e7dc-efdd-4ed1-a3ce-6d75aac4ed83"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:12.735325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] validate_networks() for [('3780e7dc-efdd-4ed1-a3ce-6d75aac4ed83', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:57:13.063010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:13.071712 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5cee9831-2df2-490a-9da5-098afd322b18 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.791555 Aug 29 10:57:13.072306 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2417/4822] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:12 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:13.081268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:13.087515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:13.105655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.106754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.107397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:13.108427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.109089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.109730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:13.231510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:13.234719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:13.250306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:13.252721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:13.254506 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45a3eb1d-0a89-4224-989a-5f2bac1f4791 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1340 microversion: 2.20 time: 0.181249 Aug 29 10:57:13.255117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2418/4823] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:13 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:13.278130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:13.279189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:13.305175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.305967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.306837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:13.307830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.309070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.309875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:13.670174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:13.682469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21c0aa04-e297-4923-ad39-574f5bb03f98 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1362 microversion: 2.1 time: 0.426162 Aug 29 10:57:13.683498 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2419/4824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:13 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:13.690384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-19378642"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:13.695640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:13.706700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.707977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.709811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:13.711201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:13.712340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:13.713426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.174071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:57:14.174582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:57:14.175335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:57:14.175976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:57:14.176477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:57:14.206898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.206898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.209253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.210284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.211206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.215562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.246700 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eff78101-0eac-4bb7-9b37-70f94b4130ac tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.561393 Aug 29 10:57:14.247428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2420/4825] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:57:13 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 10:57:14.264607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:14.266065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:14.286307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.286508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.287023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.287802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.288269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.288856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.293805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Getting quotas for project 123f9948b231469993765692f81a0dec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:57:14.314573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Getting quotas for user 3d663c1f1b9c43659641ec4f29d9c817 and project 123f9948b231469993765692f81a0dec. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:57:14.331147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Going to run 2 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:57:14.335900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:57:14.418198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=5f9c8e60-ff9e-43f7-9855-1d5e5165230d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:57:14.584794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a05de70-aca5-4901-9ac1-f5f46c829aa9 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.961710 Aug 29 10:57:14.588023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2406/4826] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:57:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1970 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 29 10:57:14.594457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:14.600168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:14.627827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.628262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.632450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.637138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.637826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.640385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.658747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:14.677794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4b1302b-17fb-44c5-acd5-86aaae81167c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.425458 Aug 29 10:57:14.678535 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2421/4827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:14 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:14.696488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:14.719396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:14.721565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Searching by: {'deleted': False, 'project_id': '123f9948b231469993765692f81a0dec'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 10:57:14.765520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.768535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.770848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.772000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:14.774494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:14.775378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:14.842372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 10:57:14.963304 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78f1413d-b860-43ef-acb2-b8744c92de6d tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.277216 Aug 29 10:57:14.966151 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2422/4828] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 10:57:14 2022] GET /compute/v2.1/servers => generated 1335 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:14.989873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:14.993491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:15.005504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:15.006111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:15.006710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:15.007476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:15.007941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:15.008424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:15.503388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:15.521693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:15.537915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:15.539113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-534082cd-589b-4d87-8940-ad1c52846716 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 0.949454 Aug 29 10:57:15.539685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2407/4829] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:14 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:15.561160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-unplugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:15.593018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:15.593547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:15.593964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:15.633620 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] Creating event network-vif-unplugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:57:15.661201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-965dbde5-c3c3-4c8f-960c-fa12a8e60f43 req-0ebdbcba-5c65-4d2a-be74-d7fef465d0d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115738 Aug 29 10:57:15.664093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2408/4830] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:15.667191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:15.674701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-829b4b8e-8fa5-471d-a085-d1cbd6a7a4fd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:15.676048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-829b4b8e-8fa5-471d-a085-d1cbd6a7a4fd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:15.681367 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a3597c1c-3b75-4832-b672-b946ad7b3b1b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1547 microversion: 2.1 time: 0.711944 Aug 29 10:57:15.695837 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2423/4831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:14 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1547 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:15.714661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:15.715309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:15.730618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:15.732893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:15.734340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:15.737065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:15.739742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:15.740929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:16.050158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-829b4b8e-8fa5-471d-a085-d1cbd6a7a4fd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:16.106097 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-829b4b8e-8fa5-471d-a085-d1cbd6a7a4fd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1217 microversion: 2.1 time: 0.438719 Aug 29 10:57:16.108950 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2409/4832] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:15 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1217 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:16.132374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:16.133451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:16.151262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:16.151984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:16.153210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:16.154748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:16.156635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:16.157505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:16.251017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:16.264663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8dbdf8b-0496-4b53-9655-d411b29bdcc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.566910 Aug 29 10:57:16.265788 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2424/4833] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:15 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:16.468803 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-864f6d37-f9c3-4e6e-a2fc-36d59a77e208 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.357034 Aug 29 10:57:16.469507 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2410/4834] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 10:57:16 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-interface => generated 284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:16.565830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:16.567548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:16.574758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:16.575298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:16.575815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:16.576738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:16.577924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:16.578622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:17.118858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:17.131569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:17.133122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:17.140656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:17.160399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:17.161123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:17.161660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:17.166812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:17.178421 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ea73c00a-9301-4c00-8d16-104d2ee6f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 0.615903 Aug 29 10:57:17.186776 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2425/4835] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:16 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:17.189189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:17.190289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:17.195212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:17.294021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:17.294877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:17.312078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:17.312786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:17.319195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:17.320259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:17.320781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:17.322501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:17.494308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:17.506053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-105491af-e021-48bb-93fa-c2ca914e2b38 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1269 microversion: 2.1 time: 0.379233 Aug 29 10:57:17.509378 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2411/4836] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:17 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1269 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:18.201229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:18.202836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:18.215356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:18.216173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:18.218355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:18.219267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:18.225095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:18.225997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:18.341482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:18.355053 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d94586b-d59a-40ed-83a3-06738bb3fb90 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1687 microversion: 2.1 time: 1.066759 Aug 29 10:57:18.355392 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2426/4837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:17 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1687 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:18.468019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be", "name": "network-vif-deleted", "tag": "13cc1b4f-2803-41ca-b241-f4126ae71098"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:18.485328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:18.489265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:18.491807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:18.514095 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] Creating event network-vif-deleted:13cc1b4f-2803-41ca-b241-f4126ae71098 for instance 6ee8daca-0a8b-4fa6-bc3d-1e6f7d6105be on n-h1-854121-10 Aug 29 10:57:18.536314 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-463e1e7a-cd95-40d6-809f-6bc4c7a35be0 req-d9818a58-57d9-4e77-b542-b12e7b6e50cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076062 Aug 29 10:57:18.537237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2427/4838] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:18.542656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:18.543597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:18.559433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:18.560287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:18.560903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:18.563180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:18.563838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:18.565364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:18.780124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:18.821333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:18.845908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:18.850538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:18.856527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-803da168-5187-4b58-8973-65adf0dbc8ff tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 0.658935 Aug 29 10:57:18.858332 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2412/4839] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:18 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:57:19.277504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:19.294439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9dc21b21-1fea-4998-a761-a03af99d2399 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1275 microversion: 2.1 time: 0.754265 Aug 29 10:57:19.296743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2428/4840] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:18 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1275 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:19.382482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:19.383108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:19.396402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:19.396896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:19.402742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:19.403566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:19.404044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:19.404480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:19.891482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:19.892868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:19.907731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:19.914187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:19.915105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:19.919894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:19.920598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:19.924388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:21.300147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:21.311863 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46f58813-43dc-4bf0-a420-37307246c61e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 1.935213 Aug 29 10:57:21.318187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2413/4841] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:19 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:21.330927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:21.332336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:21.346379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:21.348219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:21.349067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:21.357437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:21.358027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:21.358484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.354119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:22.369947 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9a6b505-7bd4-4ebb-989c-eef465af6f57 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1275 microversion: 2.1 time: 1.047572 Aug 29 10:57:22.370870 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2414/4842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:21 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1275 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:22.382168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1", "name": "network-vif-deleted", "tag": "5b4c2aff-d173-4c6c-a8e7-0e4f829a6763"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:22.402629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:22.406351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:22.407027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.439552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] Creating event network-vif-deleted:5b4c2aff-d173-4c6c-a8e7-0e4f829a6763 for instance ddaf5f0a-84a3-43a5-92a9-5762a5cdeda1 on n-h1-854121-10 Aug 29 10:57:22.452805 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3fe3bc34-2718-4190-9113-90d3c6b29b93 req-7e20c3af-bbc6-4e3c-b364-574cdc93e649 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080025 Aug 29 10:57:22.457128 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2415/4843] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:22.470902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:22.491630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:22.494400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:22.496372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.527653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] Creating event network-changed:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 10:57:22.548290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fe0c4210-8889-4ba7-b236-63bd2abad64f req-e59b160f-9e08-4c86-8d01-ce8ca3bd4078 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085413 Aug 29 10:57:22.549580 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2416/4844] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:22.556574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-plugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:22.592927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:22.603801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:22.604388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.649178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] Creating event network-vif-plugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:57:22.657071 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5aa4c494-f154-42d9-8b4b-f60583808dca req-b3a6c653-9f31-42f3-abcf-40bf5ff05e20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105151 Aug 29 10:57:22.662826 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2417/4845] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:22.674563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:22.676059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:22.696103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:22.696748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:22.697586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:22.698323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.699317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:22.700017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:22.705984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:22.727757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:22.743143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:22.744353 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1255f59b-507f-4dc8-bfbe-49d3ccb39f07 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 2.867864 Aug 29 10:57:22.756771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2429/4846] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:19 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 2881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:57:23.394705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:23.395629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:23.416441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:23.421949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:23.422663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:23.425924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:23.427133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:23.430608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:23.849392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:23.862960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a6c8b06-b563-4158-8050-d3e5afd981f3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1275 microversion: 2.1 time: 0.471300 Aug 29 10:57:23.865918 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2430/4847] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:23 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1275 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:23.881983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:23.883466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:23.896180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:23.911196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:23.913255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:23.915187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:23.920277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:23.922373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:23.925968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:24.268309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:24.272031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:24.294872 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fd062147-f8ac-441f-ab63-5667e1bf4f41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 1.628894 Aug 29 10:57:24.296965 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2418/4848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:22 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:24.510213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9c8e60-ff9e-43f7-9855-1d5e5165230d", "tag": "4944eccd-eef9-475d-aacc-3f5e0409f509"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:24.524328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:24.544398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:24.567170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:24.568780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:24.635487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] Creating event network-changed:4944eccd-eef9-475d-aacc-3f5e0409f509 for instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d on n-h1-854121-10 Aug 29 10:57:24.682327 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-edf5a4aa-7b6c-4c3d-bc77-329ba0653f09 req-6563fe24-1217-407c-8770-2f8d4f0ffe76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169902 Aug 29 10:57:24.687272 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2419/4849] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:24.715748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef687dd3-0846-451a-a3d0-3c3469335a17", "tag": "52a6b37f-9cce-41de-bbda-974863d4683e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:24.767360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:24.770482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:24.771645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:24.807277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:24.836524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:24.849130 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] Creating event network-changed:52a6b37f-9cce-41de-bbda-974863d4683e for instance ef687dd3-0846-451a-a3d0-3c3469335a17 on n-h1-854121-10 Aug 29 10:57:24.862088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:24.869426 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2b1635d9-6547-4b57-89b4-2313f9b3eee9 req-4944f1b4-a2d3-4c94-8e7a-8bbb32a0c838 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178042 Aug 29 10:57:24.871805 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2420/4850] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:24.875536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:24.888922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:24.891499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8d8f883-5e69-40c4-a6e6-c498663b520b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.021612 Aug 29 10:57:24.895037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:24.911695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:24.914218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2431/4851] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:23 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:24.919663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:24.930788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:24.937483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:24.937483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:24.943676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:25.316999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:25.317632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:25.333447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:25.335340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:25.338252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:25.395706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:25.396309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:25.396776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:25.407284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:25.435017 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2a78699-96c1-4965-bb13-aa7071a219cd tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.550800 Aug 29 10:57:25.436448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2421/4852] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:24 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:25.922926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:25.923610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:25.945423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:25.945960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:25.949226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:25.963320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:25.971090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:25.971710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:25.972330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:25.972758 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-928d04fc-9fef-46c0-ab37-5a1bc12ed57a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.660097 Aug 29 10:57:26.000820 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2432/4853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:25 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:26.104244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=10 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:26.462752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:26.463389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:26.476528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:26.477012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:26.478886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:26.481584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:26.482953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:26.485121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:27.355924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:27.373586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:27.397849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:27.411886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d0c8fc6-1253-4163-a478-16cac29fbb2e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.494604 Aug 29 10:57:27.417462 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2422/4854] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:25 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:27.429102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:27.435906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:27.436992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:27.439392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6139e979-c9fe-40ca-8259-24884193c5ae tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.986961 Aug 29 10:57:27.445819 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2433/4855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:26 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:27.450960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:27.453356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:27.457164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:27.458233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:27.459354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:27.460167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:28.240164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:28.251023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5844710b-316f-4405-8c83-0fa40b854cae tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.832057 Aug 29 10:57:28.257604 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2423/4856] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:27 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:28.441985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:28.442767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:28.461531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:28.462012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:28.462568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:28.463416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:28.467242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:28.467877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:28.468503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:28.469072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:28.479513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:28.485512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:28.489590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:28.494283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:28.498038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:28.499504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:28.538046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:30.376059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:30.395131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:30.404581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:30.415695 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15313fa8-b841-4ea9-96a3-5d0efbb4d915 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.972606 Aug 29 10:57:30.418098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2434/4857] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:28 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:30.446067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:30.451274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:30.485351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:30.501691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:30.508118 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e4e0b893-906f-489e-9d97-918168c0530e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 2.043093 Aug 29 10:57:30.512420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:30.512996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2424/4858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:28 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:30.516543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:30.520564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:30.527211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:30.538694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:31.015972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e5a7c7-725e-4eed-984a-3bfa92e74da6", "tag": "acbd3728-25d6-4213-a243-020f553352fe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:31.054584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:31.055093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:31.063306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:31.103187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:31.105210 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] Creating event network-changed:acbd3728-25d6-4213-a243-020f553352fe for instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 on n-h1-854121-10 Aug 29 10:57:31.129756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0e0cd425-0f54-40ab-8d68-962738eef4e3 req-f6c16722-95c7-422a-b744-951a6314b2c1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117712 Aug 29 10:57:31.136024 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2425/4859] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:31.395186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:31.423908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12a0e81f-a636-465f-b3dd-9881f21b3f59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.998603 Aug 29 10:57:31.427261 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2435/4860] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:30 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:31.452336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:31.453568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:31.476146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:31.481919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:31.488194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:31.491341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:31.492731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:31.497016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:31.544278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:31.545829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:31.581085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:31.583719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:31.590700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:31.595788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:31.603945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:31.604458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:32.416932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:32.436747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:32.438652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:32.442507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:32.445759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ee2c769-1b85-4875-ba9c-51d99f63c0a8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.000731 Aug 29 10:57:32.447728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2426/4861] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:31 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:32.460881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:32.464453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:32.476743 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ebde3d8a-2cd5-4a0f-9221-392aeeb96723 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.947025 Aug 29 10:57:32.480750 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2436/4862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:31 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:32.493096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:32.496214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:32.498106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:32.501949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:32.505864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:32.507363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:32.854424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:32.866706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8972fcaa-c004-4c03-b6fe-ee47c89b9a2d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.414646 Aug 29 10:57:32.885787 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2427/4863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:32 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:32.948113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9c8e60-ff9e-43f7-9855-1d5e5165230d", "name": "network-vif-plugged", "status": "completed", "tag": "4944eccd-eef9-475d-aacc-3f5e0409f509"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:32.968754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:32.970220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:32.983842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:33.027974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] Creating event network-vif-plugged:4944eccd-eef9-475d-aacc-3f5e0409f509 for instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d on n-h1-854121-10 Aug 29 10:57:33.044774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-46e533f6-8110-4a8f-9044-99beecf4ed64 req-a5bb196d-e286-47da-88b5-40b2cd73f7f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100443 Aug 29 10:57:33.046137 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2437/4864] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:33.474563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:33.475475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:33.499252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:33.505040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:33.506476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:33.506633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:33.510608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:33.513345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:33.514129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:33.515833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:33.522445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:33.529945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:33.530820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:33.532355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:33.533082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:33.533784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:34.602582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:34.620070 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6721acfd-cbb2-4b10-8f00-86501b949899 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 1.115479 Aug 29 10:57:34.622073 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2438/4865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:33 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:34.647699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:34.648390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:34.664460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:34.676629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:34.677145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:34.677592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:34.678342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:34.678805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:34.679246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:34.688760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:34.698547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:34.700028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-559b37d4-a009-4d13-bccc-cc781a12d255 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.230443 Aug 29 10:57:34.701137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2428/4866] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:33 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:35.180421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "name": "network-vif-plugged", "status": "completed", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:35.210765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:35.213781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:35.216613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:35.260423 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] Creating event network-vif-plugged:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 10:57:35.289007 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-33f94a2e-5a44-40f5-95e3-75eb2682f2be req-5304dea3-2b49-431a-85fd-6e968ed37a03 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110475 Aug 29 10:57:35.290571 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2429/4867] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:35.336411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:35.354261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f3b35ed-d923-45a0-97cf-f53dde136b33 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.721836 Aug 29 10:57:35.355234 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2439/4868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:34 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:35.648855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:35.649846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:35.683236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:35.683833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:35.684817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:35.685595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:35.686087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:35.686658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:35.727849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:35.729433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:35.766215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:35.768372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:35.770139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:35.773116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:35.778885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:35.779593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:36.618794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:36.641340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54487355-6dd5-4695-ad92-482064ae3437 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.998676 Aug 29 10:57:36.642243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2430/4869] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:35 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:36.660388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:36.666452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:36.687334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:36.689333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:36.691194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:36.693764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:36.696896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:36.697572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:36.772370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:36.784984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:36.811374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:36.817637 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0be4b782-e1d6-4aa4-9b7e-38bc76f1d089 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1407 microversion: 2.20 time: 1.094135 Aug 29 10:57:36.820304 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2440/4870] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:35 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1407 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:57:37.060505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:37.079971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-79f43a47-0429-4b33-99a4-533118d3bd3c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.436328 Aug 29 10:57:37.088924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2431/4871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:36 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:37.672826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:37.674405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:37.703142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:37.703142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:37.705183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:37.708109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:37.710796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:37.712813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:37.847809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:37.849364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:37.871168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:37.876966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:37.879747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:37.885304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:37.886022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:37.886652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:38.371146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:38.416489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32193de6-2558-4720-985b-2fca10764e35 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.747669 Aug 29 10:57:38.437964 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2441/4872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:37 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:38.461813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:38.462606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:38.485615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:38.499945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:38.500501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:38.501280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:38.501764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:38.502556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:38.828249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:38.840287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:38.855646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:38.856946 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-141f7dd3-f2a1-48b3-a2b6-16a4b6cebcc1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1599 microversion: 2.20 time: 1.015908 Aug 29 10:57:38.857530 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2432/4873] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:57:37 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1599 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:57:38.883662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:38.884448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:38.916578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:38.922943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:38.923478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:38.924155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:38.924618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:38.925588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:38.958789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:38.995052 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e939cba-3dd4-4bae-9ab2-1d0a0e11bf4c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.534351 Aug 29 10:57:38.996524 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2442/4874] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:38 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:39.162062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c390f398-21d4-41f2-affd-3d334342847f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.282259 Aug 29 10:57:39.163650 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2433/4875] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 10:57:38 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-interface => generated 284 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 10:57:39.446294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:39.447563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:39.459870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e5a7c7-725e-4eed-984a-3bfa92e74da6", "name": "network-vif-plugged", "status": "completed", "tag": "acbd3728-25d6-4213-a243-020f553352fe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:39.483981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:39.502280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:39.502762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:39.506942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:39.507432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:39.507871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:39.511844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:39.512386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:39.512848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:39.554695 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] Creating event network-vif-plugged:acbd3728-25d6-4213-a243-020f553352fe for instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 on n-h1-854121-10 Aug 29 10:57:39.574309 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-209ca506-d0c4-4ac3-b0c6-488b9548f1db req-ca0d1425-7460-46d9-9b3f-f6981eab4283 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118382 Aug 29 10:57:39.574987 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2434/4876] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:40.025021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:40.026631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:40.046600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:40.047363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:40.048066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:40.049834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:40.051620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:40.052313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:41.717378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:41.732788 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c24263c-b816-47db-a3cf-dd02f9d4994e tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 2.293081 Aug 29 10:57:41.734602 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2443/4877] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:39 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:41.939611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:41.950285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c798017-cd53-466d-a29e-0587283df795 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 1.932964 Aug 29 10:57:41.968573 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2435/4878] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:40 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:42.758042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:42.758763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:42.800099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:42.800783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:42.801238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:42.805431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:42.813571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:42.814177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:42.978243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:42.985048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:43.019775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:43.020296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:43.020757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:43.028781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:43.029299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:43.034450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:43.244824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:43.263599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3cc9dba7-e0af-42bb-8957-2738e2a159fe tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1317 microversion: 2.1 time: 0.510501 Aug 29 10:57:43.270560 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2444/4879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:42 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:43.275109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:43.321843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:43.330564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:43.332087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:43.379224 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] Creating event network-changed:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 10:57:43.415690 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-79e16fdb-3668-4f4c-b49f-fa626fee2d8f req-aa38e38e-4342-41d6-b446-b249ac44f5b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149862 Aug 29 10:57:43.416672 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2445/4880] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:43.672923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:43.714770 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fef67b5c-f3b9-4b0f-ad39-c274412def89 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.739153 Aug 29 10:57:43.717526 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2436/4881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:42 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:44.287853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:44.288579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:44.308757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:44.309274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:44.309938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:44.310481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:44.310952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:44.311391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:44.740729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:44.742059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:44.753622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:44.755168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:44.756124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:44.757354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:44.763232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:44.765504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:45.305412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:45.323277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cc7db6c0-966c-4f35-b559-2a79bc3fe8fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.587644 Aug 29 10:57:45.335000 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2437/4882] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:44 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:45.367517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:45.389483 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f166f22-d051-4849-938b-8d73df8a68a3 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 200 len: 1506 microversion: 2.1 time: 1.108446 Aug 29 10:57:45.395340 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2446/4883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:44 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 1506 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:45.422969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:45.423584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:45.437125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:45.437909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:45.438716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:45.439890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:45.440735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:45.441731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:45.758192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:45.769391 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-774fc2e5-3e3e-4dcf-afb2-d0064fe91595 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 200 len: 1505 microversion: 2.1 time: 0.350835 Aug 29 10:57:45.775381 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2438/4884] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:45 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:45.799535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:45.800064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:45.853939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:45.854445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:45.854885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:45.855603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:45.894739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:45.895158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.028209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:57:46.350221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:46.350844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:46.367911 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-624b31d7-756d-49bf-8f12-23c6600cb2d2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 204 len: 0 microversion: 2.1 time: 0.573030 Aug 29 10:57:46.370167 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2447/4885] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:57:45 2022] DELETE /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:57:46.378646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.379257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.379708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.381143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.381143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.381337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.395337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:46.395945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:46.423237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.423870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.424331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.425100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.429467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.430185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.526332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:57:46.756353 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-18f8e0f2-4578-4ec5-be72-68085bd7c031 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "DELETE /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 204 len: 0 microversion: 2.1 time: 0.374352 Aug 29 10:57:46.759966 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2448/4886] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:57:46 2022] DELETE /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:57:46.780006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:46.781679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:46.808493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.813443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.817820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.819202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:46.822454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:46.823060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:46.850215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:46.860924 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02b5c8df-7b02-416d-ba6f-27f872bfb8b1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.515813 Aug 29 10:57:46.864767 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2439/4887] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:46 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:46.875691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:47.129326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:47.145983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf46da7b-c9a6-4adf-9b10-8f0f80bcdc9c tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 200 len: 1511 microversion: 2.1 time: 0.379066 Aug 29 10:57:47.159587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2449/4888] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:46 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:47.886294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:47.890502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:47.919809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:47.951979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:47.952942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:47.955613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:47.962175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:47.987858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:48.177922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:48.178668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:48.192992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:48.194534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:48.197786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:48.200012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:48.201915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:48.202861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:48.521427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:48.537428 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-752c5a66-4318-4534-b8ea-1fd0d40db0f5 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 200 len: 1511 microversion: 2.1 time: 0.370798 Aug 29 10:57:48.542003 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2450/4889] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:48 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:48.595344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:48.612713 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e218ccac-9d03-4a10-b7be-2080bb7db9a9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.731203 Aug 29 10:57:48.613324 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2440/4890] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:47 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:49.579428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:49.582271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:49.640271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:49.642789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:49.666580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:49.667110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:49.673951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:49.675454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:49.675988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:49.676451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:49.678066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:49.683509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:49.687045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:49.696779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:49.699169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:49.701282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:50.277663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:50.290152 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5b33e67-79ba-42e8-9079-d6a187435277 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 200 len: 1469 microversion: 2.1 time: 0.725012 Aug 29 10:57:50.294618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2451/4891] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:49 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 1469 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:50.719174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:50.745861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5dd1f673-6cd7-4b10-a3c5-ac286b379227 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 1.105729 Aug 29 10:57:50.749788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2441/4892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:49 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:50.782329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9c8e60-ff9e-43f7-9855-1d5e5165230d", "name": "network-vif-deleted", "tag": "4944eccd-eef9-475d-aacc-3f5e0409f509"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:50.794682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:50.795181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:50.795671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:50.868336 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] Creating event network-vif-deleted:4944eccd-eef9-475d-aacc-3f5e0409f509 for instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d on n-h1-854121-10 Aug 29 10:57:50.893678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-599c9eeb-f7dc-4ab9-9d77-97054dde1546 req-e7a3cec7-e90e-479d-be6d-e78299fb3230 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128221 Aug 29 10:57:50.916699 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2452/4893] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:51.167353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e5a7c7-725e-4eed-984a-3bfa92e74da6", "name": "network-vif-deleted", "tag": "acbd3728-25d6-4213-a243-020f553352fe"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:51.189689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.191233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.193071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:51.225338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] Creating event network-vif-deleted:acbd3728-25d6-4213-a243-020f553352fe for instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 on n-h1-854121-10 Aug 29 10:57:51.243644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7117f853-de17-40fe-8d34-df8a48d59f83 req-63762dd8-c930-45fe-9210-e54c4266ccd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079735 Aug 29 10:57:51.245606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2442/4894] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:51.311366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:51.312086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:51.323256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.323737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.333158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:51.334347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.335033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.335816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:51.469998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.470544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.470949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:51.472848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lazy-loading 'fault' on Instance uuid 5f9c8e60-ff9e-43f7-9855-1d5e5165230d {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:57:51.750976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d663c1f1b9c43659641ec4f29d9c817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123f9948b231469993765692f81a0dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:51.778867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:51.779723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:51.792331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-80b40437-f54a-4ea2-ab29-19ccd8b79f31 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 200 len: 1307 microversion: 2.1 time: 0.485350 Aug 29 10:57:51.826584 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2453/4895] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:51 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 1307 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:51.828709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.832143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.832815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:51.833726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:51.838784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:51.839491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:52.189495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:52.204518 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2ac5947-b35f-43cb-859c-ac827e9d713e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1682 microversion: 2.1 time: 0.439292 Aug 29 10:57:52.205257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2443/4896] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:51 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1682 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:52.756117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-245670074", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "55649a3d-61e3-4990-90a5-452030acfaae"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:52.838168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:52.845605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 5f9c8e60-ff9e-43f7-9855-1d5e5165230d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:52.880452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:52.880970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:52.887283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:52.890745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:52.892314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:52.892694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:52.911976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] validate_networks() for [('55649a3d-61e3-4990-90a5-452030acfaae', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:57:52.927198 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] HTTP exception thrown: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Request method failure captured: Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d HTTP/1.1 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJtlfbh7xGeqTQL-zMOFNjO5wt1B3SzywKPf1d3JJ_swnbUQgNbIlUtlZLAe2kC3k7b8pkn1I-FO9oWG7O3Y3eT1zKZ5cpKCnNMWxxS9y-pJ1ADheaxxRkuArN_yyq5m9OFO_-b-atRtRlmw-bwVdpSJApVJ5lXp6-B-LcJCJr6F5yA Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 123f9948b231469993765692f81a0dec Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/123f9948b231469993765692f81a0dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_123f9948b231469993765692f81a0dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/123f9948b231469993765692f81a0dec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/123f9948b231469993765692f81a0dec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 123f9948b231469993765692f81a0dec Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateTestJSON-1305352231-project Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3d663c1f1b9c43659641ec4f29d9c817 Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateTestJSON-1305352231-project Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '5f9c8e60-ff9e-43f7-9855-1d5e5165230d'} Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:57:52.929747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. Aug 29 10:57:52.934875 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:52.937363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Returning 404 to user: Instance 5f9c8e60-ff9e-43f7-9855-1d5e5165230d could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:57:52.938584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3566a67-4da0-4759-8d77-dcfcbfc7b304 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d" status: 404 len: 111 microversion: 2.1 time: 0.127910 Aug 29 10:57:52.939323 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2444/4897] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:52 2022] GET /compute/v2.1/servers/5f9c8e60-ff9e-43f7-9855-1d5e5165230d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:57:52.958229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:52.959151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] [instance: 47e5a7c7-725e-4eed-984a-3bfa92e74da6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:52.978807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:52.978807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:52.979226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:52.979958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:52.980422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:52.980849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:53.016037 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] HTTP exception thrown: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Request method failure captured: Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 HTTP/1.1 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJtlfbh7xGeqTQL-zMOFNjO5wt1B3SzywKPf1d3JJ_swnbUQgNbIlUtlZLAe2kC3k7b8pkn1I-FO9oWG7O3Y3eT1zKZ5cpKCnNMWxxS9y-pJ1ADheaxxRkuArN_yyq5m9OFO_-b-atRtRlmw-bwVdpSJApVJ5lXp6-B-LcJCJr6F5yA Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 123f9948b231469993765692f81a0dec Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/123f9948b231469993765692f81a0dec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_123f9948b231469993765692f81a0dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/123f9948b231469993765692f81a0dec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/123f9948b231469993765692f81a0dec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 123f9948b231469993765692f81a0dec Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1305352231 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-MultipleCreateTestJSON-1305352231-project Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 3d663c1f1b9c43659641ec4f29d9c817 Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-MultipleCreateTestJSON-1305352231-project Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '47e5a7c7-725e-4eed-984a-3bfa92e74da6'} Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:57:53.017898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] Returning 404 to user: Instance 47e5a7c7-725e-4eed-984a-3bfa92e74da6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cc39b30-8a30-4eb3-9da5-d04de9c0a1e2 tempest-MultipleCreateTestJSON-1305352231 tempest-MultipleCreateTestJSON-1305352231-project] 10.222.0.47 "GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6" status: 404 len: 111 microversion: 2.1 time: 0.075142 Aug 29 10:57:53.028960 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2445/4898] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:52 2022] GET /compute/v2.1/servers/47e5a7c7-725e-4eed-984a-3bfa92e74da6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:57:53.234032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:53.236589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:53.274666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:53.275162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:53.278512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:53.279346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:53.282480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:53.285450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:53.354664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:53.750663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:53.759501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb6d2c69-f4e4-4d18-ae37-99021ec6631f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.535330 Aug 29 10:57:53.764774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2446/4899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:53 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:53.866864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:53.867708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:53.880430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:53.882236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:53.883243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:53.884635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:53.887450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:53.888367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:53.993619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:57:53.994682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:57:53.995541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:57:53.996114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:57:53.996749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:57:54.006201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:54.024714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:54.026689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:54.027376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:54.030495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:54.031164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:54.031802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:54.087032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Getting quotas for project ac15cf0999714c30b3994ffbb4c6cb8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:57:54.101959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Getting quotas for user 69f93235c2504b0c9e2ab30692590ddc and project ac15cf0999714c30b3994ffbb4c6cb8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:57:54.137101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:57:54.140813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:57:54.247395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e705b72-7b5d-41c7-b86c-ff6bb764e057 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494905 Aug 29 10:57:54.254405 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2454/4900] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:57:54.263395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4ea6b54-de4a-492a-aec9-166eb98ee520 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:54.264435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4ea6b54-de4a-492a-aec9-166eb98ee520 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:54.420760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f4ea6b54-de4a-492a-aec9-166eb98ee520 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:54.428796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4ea6b54-de4a-492a-aec9-166eb98ee520 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1218 microversion: 2.1 time: 0.172097 Aug 29 10:57:54.431699 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2455/4901] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:54 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:57:54.480412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:54.496527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cefddcd3-3f73-422c-abcf-cd4494e6852b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.630196 Aug 29 10:57:54.497757 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2447/4902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:53 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:55.091639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:55.092257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:55.103122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:55.103629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:55.107029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:55.107800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:55.108283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:55.108742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:55.168858 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32903039-de3f-464b-a560-4f709f17f579 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/ips" status: 200 len: 145 microversion: 2.1 time: 0.735664 Aug 29 10:57:55.177031 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2456/4903] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 10:57:54 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/ips => generated 145 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:57:55.451104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:55.451717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:55.456398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=58 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:57:55.470021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:55.473246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:55.473710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:55.474462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:55.474922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:55.475354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:55.794525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:55.809127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-09b2656b-4527-4147-b311-c240c86747c6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1214 microversion: 2.1 time: 0.359695 Aug 29 10:57:55.810400 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2448/4904] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:55 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:56.840434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:56.844085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:56.877247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:56.880225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:56.882094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:56.884107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:56.886741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:56.891216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:57.098299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:57.125718 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d921536-b589-49d5-a90e-4fb912059d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1276 microversion: 2.1 time: 0.292547 Aug 29 10:57:57.128227 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2457/4905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:56 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:57.194403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:57.195025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:57.211528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:57.212302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:57.212920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:57.213865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:57.214489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:57.215093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:57.415035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-unplugged", "status": "completed", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:57.441486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:57.442011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:57.442459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:57.474373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] Creating event network-vif-unplugged:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 10:57:57.487811 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-663e0c2c-9b78-4249-b2b3-eac5c52b6107 req-8cd62104-68d2-41fd-b4af-1268a0b69e9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077354 Aug 29 10:57:57.489613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2458/4906] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 10:57:57.960657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fc57750-7562-49f7-bf53-91bfe5111344"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:57.963189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:57.984685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:57.985165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:57.986026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:57.987052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:57.987787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:57.988402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.016597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:58.028049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-911ae123-636a-42f5-8b59-8fe2ad7553b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.838034 Aug 29 10:57:58.050756 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2449/4907] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:57 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:58.069602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:58.070273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:58.096661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.097647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.100547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.102041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.111379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.111503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.536078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:58.552187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b5eab0b-3fc5-4c14-8c7c-94d6b0cae891 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.492432 Aug 29 10:57:58.569813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61188ed8-6268-42d7-909d-6f7ec8161c24 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613359 Aug 29 10:57:58.570485 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2459/4908] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:57:57 2022] POST /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:57:58.571649 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2450/4909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:58 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:58.600196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:58.603582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:58.615609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:58.619753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:58.620807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.621320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.621802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.622542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.623010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.623448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.638876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.639899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.640503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:58.641681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:58.642344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:58.643086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:59.220558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:59.231300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6bfa9d8-65ce-40b8-9441-1fc464771b91 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.641418 Aug 29 10:57:59.233052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2460/4910] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:58 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:59.264993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:57:59.267594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:59.284900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:59.285517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:59.287230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:59.290724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:59.291626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:59.292276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:59.302733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:57:59.311787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf7a09d8-0269-4ee9-9234-ad720b718de6 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.727300 Aug 29 10:57:59.319032 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2451/4911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:58 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:57:59.489807 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97a211f7-3897-4fc2-a7b7-85b00f49de40 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.238458 Aug 29 10:57:59.495312 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2461/4912] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:57:59 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:57:59.506238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:57:59.507467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:57:59.537550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:59.541210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:59.543114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:57:59.544919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:57:59.546947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:57:59.548189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:00.341584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:00.343532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:00.356619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:00.359717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:00.362617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:00.366474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:00.367139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:00.367752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:00.389829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:00.401569 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca92b994-434b-4555-bc2c-f3d30f319174 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1671 microversion: 2.1 time: 0.901968 Aug 29 10:58:00.404563 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2452/4913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:57:59 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1671 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:00.938387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:00.956355 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e1c524e2-48b6-4a8b-8bd8-1d21b8532fcb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.618820 Aug 29 10:58:00.958180 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2462/4914] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:00 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:01.425269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:01.426546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:01.438766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:01.445302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:01.448648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:01.450237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:01.450908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:01.452372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:01.557227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb7138a-77f2-476f-bad6-ab4fbe19c8e9", "tag": "f0a011e5-1d7d-4118-89f6-38273872fdee"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:01.586746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:01.587625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:01.588317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:01.604683 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] Creating event network-changed:f0a011e5-1d7d-4118-89f6-38273872fdee for instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 on n-h1-854121-10 Aug 29 10:58:01.613271 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-72b1dded-bf14-470e-8008-e2938ff93113 req-9af8ce80-8f6d-4e10-8d6a-127ff6ee90dc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062135 Aug 29 10:58:01.614444 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2463/4915] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:58:01.772767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:01.794985 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f04d2a26-81e0-43ec-9ece-bf33ec61190d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1671 microversion: 2.1 time: 0.368305 Aug 29 10:58:01.796574 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2453/4916] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:01 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1671 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:01.977864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:01.978671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:01.994965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:01.998462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:01.998858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:01.999728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:02.002391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:02.003068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:02.324343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:02.342708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-303a1e3c-8e2d-437f-bba8-b7a4e57d966a tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.367944 Aug 29 10:58:02.344281 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2464/4917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:01 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:02.822809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:02.823433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:02.834819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:02.835358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:02.835808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:02.836508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:02.836966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:02.837399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.317273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:03.332428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ce9944e-ed3a-4aeb-a060-63a3f51cffaa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.515234 Aug 29 10:58:03.342143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2454/4918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:02 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:03.357853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:03.366162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:03.367008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:03.369489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:03.397235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.397452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.398187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.398805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.400132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.400763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.401596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.402250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.402845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.404793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.407548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.408149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.864042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49d6f3ac-4204-44e5-b0c7-56c6084fbbfd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 200 len: 322 microversion: 2.1 time: 0.509997 Aug 29 10:58:03.864699 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2465/4919] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:58:03 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:03.875462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:03.876419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:03.890235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.891482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.897668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:03.898676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:03.899317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:03.900051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:04.059681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:04.173056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:04.189217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84256cc5-5d36-47dc-b44c-8945ff15cdcc tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.827369 Aug 29 10:58:04.204038 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2455/4920] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:03 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:04.428730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:04.625939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:04.635099 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-499f5b11-036a-4f0c-88a4-d3f7f328e5a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.764394 Aug 29 10:58:04.636270 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2466/4921] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:03 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:04.657130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:04.659013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:04.665801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:04.666523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:04.667163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:04.668047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:04.668680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:04.669462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:04.895740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:04.908175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ce0880d-f3c8-444f-9620-6c4fa45e7442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.254860 Aug 29 10:58:04.925892 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2456/4922] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:04 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:04.930435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:04.931060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:04.951029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:04.952471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:04.954833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:04.956096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:04.958993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:04.959645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:05.008646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:05.213911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:05.214404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:05.240542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:05.241073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:05.241508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:05.248019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:05.248517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:05.253095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:05.331281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:05.346352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dec6480d-4158-4cff-9577-ff0343c9b142 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.419873 Aug 29 10:58:05.349069 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2467/4923] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:04 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:05.369939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:05.370779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:05.377644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:05.378475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:05.379126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:05.379852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:05.380313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:05.380920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:05.678105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:05.692926 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce16adfb-cc61-4820-a26e-2b4026f761e3 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.484691 Aug 29 10:58:05.694748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2457/4924] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:05 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:05.788778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:05.799330 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-74341942-081d-432b-bbbd-e0194ce5e436 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.433585 Aug 29 10:58:05.802403 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2468/4925] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:05 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:06.028049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1791361141", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "603a8da8-8c3d-423e-879b-e3e712d1b689"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:06.123319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] validate_networks() for [('603a8da8-8c3d-423e-879b-e3e712d1b689', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:58:06.719861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:06.721359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:06.734079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:06.734585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:06.735030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:06.735845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:06.736313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:06.749087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:07.196210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:58:07.196727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:58:07.197766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:58:07.198652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:58:07.199176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:58:07.267060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:07.270312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:07.272887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:07.274153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:07.275081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:07.278347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:07.292320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:07.303563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2fa92091-9ba6-4d28-a867-81f24a0acdb9 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.588262 Aug 29 10:58:07.306332 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2469/4926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:06 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:07.323325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:07.332896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:07.352780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:58:07.356390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:58:07.453957 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7bd34c40-6fa2-436b-b88b-d1ab9ef6f6c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431084 Aug 29 10:58:07.470176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f45dcd6b-cab2-44ca-9685-26868848aff4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:07.473092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f45dcd6b-cab2-44ca-9685-26868848aff4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:07.478393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2458/4927] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:58:07.557814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb7138a-77f2-476f-bad6-ab4fbe19c8e9", "name": "network-vif-plugged", "status": "completed", "tag": "f0a011e5-1d7d-4118-89f6-38273872fdee"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:07.590439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:07.591157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:07.591765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:07.601263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f45dcd6b-cab2-44ca-9685-26868848aff4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:07.615922 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f45dcd6b-cab2-44ca-9685-26868848aff4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1215 microversion: 2.1 time: 0.150311 Aug 29 10:58:07.631976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2470/4928] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:07 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:07.652307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] Creating event network-vif-plugged:f0a011e5-1d7d-4118-89f6-38273872fdee for instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 on n-h1-854121-10 Aug 29 10:58:07.666172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-067f0112-59df-4a49-9e5a-79c05503aceb req-d2e979aa-ceeb-4394-992e-e7b33c0d2878 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109761 Aug 29 10:58:07.667919 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2459/4929] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:08.327455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:08.328934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:08.342898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:08.343632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:08.345164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:08.346996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:08.347786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:08.348484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:08.540365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:08.551423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dedf1f0f-0187-4675-b965-7fede1fbdce4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1318 microversion: 2.1 time: 0.228472 Aug 29 10:58:08.552805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2471/4930] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:08 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:08.639329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:08.640020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:08.659177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:08.659684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:08.660086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:08.660803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:08.661238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:08.661662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:08.842388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:08.852549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c56e4ea-5ac3-47d2-a60b-696880106337 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1211 microversion: 2.1 time: 0.219554 Aug 29 10:58:08.857543 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2460/4931] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:08 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:09.572589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:09.573318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:09.583286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:09.583785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:09.584230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:09.584950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:09.585531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:09.598679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:09.880433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:09.881926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:09.899107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:09.910061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:09.917201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:09.917201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:09.920389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:09.921560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:09.994876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:10.020166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8015e64-7b79-4d12-905a-d8bd607b68a8 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1506 microversion: 2.1 time: 0.447790 Aug 29 10:58:10.041778 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2472/4932] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:09 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:10.284049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:10.299580 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a984abe1-ba6a-41dc-9115-d36d3b881a6f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1267 microversion: 2.1 time: 0.424001 Aug 29 10:58:10.300203 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2461/4933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:09 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1267 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:11.323303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:11.338205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:11.359790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:11.362235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:11.363139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:11.365143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:11.367166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:11.368065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:11.606654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:11.622721 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7973fe18-b7ed-4506-b2c8-13a585a81957 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1273 microversion: 2.1 time: 0.304868 Aug 29 10:58:11.626379 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2473/4934] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:11 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:12.657377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:12.659542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:12.679037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:12.680152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:12.680973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:12.682175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:12.684910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:12.685909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:13.311613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:13.327947 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76806329-cc0c-422a-b784-d707c87ea2bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.677272 Aug 29 10:58:13.332423 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2462/4935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:12 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:13.517144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:13.520108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:13.536337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:13.536759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:13.537203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:13.537953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:13.538415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:13.538850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:13.625101 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef624ab5-2224-4f0e-91b3-d0ea84eb5a1e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111837 Aug 29 10:58:13.626363 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2474/4936] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:58:13 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:13.638586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:13.639750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:13.656349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:13.660066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:13.661850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:13.662656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:13.665645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:13.666550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:13.776738 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-828a3cc0-9508-4b50-9907-30f8aee75430 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344" status: 200 len: 194 microversion: 2.1 time: 0.143243 Aug 29 10:58:13.779690 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2463/4937] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 29 10:58:13 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:14.352924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:14.353545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:14.367104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:14.368892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:14.369258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:14.372975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:14.373460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:14.373939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:14.700965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:14.712971 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-372f69d4-8f78-4146-a1ca-ba67738444f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.365113 Aug 29 10:58:14.718034 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2475/4938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:14 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:15.017305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e243f21f-961d-46b0-b737-de55006a0242", "tag": "777032bd-bbca-4f54-9dee-e72e8bf5b808"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:15.044457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:15.044973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:15.045403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:15.067890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:15.082545 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] Creating event network-changed:777032bd-bbca-4f54-9dee-e72e8bf5b808 for instance e243f21f-961d-46b0-b737-de55006a0242 on n-h1-854121-10 Aug 29 10:58:15.091502 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-506c39bd-0b37-48da-a6a1-92a5ee61e38a req-87c07f8f-1c4b-4587-9f10-b547b0f9abda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079097 Aug 29 10:58:15.093269 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2464/4939] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:15.734129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:15.735572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:15.756679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:15.757231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:15.758191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:15.759462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:15.760060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:15.760505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:16.318255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:16.326644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a16386a5-564a-457e-a15e-f8e953e168e9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.596826 Aug 29 10:58:16.332994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2476/4940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:15 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:16.687332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "511ba48f-296e-4b08-9a44-f46b32d405b6"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:16.706722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:16.737066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:16.738253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:16.739439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:16.740567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:16.741231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:16.741940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:17.270021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29537223-f426-48ff-8c1e-7106361bb75c tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "POST /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587687 Aug 29 10:58:17.270021 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2465/4941] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:58:16 2022] POST /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:17.353322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:17.354004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:17.365645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:17.377955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:17.377955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:17.377955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:17.377955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:17.377955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:17.606742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:18.502711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:18.504280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:18.509346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:18.509975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:18.533837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:18.534446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:18.538565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:18.540207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:18.549114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:18.550854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:18.665727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-75e10762-9993-44c8-b8b5-886c01ae8d90 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/ips" status: 200 len: 151 microversion: 2.20 time: 0.163982 Aug 29 10:58:18.666635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2466/4942] 10.222.0.47 () {60 vars in 1289 bytes} [Mon Aug 29 10:58:18 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/ips => generated 151 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 10:58:18.676669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:18.685443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a73f1d3c-67fe-4b6f-a5a1-2ce55d12a016 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 1.336646 Aug 29 10:58:18.693582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2477/4943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:17 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:19.720225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:19.722823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:19.762461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:19.763097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:19.763565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:19.764329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:19.764798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:19.765237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:20.275875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:20.290388 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2dd0e4fa-21ab-4585-88a3-4a0672c19694 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.580718 Aug 29 10:58:20.306262 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2467/4944] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:19 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:20.955245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: .version_select at 0x7f66c6f05430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-959738454", "policies": ["affinity"]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:21.027232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.065921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.245756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.255423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.292594 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d5976933-b9a3-4291-aad5-41ddb1b1caf4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.647946 Aug 29 10:58:21.294968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2478/4945] 10.222.0.47 () {60 vars in 1174 bytes} [Mon Aug 29 10:58:20 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:21.306942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: .version_select at 0x7f66c6f534c0>, body: {"server_group": {"name": "tempest-server-group-1082995120", "policies": ["affinity"]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:21.339005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:21.343697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:21.366892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:21.367831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:21.368123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.368749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:21.369921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:21.370640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:21.371328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:21.397779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.495212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.504239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.532215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f8e9b6de-dbd0-4675-86aa-c3449ddb9056 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.229221 Aug 29 10:58:21.539839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2468/4946] 10.222.0.47 () {60 vars in 1173 bytes} [Mon Aug 29 10:58:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:21.545235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: .version_select at 0x7f66c70359d0>, body: {"server_group": {"name": "tempest-server-group-1082995120", "policies": ["affinity"]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:21.567703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.574377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.627772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:21.636334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.646015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:21.668428 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-054c4a7c-4e44-4a63-9d7b-bc2634504de0 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.127056 Aug 29 10:58:21.669402 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2469/4947] 10.222.0.47 () {60 vars in 1173 bytes} [Mon Aug 29 10:58:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:21.681575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e4a19e3-0217-4301-8539-1daee093b599 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:21.718142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e4a19e3-0217-4301-8539-1daee093b599 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/a0cd77e5-caca-495a-aa03-a2e2813f5c74" status: 204 len: 0 microversion: 2.1 time: 0.040812 Aug 29 10:58:21.723347 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2470/4948] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:58:21 2022] DELETE /compute/v2.1/os-server-groups/a0cd77e5-caca-495a-aa03-a2e2813f5c74 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:58:21.730578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8e2138a-c1db-48e4-989d-a842192ccd5e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:21.753960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8e2138a-c1db-48e4-989d-a842192ccd5e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.028929 Aug 29 10:58:21.755079 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2471/4949] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:58:21 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:21.771109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-85c83a95-6005-462c-8ddb-96d7dc2fa937 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:21.808876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-85c83a95-6005-462c-8ddb-96d7dc2fa937 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/87044aea-8723-420f-88ed-595651676056" status: 204 len: 0 microversion: 2.1 time: 0.043367 Aug 29 10:58:21.810384 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2472/4950] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:58:21 2022] DELETE /compute/v2.1/os-server-groups/87044aea-8723-420f-88ed-595651676056 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:58:21.825356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-46966bc0-e548-461a-8418-520132fda45d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:21.853312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-46966bc0-e548-461a-8418-520132fda45d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035783 Aug 29 10:58:21.856459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2473/4951] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:58:21 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:21.868776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: .version_select at 0x7f66c6f53310>, body: {"server_group": {"name": "tempest-server-group-620788201", "policies": ["affinity"]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:21.930528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:21.946137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:22.035444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:22.058361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:22.093245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a0f1b36-fbc4-49cf-b6d2-0686b9441b67 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.230634 Aug 29 10:58:22.103072 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2474/4952] 10.222.0.47 () {60 vars in 1173 bytes} [Mon Aug 29 10:58:21 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:58:22.112885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a06264f-bc68-42a3-9c38-aaaeec5dcaed tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:22.202353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a06264f-bc68-42a3-9c38-aaaeec5dcaed tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/33626d2d-c6f8-450a-904e-4695b3b1f578" status: 204 len: 0 microversion: 2.1 time: 0.097972 Aug 29 10:58:22.203551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2475/4953] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:58:22 2022] DELETE /compute/v2.1/os-server-groups/33626d2d-c6f8-450a-904e-4695b3b1f578 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:58:22.209828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:22.214289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-064edfc5-82b6-4193-a235-19d3da798039 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:22.219474 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-567fba32-47c3-4278-ba34-0161a64928ad tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.897444 Aug 29 10:58:22.226102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2479/4954] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:21 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:22.256709 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-064edfc5-82b6-4193-a235-19d3da798039 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.047633 Aug 29 10:58:22.257741 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2476/4955] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:58:22 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:58:22.270818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: .version_select at 0x7f66c6eb9790>, body: {"server_group": {"name": "tempest-server-group-232970727", "policies": ["anti-affinity"]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:22.338281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:22.352360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:22.376070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:22.487794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:22.495148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_groups'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:22.536148 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e607e390-eca4-4f57-9878-c2a2aa54e8a1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.270794 Aug 29 10:58:22.539704 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2480/4956] 10.222.0.47 () {60 vars in 1173 bytes} [Mon Aug 29 10:58:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:22.551068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0011b24-5c5b-4a42-ad45-b357b21c8bae tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:22.641854 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0011b24-5c5b-4a42-ad45-b357b21c8bae tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/f4ad32ad-ec45-4867-be5a-ed2c971fbe55" status: 204 len: 0 microversion: 2.1 time: 0.095627 Aug 29 10:58:22.642952 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2477/4957] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:58:22 2022] DELETE /compute/v2.1/os-server-groups/f4ad32ad-ec45-4867-be5a-ed2c971fbe55 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 10:58:22.652321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-362de0b4-7aef-40e4-ac4f-a341d26c11b3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:22.679236 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-362de0b4-7aef-40e4-ac4f-a341d26c11b3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031564 Aug 29 10:58:22.682719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2481/4958] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:58:22 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 10:58:22.809651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-71875991", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "11950614-4baa-4744-88cf-e306d723d97b"}]}, "os:scheduler_hints": {"group": "6ece520d-6398-466a-b6b5-fee7d676486f"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:23.245209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:23.245933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:23.260587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:23.262172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:23.263693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:23.264820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:23.265445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:23.266449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:23.726245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:23.739457 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ae0078d-ae03-41d0-ac02-f58ef4f0b356 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.497333 Aug 29 10:58:23.743051 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2482/4959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:23 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:23.749401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:23.750254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:23.769246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:23.770160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:23.770861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:23.771938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:23.772677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:23.773504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:23.857318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lazy-loading 'flavor' on Instance uuid 94942cf0-a68b-4673-b2d8-cd531bd71d43 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:58:30.286497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:32.083414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:32.516086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:32.835399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=12,nova_api:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:33.756729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:34.038387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:38.516490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] validate_networks() for [('11950614-4baa-4744-88cf-e306d723d97b', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:58:38.682899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0e179cd6-4be3-4f3f-8bbe-1f40ee4b4c6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/action" status: 202 len: 0 microversion: 2.20 time: 14.937722 Aug 29 10:58:38.688807 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2483/4960] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:58:23 2022] POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/action => generated 0 bytes in 14944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:58:38.700997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e243f21f-961d-46b0-b737-de55006a0242", "name": "network-vif-plugged", "status": "completed", "tag": "777032bd-bbca-4f54-9dee-e72e8bf5b808"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:38.736626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:38.737111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:38.737535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:38.766499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] Creating event network-vif-plugged:777032bd-bbca-4f54-9dee-e72e8bf5b808 for instance e243f21f-961d-46b0-b737-de55006a0242 on n-h1-854121-10 Aug 29 10:58:38.783199 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-06f87abb-60ac-4de8-8bc9-85e072061ad8 req-1515cb79-e760-4ca7-8db5-0f8bbd23df49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090706 Aug 29 10:58:38.783836 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2484/4961] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:38.797053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:38.798717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:38.815192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:38.815690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:38.816135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:38.816853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:38.817315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:38.817766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:39.388308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:39.418329 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bddeaca3-ea8b-49be-8d96-b6230a7ef038 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1315 microversion: 2.1 time: 0.632144 Aug 29 10:58:39.420797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2485/4962] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:38 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:39.431804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:39.440346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:39.452495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:39.457507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:39.458716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:39.462640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:39.466111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:39.466885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:39.567841 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-363f1023-e7d9-4ee8-be8c-498f40481c60 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.145389 Aug 29 10:58:39.576192 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2486/4963] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:58:39 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:39.583790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:39.590929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:39.603442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:39.603951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:39.604417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:39.606768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:39.607245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:39.607689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.705856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:40.721666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:40.731394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:40.733494 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3289ab80-5b60-4f0b-b010-a5b3e336ac9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 1.155457 Aug 29 10:58:40.734303 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2487/4964] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:39 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:40.742290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:40.747391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:40.762675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.763181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.763627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.764348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.764826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.765255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.812745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:58:40.815650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:58:40.816354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:58:40.817068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:58:40.817880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:58:40.850012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-203fe44b-a41f-4117-b304-a4dcd3838995 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344" status: 200 len: 194 microversion: 2.1 time: 0.113224 Aug 29 10:58:40.850676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2488/4965] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 29 10:58:40 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:40.874333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:40.878342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:40.883079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.883594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.884040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.884794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.885253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.885680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.900783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.903887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.906860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.908420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:40.914646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:40.916488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:40.956955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:40.975563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:41.019701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:58:41.022619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:58:41.146688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:41.163343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:41.241724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:58:41.258812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Getting quotas for user 64006016fc444707b06eb4487e333249 and project 187b13567ff2450fae9d757f3d1afac8. Resources: {'server_group_members'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:58:41.344066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-067531fb-5606-45c0-aef5-ebcb102d8fa3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.557462 Aug 29 10:58:41.349789 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2478/4966] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 18562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 10:58:41.363143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:41.363653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:41.392421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:41.392973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:41.394589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:41.399663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:41.400279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:41.400734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:41.406534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:41.429056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f33bb280-a5d6-491b-a5fa-0e067c83f16b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1503 microversion: 2.1 time: 0.577267 Aug 29 10:58:41.446054 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2489/4967] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:40 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1503 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:41.459270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47b79c6b-1b7b-4a2a-a12c-530a27ed6441 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:41.460235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47b79c6b-1b7b-4a2a-a12c-530a27ed6441 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:41.628264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lazy-loading 'services' on Instance uuid ef687dd3-0846-451a-a3d0-3c3469335a17 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:58:41.663975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47b79c6b-1b7b-4a2a-a12c-530a27ed6441 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:41.690469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47b79c6b-1b7b-4a2a-a12c-530a27ed6441 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1211 microversion: 2.1 time: 0.241646 Aug 29 10:58:41.691976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2490/4968] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:41 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1211 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:41.718321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:41.736177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:41.736916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:41.739023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:41.836937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cefe272-cdbf-4333-a239-311873ba7586 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344" status: 202 len: 0 microversion: 2.1 time: 0.485777 Aug 29 10:58:41.837601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2479/4969] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:58:41 2022] DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/7fc57750-7562-49f7-bf53-91bfe5111344 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:58:41.838265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Going to try to stop instance {{(pid=128681) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 10:58:41.853796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:41.858377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:41.882939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:41.883432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:41.892243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:41.894844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:41.896812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:41.898138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:41.992122 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c03b08d0-3bb7-4501-a735-fe7554bbb2a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242/action" status: 202 len: 0 microversion: 2.1 time: 0.298555 Aug 29 10:58:41.993623 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2491/4970] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:58:41 2022] POST /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:58:42.006540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:42.019280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:42.036002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:42.038109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:42.040955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:42.044554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:42.045404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:42.046201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:42.635105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:42.649451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:42.656913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:42.662472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:42.676218 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aee19bd7-0880-4121-bcb9-1b3fe824d2a5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.834202 Aug 29 10:58:42.676499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b535e2e-1ea8-4cb8-bce1-a628dac64e2a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.673535 Aug 29 10:58:42.678752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2480/4971] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:41 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:42.681382 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2492/4972] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:41 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:42.713206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:42.713908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:42.724648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:42.725140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:42.725801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:42.730095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:42.730615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:42.733455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:43.266842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:43.276711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e48f52d-d903-4de0-ab27-e784490abaf6 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1215 microversion: 2.1 time: 0.567836 Aug 29 10:58:43.281590 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2481/4973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:42 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1215 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:43.699358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:43.700584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:43.722261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:43.722893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:43.723666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:43.724348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:43.725186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:43.726215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:43.726843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:43.730452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:43.735956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:43.736477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:43.739829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:43.740604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:43.743578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:43.744322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:44.546321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:44.563113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:44.565332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:44.566593 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f07259e3-2d89-4375-b27a-82aeb8fa12eb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.849977 Aug 29 10:58:44.578302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2482/4974] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:43 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:58:44.591455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:44.592098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:44.619870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:44.620231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:44.622346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:44.626595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:44.627309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:44.627912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:44.722370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:44.735263 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1158b136-7d9e-4fc8-99da-2b3efc61b259 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 1.040747 Aug 29 10:58:44.740829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2493/4975] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:43 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:44.853998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:44.863559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d52749e5-8c15-4af2-a680-69e0acd8a25a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1269 microversion: 2.1 time: 0.283921 Aug 29 10:58:44.867968 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2483/4976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:44 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1269 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:45.593283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:45.594239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:45.602369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:45.603415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:45.604045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:45.604943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:45.605593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:45.606246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:45.767342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:45.768127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:45.780348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:45.781612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:45.783342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:45.786401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:45.789779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:45.792061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:46.218390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:46.249426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:46.253429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:46.256630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-62849397-9f23-4b98-a51c-299e083db3a0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.666695 Aug 29 10:58:46.259578 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2494/4977] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:45 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:46.284194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:46.287497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:46.308986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:46.311307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:46.314470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:46.318916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:46.319812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:46.321645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:46.358668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:46.392139 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-411020b9-6e17-4218-884f-c12129f93c7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.625621 Aug 29 10:58:46.396900 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2484/4978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:45 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:46.967726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:46.984847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-511d0f47-e4af-4b81-9432-bf8b4c698c45 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.723592 Aug 29 10:58:47.005650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2495/4979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:46 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:47.286419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:47.286817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:47.305853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:47.306308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:47.306756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:47.310983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:47.311489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:47.314328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:47.416657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:47.417976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:47.432869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:47.433661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:47.434705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:47.435687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:47.436324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:47.436949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:48.250102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:48.263495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:48.264442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:48.290185 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d99939b-9eca-4d26-86e2-08dec5d658dd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.985053 Aug 29 10:58:48.311091 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2485/4980] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:47 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:48.339158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:48.340795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:48.379888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:48.380392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:48.389524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:48.392754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:48.395008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:48.395647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:48.467149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:48.497292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fbb9ad4-238e-4a94-8098-0a9cb2cc4646 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 1.073250 Aug 29 10:58:48.497292 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2496/4981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:47 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:48.507194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e50cb1e-c829-4614-8f36-d00ee941618e", "tag": "bd646252-2767-4a10-9673-994f89d1bfe7"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:48.547987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:48.549362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:48.549850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:48.595489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] Creating event network-changed:bd646252-2767-4a10-9673-994f89d1bfe7 for instance 3e50cb1e-c829-4614-8f36-d00ee941618e on n-h1-854121-10 Aug 29 10:58:48.605848 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-42646b12-3a95-432c-89cf-8f27e0b13ac0 req-728d4343-0cde-4154-83d1-16839c6eaea8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106802 Aug 29 10:58:48.610976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2497/4982] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:48.639970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:48.653404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b9b32a1-92ad-4cf9-a448-00a3ffcfbac1 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.332246 Aug 29 10:58:48.654524 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2486/4983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:48 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:49.319619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:49.320697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:49.344194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:49.345318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:49.346974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:49.348318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:49.349035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:49.349675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:49.520814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:49.522313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:49.543368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:49.543896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:49.546209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:49.546998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:49.548888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:49.549315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:49.969558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:49.977082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:49.987444 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deff8ad4-2a15-43a2-a4ec-7c0d30677e5f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.474097 Aug 29 10:58:49.988058 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2487/4984] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:49 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:50.000538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:50.000538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:50.017128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:50.023084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:50.024877 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c69d422e-a490-4e3d-b586-7b69d7c1f9fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.709743 Aug 29 10:58:50.029061 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2498/4985] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:49 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:50.032358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:50.035480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:50.036199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:50.039885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:50.040780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:50.041445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:50.583464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:50.592931 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d6c11919-c882-48ac-8c63-7b0708af8e47 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.603750 Aug 29 10:58:50.617031 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2488/4986] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:49 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:51.014430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:51.015175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:51.039428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.039928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.040376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.041109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.049033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.050047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.059726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:51.060347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:51.073016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:51.102009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.102945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.103573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.104543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.105003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.105437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.279202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:51.682893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:51.843017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:51.852778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:51.864592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e5c13093-928a-4916-aca6-23db7cd98811 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.855545 Aug 29 10:58:51.880063 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2499/4987] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:51 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:51.884372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:51.889656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:51.894780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:51.896064 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f509ca5a-8168-45e6-9b9b-e7b2e92ab1f7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.843911 Aug 29 10:58:51.896636 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2489/4988] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:51 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:51.899355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:51.911125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.911898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.912591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.914630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.915330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.916004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.929735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:51.930751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:51.952313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.953079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.953882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.955787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:51.956433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:51.957147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:51.963723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc795fab-e373-413d-b71e-edfd658a1aed tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/511ba48f-296e-4b08-9a44-f46b32d405b6" status: 200 len: 194 microversion: 2.1 time: 0.082203 Aug 29 10:58:51.965183 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2500/4989] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 29 10:58:51 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/511ba48f-296e-4b08-9a44-f46b32d405b6 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:51.992293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:51.993886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:52.004544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.008368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.009018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.010104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.010730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.011324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.160593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:52.166335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lazy-loading 'services' on Instance uuid ef687dd3-0846-451a-a3d0-3c3469335a17 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:58:52.289870 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7e3ef761-bf2a-4c95-b580-1170f27f28f9 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/511ba48f-296e-4b08-9a44-f46b32d405b6" status: 202 len: 0 microversion: 2.1 time: 0.310591 Aug 29 10:58:52.290480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2501/4990] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:58:51 2022] DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments/511ba48f-296e-4b08-9a44-f46b32d405b6 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:58:52.426404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:52.435778 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aff2d181-0dc1-441a-8360-ff9982dcae7e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.518087 Aug 29 10:58:52.436567 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2490/4991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:51 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:52.541806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d081dbd-403b-4f24-b586-2e9f4d51d53c", "device": "/dev/sdb"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:52.544882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:52.551497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.551914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.552354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.553050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.553505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.553967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.901436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:52.902200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:52.919910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.920413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.920859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.921587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.922070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.925140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.950543 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8aab6c08-e00a-40c0-82be-85a542fd3b1b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "POST /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411649 Aug 29 10:58:52.952901 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2502/4992] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 10:58:52 2022] POST /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:52.977933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:52.979609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:52.990427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.991347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.991962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:52.992891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:52.993414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:52.994297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:53.457548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:53.472289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:53.473896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:53.475199 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4948e12f-f5aa-4cd9-b74f-bf0d2b0aa04d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.508586 Aug 29 10:58:53.475770 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2503/4993] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:52 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:53.497643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:53.498523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:53.519638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:53.520405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:53.522392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:53.523363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:53.523998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:53.525959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:53.582222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:53.593450 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4dde935a-c936-42bf-bff0-0ed9ee6ec1c2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.696723 Aug 29 10:58:53.596068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2491/4994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:52 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:53.708097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e50cb1e-c829-4614-8f36-d00ee941618e", "name": "network-vif-plugged", "status": "completed", "tag": "bd646252-2767-4a10-9673-994f89d1bfe7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:58:53.725847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:53.726601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:53.727235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:53.744297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] Creating event network-vif-plugged:bd646252-2767-4a10-9673-994f89d1bfe7 for instance 3e50cb1e-c829-4614-8f36-d00ee941618e on n-h1-854121-10 Aug 29 10:58:53.760365 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0035ba1d-2304-4f40-be0b-2ad830d8e175 req-3227ec01-209f-4fda-a3b7-124e6fad8b9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057535 Aug 29 10:58:53.761279 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2492/4995] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:54.056994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:54.066442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-655f98e4-acbd-4b7d-ae52-dfdaf021f578 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.572566 Aug 29 10:58:54.067199 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2504/4996] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:53 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:54.500341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:54.501105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:54.507921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:54.508685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:54.509399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:54.510330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:54.510969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:54.511400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:54.615676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:54.617349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:54.629668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:54.630656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:54.631375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:54.632460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:54.633097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:54.633812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:54.811976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:54.824093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:54.833795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:54.839013 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b065b4ae-6fa4-44a6-a26e-c0a777fab1ca tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.342946 Aug 29 10:58:54.840873 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2493/4997] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:54 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:54.901600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:54.917814 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e50725b-8757-40ed-82ac-252ed1bad9f3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.307439 Aug 29 10:58:54.934957 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2505/4998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:54 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:55.088969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:55.089949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:55.098704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.102427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.102910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.103639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.104102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.104538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.493970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:55.508274 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3342c370-54dc-45cc-9ac5-8887d9a8c6e4 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1311 microversion: 2.1 time: 0.423576 Aug 29 10:58:55.509554 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2494/4999] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:55 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:58:55.866280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:55.866997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:55.886578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.887963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.888594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.889523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.890277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.890974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.941491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:55.943067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:55.957499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.958387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.959013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.964775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:55.965720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:55.966330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:55.972683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:58:56.845147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:56.873488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:56.877121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:56.878638 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb25837f-596d-490d-be0e-d4edc7c8442a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 1.016721 Aug 29 10:58:56.879954 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2506/5000] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:55 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:56.886474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:56.888941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:56.917363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:56.918181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:56.918774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:56.919752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:56.920376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:56.920818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:56.937541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:56.952801 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-774e6ec3-e458-437f-a6ae-ed8e348530aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 1.015085 Aug 29 10:58:56.956926 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2495/5001] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:55 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:57.230842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:57.240415 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fbf765fb-e795-435e-828f-209d8e4b9655 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1497 microversion: 2.1 time: 0.358816 Aug 29 10:58:57.246767 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2507/5002] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:56 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1497 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:57.261951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:57.292147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_groups [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Querying cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) for 1 instances {{(pid=128682) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 10:58:57.293127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.293855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.295185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.317874 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ce1ede22-8ea5-4106-9489-c0dd62e4f73a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f" status: 200 len: 221 microversion: 2.1 time: 0.059771 Aug 29 10:58:57.324569 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2496/5003] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:58:57 2022] GET /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f => generated 221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:58:57.330069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:57.330574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:57.347754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.348526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.349177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.350096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.350728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.351325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.411291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:58:57.569549 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e9b41ea-b3ed-4df8-a1e4-cdd68cd66154 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 204 len: 0 microversion: 2.1 time: 0.243313 Aug 29 10:58:57.581797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2508/5004] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:58:57 2022] DELETE /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:58:57.591539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:57.592179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:57.616506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.617256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.617746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.618522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.618988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.619596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.902925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:57.903755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:57.911935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.912728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.913388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.914333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:57.914983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:57.915604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:57.962974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:57.972576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-45233e99-c3b6-4043-ab5d-64c5f76d151e tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1503 microversion: 2.1 time: 0.386639 Aug 29 10:58:57.986826 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2497/5005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:57 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:57.996351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:57.997478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:58.004291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:58.005023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:58.005632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:58.006566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:58.007395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:58.008002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:58.312054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:58.336723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:58.339658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:58.349897 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-773f21aa-9843-416c-bfaa-69eea6906e72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.451229 Aug 29 10:58:58.353197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2509/5006] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:57 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:58:58.429466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:58.442620 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-178640d0-cb16-4214-9814-365c2dfcf8b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.454155 Aug 29 10:58:58.443279 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2498/5007] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:57 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:58.999164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:59.003010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:59.040517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.043050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.048237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.050161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.050874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.052520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.383601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:59.384421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:59.420413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.421130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.421723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.424055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.426785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.427555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.484532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:59.496275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ff25d47-9379-42dd-ac13-7fcc5fcdaa6a tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1503 microversion: 2.1 time: 0.501611 Aug 29 10:58:59.500998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2510/5008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:58 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:58:59.506117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:59.513454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:59.529049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.529845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.530484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.531397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.532778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.533393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.848885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:59.861628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:59.865374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:58:59.870477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f165349-fee5-4a00-bb19-5af990afcd7a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.493631 Aug 29 10:58:59.871627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2499/5009] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:58:59 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:58:59.880703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:58:59.890341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:58:59.904821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.905347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.905831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:58:59.910408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:58:59.910910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:58:59.911361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.025818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:00.038113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e773e2f2-384c-4f78-a8ec-6d1da11b9416 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164859 Aug 29 10:59:00.048947 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fad33ad1-6b70-4d53-9455-1d7380df541b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.536942 Aug 29 10:59:00.049219 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2500/5010] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:58:59 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:00.049407 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2511/5011] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:58:59 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:00.291993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:00.294375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:00.309427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.314138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.317520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.318613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.319535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.320676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.402401 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f226929d-6de1-4875-a88a-5cff71958288 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112256 Aug 29 10:59:00.404383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2501/5012] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 10:59:00 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:00.539138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:00.540404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:00.551848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.552661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.553278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.554197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.554825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.556193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.645100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:00.646169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:00.674297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.674830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.675293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.676074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.676547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.676991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.789132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 10:59:00.887495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:00.916069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7000e97-bf73-4102-a951-dd3332640585 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1461 microversion: 2.1 time: 0.384505 Aug 29 10:59:00.930301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2512/5013] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:00 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1461 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:00.950323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:00.954428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:00.972682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.973169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.978414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:00.979425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:00.982587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:00.983523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.018105 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-316bb076-979c-4517-ac79-3f24d2a5309d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 204 len: 0 microversion: 2.1 time: 0.379812 Aug 29 10:59:01.020785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2502/5014] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:59:00 2022] DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:59:01.037260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e50cb1e-c829-4614-8f36-d00ee941618e", "name": "network-vif-deleted", "tag": "bd646252-2767-4a10-9673-994f89d1bfe7"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:01.054469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.056548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.058981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.088044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] Creating event network-vif-deleted:bd646252-2767-4a10-9673-994f89d1bfe7 for instance 3e50cb1e-c829-4614-8f36-d00ee941618e on n-h1-854121-10 Aug 29 10:59:01.105313 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5d63865d-e68c-4629-9390-97a45e42eb47 req-686ef6d5-5cce-4b11-8a5d-ad828a7202e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081429 Aug 29 10:59:01.106271 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2503/5015] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:01.125334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:01.126485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:01.129622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:01.148420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.151942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.154475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.157608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.158873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.162513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.604121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:01.623171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ead015e2-aa96-4f5a-b2dc-1b266e65af32 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1672 microversion: 2.1 time: 0.515611 Aug 29 10:59:01.623784 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2504/5016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:01 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1672 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:01.631174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:01.633383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:01.634336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:01.644779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.646244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.646928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.647875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.648564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.649379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.666301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:01.681334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:01.684626 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b96d39e-a87d-4e3c-a136-e7cce146e917 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.752812 Aug 29 10:59:01.686247 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2513/5017] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:00 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:01.894531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:01.903400 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f692e05-4718-4f1f-aec9-c9949b512702 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.275694 Aug 29 10:59:01.907417 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2505/5018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:01 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:01.938779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:01.939698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:01.963638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.965828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.966463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:01.967363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:01.974495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:01.975073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:02.067303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:02.070035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:02.073261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:02.074815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lazy-loading 'fault' on Instance uuid 3e50cb1e-c829-4614-8f36-d00ee941618e {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:59:02.082139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:02.125151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64006016fc444707b06eb4487e333249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187b13567ff2450fae9d757f3d1afac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:02.147457 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f2fce5f4-4542-46be-9ea9-83128d311420 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 200 len: 1301 microversion: 2.1 time: 0.213490 Aug 29 10:59:02.153092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2514/5019] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:01 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 1301 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:02.675816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:02.678393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:02.710654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:02.711181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:02.711625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:02.714898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:02.718849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:02.720758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:02.721529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:02.727718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:02.744104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:02.754204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:02.755166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:02.756669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:02.758248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:02.759183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.348187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:03.387315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:03.394807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:03.396546 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c5a66f2-3b75-45fb-a1c9-2dd3751b3420 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.683356 Aug 29 10:59:03.397676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2515/5020] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:02 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:03.409043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:03.417790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:03.425554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:03.426115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:03.426553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.439112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:03.439684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:03.440139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.737529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:03.751921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a83b25fb-d34b-4906-b814-06cee2c91f04 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1672 microversion: 2.1 time: 1.094135 Aug 29 10:59:03.753782 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2506/5021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:02 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1672 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:03.771378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:03.772888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:03.790841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:03.793107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:03.793602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.794653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:03.798349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:03.799664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.836849 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e HTTP/1.1 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3e50cb1e-c829-4614-8f36-d00ee941618e'} Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:03.839099 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:03.843700 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:03.857249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:03.859279 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f250843-eb2c-48f2-a25c-c049f61c9168 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 404 len: 111 microversion: 2.1 time: 0.104093 Aug 29 10:59:03.861072 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2507/5022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:03 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:03.879336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:03.933728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_groups [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Querying cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) for 1 instances {{(pid=128682) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 10:59:03.934885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:03.935649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:03.938676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:03.983051 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8db6f85e-e73b-47bc-b347-b7061928800d tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.113301 Aug 29 10:59:03.987597 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2508/5023] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 10:59:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:04.004365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.037478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:04.054941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_groups [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Querying cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) for 1 instances {{(pid=128682) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 10:59:04.055239 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6c165632-f075-42e8-9fb1-d8b7c9125b5a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.655828 Aug 29 10:59:04.056036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.056869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.057495 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2516/5024] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:03 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:04.081823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.103056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0bce6147-67f7-4aae-b761-c618678a2d2b tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f" status: 200 len: 183 microversion: 2.1 time: 0.105177 Aug 29 10:59:04.104307 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2509/5025] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 10:59:03 2022] GET /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:04.117892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.118691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:04.126960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:04.140360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.143799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.155615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.166466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.182743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.183521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.284942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e HTTP/1.1 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '3e50cb1e-c829-4614-8f36-d00ee941618e'} Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:04.289612 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.294156 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ab522448-542d-4560-95ee-0267323bbc18 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 404 len: 111 microversion: 2.1 time: 0.179950 Aug 29 10:59:04.295464 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2517/5026] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:04.305989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.306998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] [instance: 3e50cb1e-c829-4614-8f36-d00ee941618e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:04.332913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.333715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.339265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.340686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.342309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.350606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.388971 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e HTTP/1.1 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '3e50cb1e-c829-4614-8f36-d00ee941618e'} Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.402218 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. Aug 29 10:59:04.408263 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.411654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance 3e50cb1e-c829-4614-8f36-d00ee941618e could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.414711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fbdb1e60-9841-4776-91a5-404b1f63fdb3 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e" status: 404 len: 111 microversion: 2.1 time: 0.113019 Aug 29 10:59:04.418316 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2510/5027] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:04 2022] GET /compute/v2.1/servers/3e50cb1e-c829-4614-8f36-d00ee941618e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:04.428539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39457f80-acf4-4c50-9f60-7172906eb0ab tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.434849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.435393 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-39457f80-acf4-4c50-9f60-7172906eb0ab tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. Aug 29 10:59:04.435546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39457f80-acf4-4c50-9f60-7172906eb0ab tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-server-groups/f4ad32ad-ec45-4867-be5a-ed2c971fbe55 HTTP/1.1 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f4ad32ad-ec45-4867-be5a-ed2c971fbe55'} Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.438209 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. Aug 29 10:59:04.442644 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.444548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39457f80-acf4-4c50-9f60-7172906eb0ab tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance group f4ad32ad-ec45-4867-be5a-ed2c971fbe55 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.445625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39457f80-acf4-4c50-9f60-7172906eb0ab tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/f4ad32ad-ec45-4867-be5a-ed2c971fbe55" status: 404 len: 117 microversion: 2.1 time: 0.021765 Aug 29 10:59:04.451720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2518/5028] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/os-server-groups/f4ad32ad-ec45-4867-be5a-ed2c971fbe55 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:59:04.462509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.463013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.463488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.464176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.464577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e650dfe4-5422-4b0e-aa21-8986b5a3d385 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.464767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.465056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.475642 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e650dfe4-5422-4b0e-aa21-8986b5a3d385 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e650dfe4-5422-4b0e-aa21-8986b5a3d385 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-server-groups/33626d2d-c6f8-450a-904e-4695b3b1f578 HTTP/1.1 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '33626d2d-c6f8-450a-904e-4695b3b1f578'} Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.477497 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. Aug 29 10:59:04.482446 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.484412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e650dfe4-5422-4b0e-aa21-8986b5a3d385 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance group 33626d2d-c6f8-450a-904e-4695b3b1f578 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.488181 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e650dfe4-5422-4b0e-aa21-8986b5a3d385 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/33626d2d-c6f8-450a-904e-4695b3b1f578" status: 404 len: 117 microversion: 2.1 time: 0.032858 Aug 29 10:59:04.489209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2519/5029] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/os-server-groups/33626d2d-c6f8-450a-904e-4695b3b1f578 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:04.499599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b85b19b-9847-4058-9930-178ca390b468 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.518858 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2b85b19b-9847-4058-9930-178ca390b468 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b85b19b-9847-4058-9930-178ca390b468 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-server-groups/87044aea-8723-420f-88ed-595651676056 HTTP/1.1 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '87044aea-8723-420f-88ed-595651676056'} Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.523517 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b85b19b-9847-4058-9930-178ca390b468 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance group 87044aea-8723-420f-88ed-595651676056 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b85b19b-9847-4058-9930-178ca390b468 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/87044aea-8723-420f-88ed-595651676056" status: 404 len: 117 microversion: 2.1 time: 0.032167 Aug 29 10:59:04.528959 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2520/5030] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/os-server-groups/87044aea-8723-420f-88ed-595651676056 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:59:04.537110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a28bc6ee-1d5d-4275-b8a7-314dfcbf7018 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.556792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a28bc6ee-1d5d-4275-b8a7-314dfcbf7018 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] HTTP exception thrown: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a28bc6ee-1d5d-4275-b8a7-314dfcbf7018 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Request method failure captured: Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/os-server-groups/a0cd77e5-caca-495a-aa03-a2e2813f5c74 HTTP/1.1 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJvMlCmR-TOfuS_nykxaWqL0uniCabWBHlXAO6qx6SMgSQYRH0I3AR-RcZSjTRNe0BRYtETNhZXTDkagLYqAdggyIonTBcGBv27YJPWO9TJAfLzZu-tG3eY83jXGQTKLpnN6rN8PYxwE32PG_Ih_EfeddrsFU0sziL9zPKisXBgCP1w Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/187b13567ff2450fae9d757f3d1afac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 187b13567ff2450fae9d757f3d1afac8 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerGroupTestJSON-658823565 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 64006016fc444707b06eb4487e333249 Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerGroupTestJSON-658823565-project Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a0cd77e5-caca-495a-aa03-a2e2813f5c74'} Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.561262 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. Aug 29 10:59:04.567419 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:04.570353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a28bc6ee-1d5d-4275-b8a7-314dfcbf7018 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Returning 404 to user: Instance group a0cd77e5-caca-495a-aa03-a2e2813f5c74 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:04.572477 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a28bc6ee-1d5d-4275-b8a7-314dfcbf7018 tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/a0cd77e5-caca-495a-aa03-a2e2813f5c74" status: 404 len: 117 microversion: 2.1 time: 0.039908 Aug 29 10:59:04.575708 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2521/5031] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/os-server-groups/a0cd77e5-caca-495a-aa03-a2e2813f5c74 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 10:59:04.589272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83c1625c-cd8d-4daa-973e-d0fb6bf4f13c tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.647436 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83c1625c-cd8d-4daa-973e-d0fb6bf4f13c tempest-ServerGroupTestJSON-658823565 tempest-ServerGroupTestJSON-658823565-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f" status: 204 len: 0 microversion: 2.1 time: 0.066997 Aug 29 10:59:04.648224 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2522/5032] 10.222.0.47 () {58 vars in 1266 bytes} [Mon Aug 29 10:59:04 2022] DELETE /compute/v2.1/os-server-groups/6ece520d-6398-466a-b6b5-fee7d676486f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:59:04.787466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:04.789728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:04.810257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.818284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.819468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:04.821478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:04.822719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:04.823373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:05.314956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:05.354744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4e64e489-271c-41a3-a748-04d21ce1ed63 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1605 microversion: 2.1 time: 0.579487 Aug 29 10:59:05.355889 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2523/5033] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:04 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1605 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:05.386129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:05.389880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:05.418486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:05.419327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:05.420103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:05.431491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:05.434543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:05.435826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:05.548561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:05.563819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:05.565273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:05.566519 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a62216bc-9196-4e69-90d5-d0a3f8b138ea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1744 microversion: 2.20 time: 1.142052 Aug 29 10:59:05.569933 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2511/5034] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:04 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1744 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:06.328630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:06.338990 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-201c3949-f496-4334-962b-2242c0557242 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.977337 Aug 29 10:59:06.374849 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2524/5035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:05 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:06.395638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:06.397507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:06.416156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:06.416972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:06.418377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:06.419393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:06.420119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:06.420856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:06.593579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:06.594936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:06.602609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:06.610209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:06.611459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:06.613580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:06.614610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:06.617154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:06.617484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89ee3eeb-390f-4973-b550-5efc6b4a314b tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1605 microversion: 2.1 time: 0.227560 Aug 29 10:59:06.618172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:06.632985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2512/5036] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:06 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:06.908214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef687dd3-0846-451a-a3d0-3c3469335a17", "name": "network-vif-deleted", "tag": "52a6b37f-9cce-41de-bbda-974863d4683e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:06.930341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:06.936979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:06.938538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:06.971667 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] Creating event network-vif-deleted:52a6b37f-9cce-41de-bbda-974863d4683e for instance ef687dd3-0846-451a-a3d0-3c3469335a17 on n-h1-854121-10 Aug 29 10:59:07.003905 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4f0cba07-afd7-48e2-a55e-533b6b432f14 req-e978a60b-36ae-449d-bf4a-5a7be18eebb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110174 Aug 29 10:59:07.008506 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2513/5037] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:07.166352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:07.186011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:07.188550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:07.194098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0bff8f5-63bd-4982-b1b5-2e8f6bc8b85b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.605257 Aug 29 10:59:07.211751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2525/5038] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:06 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:59:07.385644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:07.386719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:07.410830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:07.411374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:07.411829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:07.412577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:07.413034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:07.413467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:07.478685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:07.645570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:07.647351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:07.666446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:07.666971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:07.670777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:07.671458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:07.674273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:07.674829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:07.811694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:07.818804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:07.819782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:07.824251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lazy-loading 'fault' on Instance uuid ef687dd3-0846-451a-a3d0-3c3469335a17 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:59:08.036994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2437d037d844ce2aa3bbceaf369f908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd4e0de46fe4695a27284a6c417ad45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:08.054938 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79396d8d-92f2-4d50-b72b-8473aae77412 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 200 len: 1327 microversion: 2.1 time: 0.411909 Aug 29 10:59:08.061298 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2526/5039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:07 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 1327 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:08.247511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:08.252629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:08.268580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:08.269465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:08.270182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:08.271255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:08.271990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:08.273624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:08.390602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:08.405103 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-25a115d6-8f32-4216-a070-4d459901dead tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 1.024291 Aug 29 10:59:08.410866 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2514/5040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:07 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:09.090304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:09.092749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:09.145085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:09.145615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:09.156430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:09.159591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:09.161115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:09.161766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:09.233251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 HTTP/1.1 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ef687dd3-0846-451a-a3d0-3c3469335a17'} Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:09.260122 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:09.267051 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:09.282640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:09.289773 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b082c25-d993-46b9-9d33-aa5766d0c69e tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 404 len: 111 microversion: 2.1 time: 0.200322 Aug 29 10:59:09.295040 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2515/5041] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:09 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:09.318995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e0421fc-62a1-4898-b7c8-80ebc54b625d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '.version_select at 0x7f66c6e60ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:09.375464 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e0421fc-62a1-4898-b7c8-80ebc54b625d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871729211" status: 202 len: 0 microversion: 2.1 time: 0.074149 Aug 29 10:59:09.384357 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2516/5042] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 29 10:59:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871729211 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:59:09.411983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:09.436515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:09.442851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:09.444821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:09.447046 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fe9443b9-07aa-4ba1-9c40-744a95b20b1c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.215549 Aug 29 10:59:09.448987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:09.467980 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2527/5043] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:08 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:09.489057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:09.490050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:09.490905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:09.499213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:09.500815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:09.502682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:10.130960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:10.146048 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-358f9481-9bd9-4d7a-accc-a36f87d24c10 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.712842 Aug 29 10:59:10.150520 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2517/5044] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:09 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:10.477036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:10.477667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:10.498617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:10.502437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:10.504111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:10.508692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:10.509633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:10.511629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:11.157381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:11.170203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:11.176607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:11.179648 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf9e3be1-a08f-4745-a0be-5312905cffd9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.707737 Aug 29 10:59:11.194039 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2528/5045] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:10 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:11.202850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:11.204734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:11.239808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:11.242529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:11.243276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:11.244285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:11.245367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:11.246930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:12.006171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:12.050402 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-604e8a08-95d2-478f-b786-92da1ca8a460 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1513 microversion: 2.1 time: 0.874209 Aug 29 10:59:12.064374 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2518/5046] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:11 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1513 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:12.206103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:12.206734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:12.221043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:12.221543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:12.233682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:12.233682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:12.234220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:12.235340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:12.620515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:12.639531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:12.654224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:12.655528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-88ef7ce1-95e1-4c0f-851f-2f07c828b217 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.454741 Aug 29 10:59:12.682151 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2529/5047] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:12 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:12.808210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "name": "network-vif-plugged", "status": "completed", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:12.841613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:12.847984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:12.848717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:12.876480 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] Creating event network-vif-plugged:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 10:59:12.894100 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e31fa41b-1e15-41ce-a930-25f86bad6a4a req-31d05fec-790f-4368-9126-47ed218f37cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090081 Aug 29 10:59:12.909896 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2519/5048] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:13.073491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:13.074383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:13.099834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.100252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.100711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.101461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.101962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.102635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.512613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:13.525059 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-209f9c9b-ca06-4cc8-8712-16acf1eea89d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1490 microversion: 2.1 time: 0.455249 Aug 29 10:59:13.527150 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2530/5049] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:13 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1490 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:13.557027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:13.559745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:13.592399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.592973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.593430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.594969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.595591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.596037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.701280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:13.704315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:13.722789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.723306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.723755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.724488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.724956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.725463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.751272 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0891b258-f37d-4e04-9523-078fb7a352e7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 200 len: 111 microversion: 2.1 time: 0.197770 Aug 29 10:59:13.752920 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2520/5050] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:13 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 111 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:13.771772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:13.793693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:13.827452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.838636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.842087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:13.850842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:13.851722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:13.855705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:14.592547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:14.611584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:14.614008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:14.615776 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d915075-7403-4870-af41-171541f0ff6f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.921442 Aug 29 10:59:14.616351 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2531/5051] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:13 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:59:14.694701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:14.708868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df2fbe1c-1b96-4174-8ffd-89bcabe801d5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.949883 Aug 29 10:59:14.709875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2521/5052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:13 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:14.739103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:14.740135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:14.751172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:14.752664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:14.754946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:14.756202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:14.757047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:14.759755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.210994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:15.221831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-753e8b7a-42c6-44d3-8ed8-f4851b1c8611 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.487254 Aug 29 10:59:15.222450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2532/5053] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:14 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:15.245367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:15.246653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:15.255303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.260186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.260908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.261921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.267202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.267949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.565975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:15.590295 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f38eb33-4c09-42c4-96ff-231675b0d69a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.332712 Aug 29 10:59:15.602371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2522/5054] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:15 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:15.615372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:15.616067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:15.625371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.626274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.626919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.627843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.628481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.629082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.644662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:15.645734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:15.653014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.653839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.654631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:15.655565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:15.657053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:15.658029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:16.077401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:16.104082 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2721765d-1012-49a1-b0fb-c1fadac31382 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.492829 Aug 29 10:59:16.115169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2533/5055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:15 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:16.138144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:16.149045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:16.152574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:16.154640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-368e5593-80e4-437f-9da6-9111a29be529 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.518094 Aug 29 10:59:16.155676 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2523/5056] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:15 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:16.401160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-458596013", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "603a8da8-8c3d-423e-879b-e3e712d1b689"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:16.599256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] validate_networks() for [('603a8da8-8c3d-423e-879b-e3e712d1b689', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 10:59:17.183126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:17.184834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:17.209765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:17.215815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:17.216968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:17.224669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:17.229127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:17.232745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:18.436738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:18.558498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:18.563405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:18.587127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89ab8b34-899c-4b0a-bf80-8d8f01cd7288 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.408597 Aug 29 10:59:18.602941 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2524/5057] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:17 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:19.541215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 10:59:19.542751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 10:59:19.544129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 10:59:19.545053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 10:59:19.546125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 10:59:19.588537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:19.589647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:19.601354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:19.602640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:19.603355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:19.604044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:19.619746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:19.621756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:19.665694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:19.667684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:19.670544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:19.673609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:19.680578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:19.681255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:19.720119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 10:59:19.742058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 10:59:19.789223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 10:59:19.792246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 10:59:20.001646 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-113fa974-6ecc-4e46-b270-0b575c59a626 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.595183 Aug 29 10:59:20.007812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2534/5058] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 10:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 10:59:20.039609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46e2783f-b78c-4c0d-8eae-b77919ec32db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:20.048647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46e2783f-b78c-4c0d-8eae-b77919ec32db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:20.195179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:20.231127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:20.248625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:20.262896 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e0dad6c-f346-4e29-9bda-8c092c7fa834 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.650513 Aug 29 10:59:20.268354 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2525/5059] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:19 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:20.349996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46e2783f-b78c-4c0d-8eae-b77919ec32db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:20.368698 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46e2783f-b78c-4c0d-8eae-b77919ec32db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1214 microversion: 2.1 time: 0.345207 Aug 29 10:59:20.382016 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2535/5060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:20 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1214 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:21.303228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:21.304073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:21.351277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:21.351780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:21.352235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:21.352965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:21.353428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:21.366625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:21.412081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:21.412927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:21.456182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:21.462963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:21.465121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:21.467949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:21.477193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:21.486012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:21.920272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:21.936459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27643c7c-bde2-49b0-abb1-bbb3c2b4801f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1218 microversion: 2.1 time: 0.533181 Aug 29 10:59:21.937608 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2536/5061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:21 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1218 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:22.018877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:22.031012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:22.037392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:22.038883 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7206f28-6969-47f4-aa5c-1a9fee02f534 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.753581 Aug 29 10:59:22.039496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2526/5062] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:21 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:22.966429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:22.967073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:23.007243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:23.011539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:23.012182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:23.018990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:23.019764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:23.021059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:23.095359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:23.096680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:23.126074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:23.132414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:23.133142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:23.134889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:23.142583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:23.145302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:23.313989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:23.337300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d301ccd0-2500-456d-aaa8-b63f03a54bd4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1274 microversion: 2.1 time: 0.376461 Aug 29 10:59:23.342067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2537/5063] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:22 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:23.660633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:23.685010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:23.689171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:23.700766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-129fabb2-2489-4c3c-a582-cfafe181d638 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.605948 Aug 29 10:59:23.701437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2527/5064] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:23 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:24.372761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:24.373455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:24.391312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:24.393276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:24.394074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:24.395930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:24.397473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:24.400008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:24.411710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:24.648555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:24.658700 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a569858-3755-46ef-9e20-08e699b40a59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1272 microversion: 2.1 time: 0.298394 Aug 29 10:59:24.672480 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2538/5065] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:24 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:24.727371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:24.728544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:24.740242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:24.740741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:24.741189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:24.741938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:24.742404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:24.742842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:25.689862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:25.691076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:25.718360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:25.720234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:25.720897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:25.721899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:25.724935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:25.725773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:26.132824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:26.157157 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fe16e5fe-fc97-41b9-a080-28c8091fa442 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1272 microversion: 2.1 time: 0.471845 Aug 29 10:59:26.159545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:26.162050 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2539/5066] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:25 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:26.206459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:26.220716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:26.229352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-777b8331-5cc0-4928-bb7e-769b45115efe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.499707 Aug 29 10:59:26.236131 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2528/5067] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:24 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:27.197552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:27.198902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:27.214311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:27.235142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:27.248497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:27.251383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:27.256857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:27.259628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:27.261275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:27.262169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:27.300696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:27.301455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:27.302151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:27.303684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:27.304685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:27.305318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:27.852217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:27.910976 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0edd712f-9975-41b4-a1e9-905678892dbf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1272 microversion: 2.1 time: 0.718182 Aug 29 10:59:27.919091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2540/5068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:27 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1272 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:28.953385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:28.954391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:28.967607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:28.968107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:28.968579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:28.969297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:28.989888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:28.990530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:29.009866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:29.035605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:29.043400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:29.044751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e39dfaab-8567-40ce-b927-13b36531a3f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.787440 Aug 29 10:59:29.062624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2529/5069] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:27 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:29.676106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:29.735045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:29.744017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-09a51719-e8ce-471b-863f-8d1fff5f7780 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 0.795264 Aug 29 10:59:29.757415 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2541/5070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:28 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:30.090837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:30.091850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:30.106738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:30.107632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:30.110009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:30.111230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:30.114325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:30.115139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:30.775574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:30.776795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:30.797267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:30.806098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:30.809021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:30.810305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:30.819170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:30.823046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:30.826195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:31.428013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:31.453344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:31.468924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:31.485238 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d81b4fb3-67c6-48f4-9701-ab28b098e6bb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.398839 Aug 29 10:59:31.485880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2530/5071] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:30 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:31.716273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:31.728085 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7f15af3-b3a2-4f90-807d-f3ec2ac502f9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 0.956378 Aug 29 10:59:31.744931 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2542/5072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:30 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:32.525919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:32.530012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:32.557312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:32.567937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:32.569878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:32.574833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:32.578017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:32.584152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:32.584605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:32.766462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:32.767382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:32.792164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:32.798167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:32.799393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:32.801746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:32.808890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:32.813202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:33.795844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:33.810946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c47c363a-ea66-4806-b3c1-abf765e5fb31 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 1.049317 Aug 29 10:59:33.813844 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2543/5073] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:32 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:33.827304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:33.842506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:33.862187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:33.863054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:33.867395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:33.868542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:33.869183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:33.869834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:33.943855 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 HTTP/1.1 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ef687dd3-0846-451a-a3d0-3c3469335a17'} Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:33.945831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:33.951153 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:33.962653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:33.963852 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f5e27ac-cd01-4fdc-aa72-2c9c238dc94d tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 404 len: 111 microversion: 2.1 time: 0.148850 Aug 29 10:59:33.964802 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2544/5074] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:59:33 2022] DELETE /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:33.977529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e408b892-3e22-4781-9cd7-c7f2e78a9980", "tag": "743bf234-fdc1-48cc-b14e-2b8223019469"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:34.029525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:34.030229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:34.034083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:34.095995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] Creating event network-changed:743bf234-fdc1-48cc-b14e-2b8223019469 for instance e408b892-3e22-4781-9cd7-c7f2e78a9980 on n-h1-854121-10 Aug 29 10:59:34.123704 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5eb48e8d-3733-4152-bf67-eb960be879ef req-3c89d5af-52d3-47d8-8e1e-44c885a49af5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142555 Aug 29 10:59:34.133993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2545/5075] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:34.150620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:34.164887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: ef687dd3-0846-451a-a3d0-3c3469335a17] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:34.209826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:34.212970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:34.216383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:34.219490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:34.224371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:34.227681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:34.314195 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 HTTP/1.1 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'ef687dd3-0846-451a-a3d0-3c3469335a17'} Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:34.325525 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. Aug 29 10:59:34.336862 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:34.357206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance ef687dd3-0846-451a-a3d0-3c3469335a17 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:34.366193 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1c6f529e-87dd-46ea-89a7-cc811bdcd790 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17" status: 404 len: 111 microversion: 2.1 time: 0.229926 Aug 29 10:59:34.373417 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2546/5076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:34 2022] GET /compute/v2.1/servers/ef687dd3-0846-451a-a3d0-3c3469335a17 => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:34.592390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:34.604622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:34.606117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:34.607560 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-404f945b-e3dc-4eb2-be24-72493f09d0b6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 2.099940 Aug 29 10:59:34.640352 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2531/5077] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:32 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:34.838344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:34.840067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:34.844255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:34.884379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:34.893858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:34.900161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:34.901691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:34.907133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:34.910053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:35.363552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:35.382011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae579b03-c6fa-492d-84cd-eb64322e1115 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 0.549050 Aug 29 10:59:35.406335 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2547/5078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:34 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:35.636828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:35.637380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:35.656325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:35.669670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:35.673405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:35.677258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:35.680526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:35.681181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:36.425602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:36.426495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:36.461935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:36.471306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:36.477549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:36.478449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:36.481234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:36.490367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:36.491483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:36.493679 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70e5d9a7-e2fe-4101-9df8-bdad868bea30 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.860848 Aug 29 10:59:36.494224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:36.496254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:36.502903 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2532/5079] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:35 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:37.531596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:37.533171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:37.549869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:37.554685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:37.558453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:37.562788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:37.566377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:37.574401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:37.654560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:37.708951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:37.727029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f81d106c-0eee-474f-82f5-ac4db39c5b68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 1.303646 Aug 29 10:59:37.731100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2548/5080] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:36 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:38.009282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:38.023918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:38.025533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:38.036258 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c9f66c1-7918-4350-b626-b2e5156a94fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 0.509879 Aug 29 10:59:38.037894 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2533/5081] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:37 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:38.747919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:38.748533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:38.803477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:38.804159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:38.804617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:38.805374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:38.805868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:38.806301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:39.062507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:39.063145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:39.076262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:39.090624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:39.093437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:39.094688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:39.102494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:39.104939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:40.472563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:40.481212 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-85cf16ce-db58-4661-ac86-50ef35f2d4aa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 1.737067 Aug 29 10:59:40.486624 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2549/5082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:38 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:40.628443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:40.665934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:40.667734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:40.679357 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff1ba402-367f-47be-9c82-7b0bfde24820 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.621419 Aug 29 10:59:40.686328 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2534/5083] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:39 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:41.505114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:41.505944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:41.548497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:41.550468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:41.551563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:41.557733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:41.561787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:41.563935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:41.708539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:41.709772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:41.723316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:41.724079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:41.724721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:41.725850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:41.726486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:41.727908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:42.502468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:42.512376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ea5de2b-8108-48a8-a424-9e7e38cb7209 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 1.011127 Aug 29 10:59:42.512967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2550/5084] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:41 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:42.563956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e408b892-3e22-4781-9cd7-c7f2e78a9980", "name": "network-vif-plugged", "status": "completed", "tag": "743bf234-fdc1-48cc-b14e-2b8223019469"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:42.608716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:42.622857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:42.625311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:42.690862 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] Creating event network-vif-plugged:743bf234-fdc1-48cc-b14e-2b8223019469 for instance e408b892-3e22-4781-9cd7-c7f2e78a9980 on n-h1-854121-10 Aug 29 10:59:42.709565 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-25b57ca6-ac48-4c40-9f0b-62dc153e0ab0 req-95bcd972-a3e4-41fa-bc6f-4988b1e608f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155751 Aug 29 10:59:42.717411 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2551/5085] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 10:59:43.028792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:43.065950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:43.072161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:43.076326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a30e0bc5-e0e2-404a-bd44-34db9c804d72 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.371959 Aug 29 10:59:43.084532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2535/5086] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:41 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:43.962599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:43.963116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:43.982249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:43.986366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:43.988878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:43.990445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:43.993808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:44.010960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:44.095294 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 HTTP/1.1 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b980d711-fd13-4285-8ee6-23599482ab10'} Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:44.097070 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 10:59:44.101909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:44.117718 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a43f22a4-258d-4c16-aefc-4ff9688d51f3 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 404 len: 111 microversion: 2.1 time: 0.158831 Aug 29 10:59:44.121068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2536/5087] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 10:59:43 2022] DELETE /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:44.129260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:44.129931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:44.168559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:44.176128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:44.176675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:44.177461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:44.184734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:44.185267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:44.279784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:44.281149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:44.305119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:44.305626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:44.306106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:44.306834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:44.307302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:44.307742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:45.475771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:45.481232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:45.493509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:45.503467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:45.505476 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb8c1e6b-3c3d-4d53-ae14-fd24d69ddff6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.383331 Aug 29 10:59:45.505891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ae5c731-26a2-4fe0-ba0d-fd028c419212 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1314 microversion: 2.1 time: 1.976947 Aug 29 10:59:45.507637 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2552/5088] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:43 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1314 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:45.527416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:45.528483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] [instance: b980d711-fd13-4285-8ee6-23599482ab10] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:45.533728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2537/5089] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:44 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:45.552110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:45.552841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:45.556837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:45.559465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:45.560248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:45.562414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:45.615209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] HTTP exception thrown: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Request method failure captured: Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 HTTP/1.1 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJp8ILjBaFdxxsIHdQXk0JDWLillG8TIHaMy0JImCO-4sbNrqgw8rpcd8e2wYCwksf_R0ZcXvPXNM2iPSiK6yLmVLet12OJJ7hFQOWDh1oZg-XyU-yIYW0K4hOxd0-mQPH2udaE40FgOqgdHMB6yysanyfQnQn3Ypl_l-6ZobaR4vqA Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7cd4e0de46fe4695a27284a6c417ad45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 7cd4e0de46fe4695a27284a6c417ad45 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146563285 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: d2437d037d844ce2aa3bbceaf369f908 Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeTestJSON-1146563285-project Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'b980d711-fd13-4285-8ee6-23599482ab10'} Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 10:59:45.622452 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. Aug 29 10:59:45.631322 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 10:59:45.636057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] Returning 404 to user: Instance b980d711-fd13-4285-8ee6-23599482ab10 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 10:59:45.659695 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3fbb03a8-e396-4db8-9dad-0e4349e97343 tempest-AttachVolumeTestJSON-1146563285 tempest-AttachVolumeTestJSON-1146563285-project] 10.222.0.47 "GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10" status: 404 len: 111 microversion: 2.1 time: 0.136991 Aug 29 10:59:45.662256 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2553/5090] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:45 2022] GET /compute/v2.1/servers/b980d711-fd13-4285-8ee6-23599482ab10 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 10:59:46.531563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:46.533062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:46.549627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:46.551001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:46.553470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:46.557536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:46.560858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:46.562049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:46.562934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:46.563821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:46.564315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:46.564760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:46.570711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:46.572025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:46.574358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:46.575089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:47.938264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:47.950634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a547e62e-7c87-4690-9906-4e317fe8128c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1502 microversion: 2.1 time: 1.423023 Aug 29 10:59:47.953413 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2538/5091] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:46 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1502 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:47.969263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:47.996613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:48.007774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:48.009318 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1cd8e96a-14b6-485b-bcf1-7a20e208df13 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1739 microversion: 2.20 time: 1.463659 Aug 29 10:59:48.009846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:48.012384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:48.024603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:48.025108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:48.025554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:48.026249 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2554/5092] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:46 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1739 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:48.033555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:48.042150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:48.042691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:48.096578 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c12a8d29-daa4-4508-a719-9088e5e8bba9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.098316 Aug 29 10:59:48.097778 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2539/5093] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:47 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:48.777485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:48.778751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:48.791255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:48.791717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:48.792170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:48.792909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:48.793412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:48.793887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:48.945642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lazy-loading 'services' on Instance uuid abb7138a-77f2-476f-bad6-ab4fbe19c8e9 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 10:59:49.034968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:49.035680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:49.050770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:49.051258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:49.051696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:49.052453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:49.067189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:49.067694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:49.122491 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-99dc60d5-c855-469d-964b-3f1b50ecb5a1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9/os-volume_attachments/2d081dbd-403b-4f24-b586-2e9f4d51d53c" status: 202 len: 0 microversion: 2.1 time: 0.356367 Aug 29 10:59:49.124362 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2555/5094] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 10:59:48 2022] DELETE /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9/os-volume_attachments/2d081dbd-403b-4f24-b586-2e9f4d51d53c => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 10:59:49.160214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:49.184260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:49.203503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:49.204011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:49.204459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:49.205198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:49.213626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:49.214518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:50.053851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:50.087159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:50.105933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:50.109934 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f9f47b5-639d-4d68-a7f2-1c8d0234085c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1721 microversion: 2.20 time: 1.080482 Aug 29 10:59:50.129961 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2540/5095] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:49 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1721 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:50.581336 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f0bd727-7af1-42ea-a9a0-3b2a8269b8f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 1.454871 Aug 29 10:59:50.583642 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2556/5096] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:49 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:51.134092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:51.134807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:51.144666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.151474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.152141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.152970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.153791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.154231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.596677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:51.599452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:51.620369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.620877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.621322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.622065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.622528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.622955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.743800 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b9c578e7-ce62-4928-8b6d-5159414e2778 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.152342 Aug 29 10:59:51.754892 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2557/5097] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:51 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 10:59:51.761397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:51.771894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:51.787156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:51.794744 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d65d9365-4540-4671-ab87-4faba6f0dd9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1724 microversion: 2.20 time: 0.659818 Aug 29 10:59:51.797902 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2541/5098] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:51 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:51.822917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86239428-3236-4e8e-85b0-9c8e3297e8c3"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:51.825799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:51.840743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.845890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.846716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.848340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:51.855426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:51.856136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:51.916192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 10:59:52.631938 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21403a40-eb50-42de-b252-0b91cbdeee23 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.812765 Aug 29 10:59:52.634129 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2558/5099] 10.222.0.47 () {62 vars in 1364 bytes} [Mon Aug 29 10:59:51 2022] POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 188 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 10:59:52.767437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:52.770979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:52.789629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:52.790600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:52.791328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:52.793722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:52.796167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:52.796917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:52.909433 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-506ada2a-7d97-4167-9e21-6e78061e44f7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.143275 Aug 29 10:59:52.911809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2542/5100] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:52 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:52.972165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:52.978780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:53.000911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:53.001417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:53.002554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:53.003291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:53.004887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:53.005346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:53.169126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128681) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 10:59:53.321759 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3020bf7e-a291-492a-90bd-d0bbdecc90c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/action" status: 202 len: 0 microversion: 2.20 time: 0.352523 Aug 29 10:59:53.325652 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2559/5101] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 10:59:52 2022] POST /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 10:59:53.336413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:53.337306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:53.360938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:53.362770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:53.366010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:53.368878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:53.370008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:53.371850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:53.907851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "name": "network-vif-unplugged", "status": "completed", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:53.957506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:53.959890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:53.961415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:54.001911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.server_external_events [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] Unable to find a host for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43. Dropping event network-vif-unplugged {{(pid=128681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 10:59:54.006661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-88b8b112-31b4-48cb-9d69-f40a7bd50130 req-638e4065-aae9-40e8-b28e-5263b849cbca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.105423 Aug 29 10:59:54.007686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2560/5102] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 10:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 10:59:54.016070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:54.026276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:54.038944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:54.040338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:54.041497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:54.043790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:54.044563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:54.046919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:54.106115 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16b3c411-2bfb-4b6e-8855-6b1034c90dd3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.096283 Aug 29 10:59:54.107440 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2561/5103] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:54 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:54.240288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:54.254615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:54.257337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:54.263534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99dcc16c-14ea-4c96-b32c-7284c8836b83 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1750 microversion: 2.20 time: 0.932358 Aug 29 10:59:54.283882 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2543/5104] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:53 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1750 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:55.120667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:55.123870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:55.156805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:55.157493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:55.158958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:55.159733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:55.160202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:55.160657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:55.291386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-654b6227-1f50-4169-b0f8-00108c82fb8d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.176395 Aug 29 10:59:55.292336 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2562/5105] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:55 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:55.294532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:55.295260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:55.310686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:55.311665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:55.312459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:55.314372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:55.319773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:55.320524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:55.995966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:56.024828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:56.031099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:56.031993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81fdc345-de1a-4459-bc3f-ba49120e902d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1750 microversion: 2.20 time: 0.742250 Aug 29 10:59:56.050750 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2544/5106] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:55 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1750 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 10:59:56.318129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:56.320577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:56.350789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:56.351294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:56.351744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:56.352482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:56.352949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:56.353384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:56.447410 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d13d73a-8728-472a-9567-0b933fda5e1f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 14 microversion: 2.1 time: 0.147677 Aug 29 10:59:56.448445 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2563/5107] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:56 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 10:59:57.073067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:57.074377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:57.101499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.104050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.105517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.108736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.109482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.110753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.460091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 10:59:57.463167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:57.478731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.490519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.491270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.492216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.492852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.493456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.619371 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8da29891-add4-41ef-b65d-e7085153954e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action" status: 200 len: 8208 microversion: 2.1 time: 0.163361 Aug 29 10:59:57.620597 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2564/5108] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 10:59:57 2022] POST /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980/action => generated 8208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 10:59:57.641336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:57.650877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:57.673936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.674439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.677938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.678775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:57.679262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:57.679724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:57.888688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:57.908940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:57.912313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:57.923653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a2593fb-fad1-482a-8cf0-cba6ebf47fad tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.852043 Aug 29 10:59:57.925745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2545/5109] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:57 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:58.691752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:58.737498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-990ea7e3-29f6-4a94-8b32-df87fb0d4047 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.095844 Aug 29 10:59:58.738278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2565/5110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:57 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:58.771319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:58.772679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:58.787904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:58.789576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:58.790627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:58.793267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:58.796490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:58.797224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:58.966678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:58.966899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:58.981364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:58.981935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:58.982388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:59.003833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:59.004349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:59.007971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:59.769201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:59.778193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:59.802670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:59.804297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ced545d-4136-4b2e-ab41-709afcc6d377 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.033278 Aug 29 10:59:59.804931 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2546/5111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:58 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 10:59:59.805400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 10:59:59.806907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8b2382cc-3b48-46bf-b744-cf1de31d440d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.860846 Aug 29 10:59:59.807477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2566/5112] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 10:59:58 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 10:59:59.842001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 10:59:59.842975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 10:59:59.852180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:59.855547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:59.858845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 10:59:59.859871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 10:59:59.863094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 10:59:59.863770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.457034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:00.470001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b96cb1ac-1187-4060-a3d2-22af308df737 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.632282 Aug 29 11:00:00.472243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:00.472764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:00.474038 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2547/5113] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 10:59:59 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:00.490809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.491316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.496500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.497277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.500612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:00.501548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:00.503765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.516142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.525978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.526491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.526941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.527668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.528143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.528559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.602805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:00:00.886123 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-357818c9-903d-450c-a39d-a496d1925c67 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 204 len: 0 microversion: 2.1 time: 0.417205 Aug 29 11:00:00.887559 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2567/5114] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:00:00 2022] DELETE /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:00:00.902673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:00.903742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:00.930910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.931710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.932329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:00.935644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:00.937162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:00.938058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.445419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:01.463880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df009f6e-a9bf-44c0-8563-bcbf4d1b5cc1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.968993 Aug 29 11:00:01.464495 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2548/5115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:00 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:01.485445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:01.488342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:01.504836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.505652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.507506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.509605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.511784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.512430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.614274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:01.633939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:01.635410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:01.636663 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ede1ee25-af72-4798-bad1-4c3272cae598 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.747571 Aug 29 11:00:01.650632 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2568/5116] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:00 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:01.673905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:01.674510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:01.702767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.708369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.708847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.709601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.717445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.724066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.864618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Locking {{(pid=128681) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 29 11:00:01.911433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=7,nova_cell1:UPDATE=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:01.947457 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f00f936-b4a8-4051-bfe8-3e0ebc37ce14 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.298771 Aug 29 11:00:01.953058 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2569/5117] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:01 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:01.960732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:01.961673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:01.971727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.972838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.973524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:01.974880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:01.975558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:01.976490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:02.582725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:02.600192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f845418-795f-4a23-b18f-f0de7ae4f9df tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1512 microversion: 2.1 time: 1.129327 Aug 29 11:00:02.609043 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2549/5118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:01 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1512 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:02.663022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:02.663692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:02.674136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:02.674646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:02.677291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:02.679706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:02.680208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:02.680656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:03.485454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:03.505157 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0f02263-df14-4344-a613-16df6abc6aef tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.547462 Aug 29 11:00:03.505829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2570/5119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:01 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:03.526905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:03.547494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:03.548011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:03.548461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:03.645318 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action HTTP/1.1 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 15 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: {"os-stop": {}} Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '63a6ae2b-2bf1-4cf2-9517-b8236cfefdac', 'body': {'os-stop': {}}} Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked Aug 29 11:00:03.647294 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:03.653502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 409 to user: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac is locked {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:00:03.654232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9be53a3c-43bd-4f43-882b-659589d08a27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 409 len: 107 microversion: 2.1 time: 0.132617 Aug 29 11:00:03.662200 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2571/5120] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:03 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 107 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 11:00:03.676085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:03.676922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:03.694339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:03.694927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:03.696786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:03.697681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:03.698433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:03.698977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.057441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:04.076232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:04.085268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:04.092814 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f24a43ba-07ce-4f43-b319-ac7f03f7921d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 1.430923 Aug 29 11:00:04.110310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2550/5121] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:02 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:00:04.118838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:04.119680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:04.126485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=40 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:04.128181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:04.128892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:04.129521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.130520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:04.131143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:04.131738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.137074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:04.227764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Unlocking {{(pid=128682) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 11:00:04.354647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53482606-2827-4e84-aad8-5ca8f1fbed05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.242649 Aug 29 11:00:04.355557 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2551/5122] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:04 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:04.374025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:04.393257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:04.399727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:04.403603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.469121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Going to try to stop instance {{(pid=128682) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 11:00:04.593448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-672765e9-c8fc-464b-bc5a-f5580fb0ba67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.229759 Aug 29 11:00:04.594760 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2552/5123] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:04 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:04.606351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:04.607075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:04.619735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:04.620677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:04.621335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.622453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:04.623084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:04.624908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:04.728196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:04.744014 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be9905dd-8cf4-4d8f-bf0e-3486a82decbb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1512 microversion: 2.1 time: 1.080426 Aug 29 11:00:04.753227 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2572/5124] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:03 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1512 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:05.123881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:05.124848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:05.128167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:05.138808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.141094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:05.144394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:05.150014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.151189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:05.154156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:05.695950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:05.719496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f21f5cf3-e585-4424-8752-0dcbebe048af tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 1.120028 Aug 29 11:00:05.721540 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2553/5125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:04 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:05.742216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb7138a-77f2-476f-bad6-ab4fbe19c8e9", "name": "network-vif-deleted", "tag": "f0a011e5-1d7d-4118-89f6-38273872fdee"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:05.787279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.789359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:05.790210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:05.823561 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] Creating event network-vif-deleted:f0a011e5-1d7d-4118-89f6-38273872fdee for instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 on n-h1-854121-10 Aug 29 11:00:05.873731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-88142a1b-7c6f-45b4-b854-26a73d2b71a3 req-83ea1636-0034-4138-b5e7-35f6d47a8653 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144243 Aug 29 11:00:05.881789 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2554/5126] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:05.897284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:05.898307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:05.908722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.909364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:05.910725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:05.911872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.912514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:05.913221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:05.996246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:05.996795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:06.000354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:06.000476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lazy-loading 'fault' on Instance uuid abb7138a-77f2-476f-bad6-ab4fbe19c8e9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:00:06.096475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:06.112318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:06.124316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:06.126096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66a5fcdd-64d1-49c4-bc84-d04acd3be907 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 1.006693 Aug 29 11:00:06.138789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2573/5127] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:05 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:00:06.255829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:06.275334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e0f7dc5-a605-4713-8662-d8fc931144c5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 200 len: 1308 microversion: 2.1 time: 0.389829 Aug 29 11:00:06.278341 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2555/5128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:05 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:06.758190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:06.762229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:06.792736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:06.797063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:06.798487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:06.799434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:06.802184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:06.802872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:07.164745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:07.165432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:07.174519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:07.175015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:07.175460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:07.176195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:07.176633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:07.181910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:07.194001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:07.196253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d12665e9-bdb6-4f5e-a7a6-0f76ef36e4cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.455798 Aug 29 11:00:07.206230 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2574/5129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:06 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:07.300720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:07.301521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: abb7138a-77f2-476f-bad6-ab4fbe19c8e9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:07.328380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:07.330838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:07.332102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:07.332861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:07.334898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:07.335629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:07.374027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] HTTP exception thrown: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Request method failure captured: Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 HTTP/1.1 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJsuRx3cABU3sRA9Mm8nVW1KsMRaXnQKX85EfAgyQ_EC0Bcf9CNU-dX6iYrqgB_yuPVpD4MnLrWKbMmU9wmnRxzkQh7eb_7ExQSfvinkXVBXLDKmNDolneL6-zN1zoBU-4cd7KqAsmpROUA4hz6ucWdHJCjt4aEkg9KnW4iIzBNQoeI Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ac15cf0999714c30b3994ffbb4c6cb8c Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ac15cf0999714c30b3994ffbb4c6cb8c Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesSnapshotTestJSON-1118135908-project Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 69f93235c2504b0c9e2ab30692590ddc Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesSnapshotTestJSON-1118135908-project Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'abb7138a-77f2-476f-bad6-ab4fbe19c8e9'} Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:07.376681 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Returning 404 to user: Instance abb7138a-77f2-476f-bad6-ab4fbe19c8e9 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:00:07.382061 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-296a9d9e-31f8-4f3d-ac05-05592cd2647c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9" status: 404 len: 111 microversion: 2.1 time: 0.082553 Aug 29 11:00:07.387922 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2575/5130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:07 2022] GET /compute/v2.1/servers/abb7138a-77f2-476f-bad6-ab4fbe19c8e9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:00:07.906116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:07.928939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:07.947521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:07.955591 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-285e86e1-0bbb-4fcc-83a6-9a41e86cb1cd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.788667 Aug 29 11:00:07.956257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2556/5131] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:07 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:08.242440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:08.243788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:08.259252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:08.260052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:08.265610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:08.267981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:08.273558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:08.275136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:08.661760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:08.672181 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d1e7a625-12e7-4947-ab61-3891fd124f38 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.447455 Aug 29 11:00:08.679589 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2576/5132] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:08 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:08.986464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:08.987149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:09.011678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:09.019715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:09.020191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:09.020955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:09.025685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:09.026366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:09.516878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:09.533120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:09.535199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:09.536593 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7ffdaa6-cd55-4054-8968-fb1ac1ead363 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.557312 Aug 29 11:00:09.537784 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2557/5133] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:08 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:09.703884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:09.704956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:09.718300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:09.718300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:09.718300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:09.718300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:09.718855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:09.721464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:10.165407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:10.175405 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c3d1f5a-0183-4ca5-9179-4747785faa68 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.476880 Aug 29 11:00:10.179285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2577/5134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:09 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:10.564330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:10.567689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:10.587551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:10.593868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:10.594524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:10.599317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:10.605875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:10.606555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:11.265113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:11.286495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:11.293006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:11.298581 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1cc5a0fe-1a35-4323-95ba-5cb53f6e39c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1752 microversion: 2.20 time: 0.739573 Aug 29 11:00:11.301950 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2558/5135] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:10 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1752 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:11.322355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:11.323901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:11.343916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:11.346397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:11.347644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:11.348650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:11.349625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:11.350350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:11.713033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-675279961", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a19bfc66-d779-43d0-8799-63a76d37a66e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:11.801864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] validate_networks() for [('a19bfc66-d779-43d0-8799-63a76d37a66e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:00:12.997150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:13.020144 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-72d09ceb-80dc-4a26-a686-f9b75c070ce5 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 1.706944 Aug 29 11:00:13.025181 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2559/5136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:11 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:13.035497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:13.039064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:13.064134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:13.064881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:13.065956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:13.066908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:13.067804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:13.068809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:13.934840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:13.957884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:13.970550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:13.971882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ded0e162-c338-4698-9363-2d2abf4ffbc4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.944383 Aug 29 11:00:13.972459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2560/5137] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:13 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:14.046555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:14.048021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:14.072666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:14.073640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:14.074403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:14.075402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:14.079184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:14.080077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:15.146084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:15.163280 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d355084-1db5-4339-abb2-fc43c3e4591a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 1.117250 Aug 29 11:00:15.168984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:00:15.170296 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2561/5138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:14 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:15.171082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:00:15.171983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:00:15.172563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:00:15.173162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:00:15.179630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:15.180253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:15.198883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:15.200361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:15.202802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:15.207043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:15.207562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:15.208000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:15.208150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:15.208732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:15.209288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:15.209638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:15.210708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:15.213915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:15.290991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Getting quotas for project b1dc4ee0d40644e8b8a84c70d9e9e610. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:00:15.315927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Getting quotas for user bc1ad5a7cd414d27958a5643c2d438a2 and project b1dc4ee0d40644e8b8a84c70d9e9e610. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:00:15.379918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:00:15.386677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:00:15.541939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc05e317-94ee-4ac0-8e41-0a70b20d5b68 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.539757 Aug 29 11:00:15.543981 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2578/5139] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:00:15.945926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:16.031163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:16.032903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:16.034320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a9af9a2c-8024-4855-9dbf-31d0f2328dec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.862705 Aug 29 11:00:16.063452 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2562/5140] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:15 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:16.085399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c33f4c1-bf68-4011-af38-a730f5b4c997 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:16.098946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c33f4c1-bf68-4011-af38-a730f5b4c997 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:16.361349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c33f4c1-bf68-4011-af38-a730f5b4c997 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:16.372541 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c33f4c1-bf68-4011-af38-a730f5b4c997 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1227 microversion: 2.1 time: 0.305055 Aug 29 11:00:16.380208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2563/5141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:16 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1227 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:16.386663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:16.391340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:16.405923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:16.406432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:16.406881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:16.424431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:16.424929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:16.425373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:16.453479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:16.455254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:16.455947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:16.456535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:16.459781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:16.460091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:16.460537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:16.539624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d89a9172-e1f6-43d3-963d-8cec01ba6198 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.991970 Aug 29 11:00:16.545189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2579/5142] 10.222.0.47 () {58 vars in 1185 bytes} [Mon Aug 29 11:00:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:16.786731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:16.803447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1554017112", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "availability_zone": "nova:n-h2-854121-10", "networks": [{"uuid": "0ce292b6-8efc-44f4-9a65-61101b220855"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:16.846852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a7fdddb-dea8-407a-97ee-ec2df211d31b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1656 microversion: 2.1 time: 0.462844 Aug 29 11:00:16.859698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2564/5143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:16 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1656 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:16.905156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:16.955441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:16.955957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:16.956409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:17.029439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] validate_networks() for [('0ce292b6-8efc-44f4-9a65-61101b220855', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:00:17.068627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:17.140688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Going to try to start instance {{(pid=128682) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 11:00:17.366799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97b2418f-5bc8-4a52-9661-05e5af03f120 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.497515 Aug 29 11:00:17.381383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2565/5144] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:16 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:17.413154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:17.413984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:17.450750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:17.454967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:17.460583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:17.462023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:17.465472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:17.467947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:18.749266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:00:18.750707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:00:18.752555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:00:18.753152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:00:18.753855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:00:18.778606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:18.785382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:18.788146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:18.791435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:18.792509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:18.795595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:18.896824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Getting quotas for project d85aa32a99fb46509add8a3243c10b02. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:00:18.923427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Getting quotas for user d8f8a4984cad4b5e925cac18808ed8ff and project d85aa32a99fb46509add8a3243c10b02. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:00:18.953360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:00:18.956354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:00:19.039142 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11cace77-0c9d-4291-8d3e-a8c8a27df523 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.240285 Aug 29 11:00:19.048861 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2580/5145] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:00:19.057566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:19.059593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:19.070902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:19.072003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:19.073938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:19.074977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:19.075703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:19.077046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:19.750941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:19.775832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:19.783330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:19.789385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebcc6164-d3d8-4aa0-9194-3022e1df9c25 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 2.405240 Aug 29 11:00:19.800175 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2566/5146] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:17 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:19.816729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:19.826416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:19.846776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:19.849732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:19.851776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:19.858221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:19.873504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:19.874662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:19.962591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:19.990458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a49128c5-66a3-4782-9274-f3d4d4848972 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1665 microversion: 2.1 time: 0.921273 Aug 29 11:00:20.001790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2581/5147] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:19 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1665 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:20.033285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91c057e6-84fd-4930-a71b-58781f701a1e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:20.034383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91c057e6-84fd-4930-a71b-58781f701a1e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:20.400449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:20.416374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b2f85ce-81f2-479b-a673-140e2486d17c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1285 microversion: 2.1 time: 0.614765 Aug 29 11:00:20.427280 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2567/5148] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:19 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1285 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:20.557835 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91c057e6-84fd-4930-a71b-58781f701a1e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1329 microversion: 2.1 time: 0.552474 Aug 29 11:00:20.560775 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2582/5149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:20 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1329 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:20.822590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:20.823434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:20.839851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:20.845004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:20.846488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:20.848811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:20.850137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:20.853775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:21.021041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:21.022780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:21.047493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:21.049141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:21.050525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:21.054339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:21.055101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:21.056436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:21.840550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:21.853918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d06ea251-7f83-4880-b449-f75e00195da1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1665 microversion: 2.1 time: 0.837150 Aug 29 11:00:21.863942 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2583/5150] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:21 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1665 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:21.880433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:21.882804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:21.902406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:21.910638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:21.914275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:21.915333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:21.917768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:21.921911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:21.976315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:21.989208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:21.992915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:22.002504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-609de31c-baa2-431a-817b-0c8ff957dc26 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 1.181515 Aug 29 11:00:22.003122 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2568/5151] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:20 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:22.007785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:22.010093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:22.032059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:22.033226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:22.034617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:22.035549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:22.036295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:22.036918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:22.367931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:22.384199 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a132b0a7-0091-4871-88e1-e9965b3d6238 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1285 microversion: 2.1 time: 0.518921 Aug 29 11:00:22.392959 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2584/5152] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:21 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1285 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:22.445065 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b71f321e-5f6b-46be-9062-ba68588afa34 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1338 microversion: 2.1 time: 0.433727 Aug 29 11:00:22.448302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2569/5153] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:22 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1338 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:22.887696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:22.889631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:22.906513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:22.907456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:22.908025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:22.909581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:22.913537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:22.914480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:23.029295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:23.030090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:23.041151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:23.041650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:23.042154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:23.042875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:23.043340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:23.043767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:25.122081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:25.134087 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3cebee1d-4df6-43b1-b9c1-af28a1682a07 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1665 microversion: 2.1 time: 2.250241 Aug 29 11:00:25.135303 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2585/5154] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:22 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1665 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:25.146670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:25.147996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:25.167173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:25.168496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:25.169872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:25.171095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:25.171759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:25.172376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:26.020048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:26.069422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:26.082753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:26.089880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e7054fb-5aec-4328-a3d7-91afb59e1f56 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 3.064379 Aug 29 11:00:26.093632 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2570/5155] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:23 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:26.110875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:26.134948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:26.155429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:26.163839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:26.166545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:26.182682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:26.184211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:26.187037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:26.370363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:27.046857 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c134e32b-fecd-499a-9879-e554f9ef742a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1424 microversion: 2.1 time: 0.950808 Aug 29 11:00:27.059580 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2571/5156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:26 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1424 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:27.080029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1195900463", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "55649a3d-61e3-4990-90a5-452030acfaae"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:27.264872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] validate_networks() for [('55649a3d-61e3-4990-90a5-452030acfaae', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:00:27.606638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:27.627573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c432fbf9-d6aa-4652-a99f-039b148ac466 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1327 microversion: 2.1 time: 2.483581 Aug 29 11:00:27.632695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2586/5157] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:25 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1327 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:27.663768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:27.669005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:27.697936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:27.712462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:27.713376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:27.719787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:27.727351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:27.734212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:28.189655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:28.212461 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e27eafcd-af31-4977-95a4-67528dc90a6d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.576018 Aug 29 11:00:28.215845 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2587/5158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:27 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:28.224355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:28.240779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:28.262533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:28.263901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:28.265715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:28.268483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:28.271021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:28.282940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:28.858521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:29.672681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:29.687933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:29.689453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:29.691026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f8b3533-6b60-463b-8581-5f4682fd9396 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 1.472062 Aug 29 11:00:29.700445 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2588/5159] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:28 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:29.713390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:29.714375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:29.729374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:29.730341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:29.731136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:29.732902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:29.737340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:29.738187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:30.040622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:00:30.040622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:00:30.041280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:00:30.041846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:00:30.042374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:00:30.071717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:30.072430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:30.072986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:30.080868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:30.081922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:30.082631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:30.128433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Getting quotas for project ac15cf0999714c30b3994ffbb4c6cb8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:00:30.143984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Getting quotas for user 69f93235c2504b0c9e2ab30692590ddc and project ac15cf0999714c30b3994ffbb4c6cb8c. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:00:30.181013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:00:30.197391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:00:30.493735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-66baeda9-d7ac-43e3-ae13-6a811f069733 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.432354 Aug 29 11:00:30.503609 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2572/5160] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:00:30.536746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:30.542412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:30.550309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=14 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:30.561638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:30.562377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:30.569531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:30.570509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:30.571565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:30.572251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.124492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:31.127072 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ac92b8e-9bb8-4e42-a643-ab04fdbdee53 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 1.424361 Aug 29 11:00:31.136138 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2589/5161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:29 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:31.147093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:31.147721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:31.171155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:31.171668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:31.172112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.172833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:31.173748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:31.174499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.598829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:31.612904 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-adb99274-0e1e-4ffa-af64-5a9920c7a3a7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.104127 Aug 29 11:00:31.613780 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2573/5162] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:30 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:31.891178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:31.907070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8669fbfd-fec6-4b12-b96e-6b1fe128993b", "tag": "c40bbef8-e5d6-45ad-8f92-b165ec74a07b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:31.910566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e9972d9-47c9-467a-b093-2778eac3d42b tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1327 microversion: 2.1 time: 0.772990 Aug 29 11:00:31.915881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2590/5163] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:31 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1327 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:31.924038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:31.924789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:31.938989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:31.939496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:31.939824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:31.939963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.940364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:31.940643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:31.940795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.942732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:31.943185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:31.971377 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] Creating event network-changed:c40bbef8-e5d6-45ad-8f92-b165ec74a07b for instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b on n-h1-854121-10 Aug 29 11:00:31.986046 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3c1cc8d3-b1c3-4062-959b-f13e0ee59a10 req-f50f47d2-e121-4e82-87b6-a883b9b4bbd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367537 Aug 29 11:00:31.987300 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2574/5164] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:32.003181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:32.004119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:32.019112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:32.019602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:32.020041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:32.020749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:32.021196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:32.026522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:32.940610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:32.959319 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7243610-3156-46c9-8d8d-8808d1cb2cd7 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1223 microversion: 2.1 time: 1.042067 Aug 29 11:00:32.962019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2591/5165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:31 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1223 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:32.985214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:32.988548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:33.014661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.016673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.017538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.019880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.048606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.049226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.156024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Unlocking {{(pid=128681) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 11:00:33.290197 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58c5fb51-3a49-4c4c-afaa-3298bad9f6b9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.326291 Aug 29 11:00:33.291429 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2592/5166] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:32 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:33.297162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:33.303409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:33.314576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.323657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.324375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.325293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.327017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.327623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.572809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:33.583022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:33.584454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:33.585641 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e247dc80-a559-46fd-aef1-3079daf387ef tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 1.597083 Aug 29 11:00:33.601064 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2575/5167] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:31 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:33.605534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:33.606060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:33.623661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.624142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.624771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.625391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.625892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.626321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.697552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f11175b8-82ea-4eeb-a6df-a92aa2b9418b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.404082 Aug 29 11:00:33.698835 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2593/5168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:33 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:33.725532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:33.726836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:33.752096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.752617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.753069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:33.753889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:33.754544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:33.754982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.151463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:34.157745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:34.159934 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e9260d0-8e00-4018-ab4b-a808a519394f tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1327 microversion: 2.1 time: 0.560738 Aug 29 11:00:34.163954 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2576/5169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:33 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1327 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:34.170785 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08a3aca5-0981-4a0e-a123-1d241cb9d248 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.469855 Aug 29 11:00:34.172010 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2594/5170] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:33 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:34.174558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:34.178660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:34.194755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:34.198818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:34.199452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:34.204509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.205004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.205566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.209778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.210423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.211900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.212026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.212139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.212542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.213268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.213752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.214194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.440533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:34.459090 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54fbea20-0b5e-4a03-a279-bb0d99c69fa5 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1279 microversion: 2.1 time: 0.293450 Aug 29 11:00:34.460236 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2577/5171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:34 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:34.614833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:34.616243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:34.632296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.636213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.636987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.645174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.647509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.648548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.787165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:34.805294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4b5fe4f-b37b-4f84-8101-fcece199bb20 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.610122 Aug 29 11:00:34.807316 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2595/5172] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:34 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:34.816192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cf50d0-1b39-48f9-9bde-fb26e12bdacf", "tag": "73b89409-9286-4464-859a-6c982e7a3ac0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:34.828126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.828764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.829465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.868207 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] Creating event network-changed:73b89409-9286-4464-859a-6c982e7a3ac0 for instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf on n-h2-854121-10 Aug 29 11:00:34.884896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-54a61eb0-9a55-40cc-a8e8-fb8c509db0c4 req-0769dc55-71a8-4ece-a239-0b83980635ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074055 Aug 29 11:00:34.885571 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2596/5173] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:34.896753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:34.903010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:34.919012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.919823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.920316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:34.921051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:34.921509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:34.921981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.289828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:35.312796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:35.315541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:35.322171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64d63d35-277a-494c-9e66-6c5712d803fe tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.716832 Aug 29 11:00:35.323846 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2578/5174] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:34 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:35.344120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:35.346060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:35.363865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.365316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.367845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.371239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.372244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.373228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.480808 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1fe8da05-7b36-4b41-82b7-666ca850fe6c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.593243 Aug 29 11:00:35.481440 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2597/5175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:34 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:35.493958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:35.498239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:35.500543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:35.515287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.516007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.516659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.518143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.518865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.519503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.854048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:35.867521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae2058d7-702f-4f58-b9dd-40bc58881ef1 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1327 microversion: 2.1 time: 0.384364 Aug 29 11:00:35.868117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2598/5176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:35 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:35.872935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:35.873558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:35.881920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.882667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.883397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.884426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.884786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.885334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.886407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:35.899527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c4e407ce-88ae-4c25-bf70-291f43ed3d77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.568586 Aug 29 11:00:35.901644 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2579/5177] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:35 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:35.923438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:35.924128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:35.940592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.941460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.942164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:35.943108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:35.944317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:35.945258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.066790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11e5bfa7-950c-416f-9c3f-2576a15fb8b7 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.147528 Aug 29 11:00:36.068605 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2580/5178] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:35 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:00:36.087954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:36.090181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:36.117450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.118623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.119359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.120719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.121411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.122036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.214279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:36.268523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:36.285488 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-81ad646d-9472-4aca-bb34-594a7e5351ae tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.415302 Aug 29 11:00:36.288404 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2599/5179] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:35 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:36.348439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:36.349219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:36.363445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.364240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.365741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.366694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.369683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.370319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.905628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:36.908677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:36.917448 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3f1bc3a-39dd-4fd7-a56c-ca1da4d48c41 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1674 microversion: 2.1 time: 0.842955 Aug 29 11:00:36.922836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2581/5180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:36 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1674 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:36.924170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:36.929093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:36.931753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5cfe984d-8e7c-4321-a7a9-97c659de9960 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.588368 Aug 29 11:00:36.933393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2600/5181] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:36 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:00:36.955214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:36.959870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:36.976703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.977423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.978084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:36.979013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:36.979601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:36.980228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.215133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8669fbfd-fec6-4b12-b96e-6b1fe128993b", "name": "network-vif-plugged", "status": "completed", "tag": "c40bbef8-e5d6-45ad-8f92-b165ec74a07b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:37.235172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.237554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.242457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.271912 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca3aea33-db76-4300-9956-c6bd11c68fa8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.336911 Aug 29 11:00:37.284981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] Creating event network-vif-plugged:c40bbef8-e5d6-45ad-8f92-b165ec74a07b for instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b on n-h1-854121-10 Aug 29 11:00:37.284981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5871ddde-f73a-47ec-9c6f-e02d4150c31c req-0556b9af-2e8a-4358-b7a2-cfbba5d21258 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355894 Aug 29 11:00:37.284981 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2582/5182] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:37.289507 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2601/5183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:36 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:37.293887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:37.294863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:37.303092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.303594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.304034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.304746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.305196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.305618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.308107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:37.308802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:37.319156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.319661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.320461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.322284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.323643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.324461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.716788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:37.730298 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9eef8fdb-04d8-4483-a167-fff315137d2c tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.426166 Aug 29 11:00:37.732344 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2602/5184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:37 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:37.764535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:37.783831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e014ef5d-b50d-43b5-99f5-01f9f3d4e82d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1327 microversion: 2.1 time: 0.499765 Aug 29 11:00:37.785485 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2583/5185] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:37 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1327 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:37.946271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:37.947801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:37.961564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.964562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.965245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:37.967842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:37.968547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:37.969215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.128055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81bc26a-4457-4577-adda-2f2b76a8a591", "tag": "9b6c6348-7203-4c39-b517-b97712333b8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:38.148363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.148938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.149481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.152972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:38.161827 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-581f81d8-68f4-4a69-9333-7657ad9a62bd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1654 microversion: 2.1 time: 0.219769 Aug 29 11:00:38.162887 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2584/5186] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:37 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:38.169062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:38.169884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:38.172613 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] Creating event network-changed:9b6c6348-7203-4c39-b517-b97712333b8c for instance e81bc26a-4457-4577-adda-2f2b76a8a591 on n-h1-854121-10 Aug 29 11:00:38.177318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.178501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.179680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.180822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.181285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.181734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.182181 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-651cb973-9b55-4a31-bf3f-c656bf4261bc req-9fb318e6-b74a-4804-b929-9778c0aa25a9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.447402 Aug 29 11:00:38.183333 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2603/5187] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:38.192835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:38.193687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:38.204861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.206389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.207016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.207939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.209017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.209739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.291519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:38.336560 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0336f076-7ea6-4fa7-b460-f4cb2f337d49 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.149302 Aug 29 11:00:38.337524 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2604/5188] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:00:38 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:00:38.350589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:38.351758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:38.368158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.369459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.370243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.371173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.375432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.375968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.483759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:38.496788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:38.500393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:38.503042 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f059880f-aa6e-494f-aea9-1fa292f0cb2c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.338746 Aug 29 11:00:38.509273 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2585/5189] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:38 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:38.530064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:38.531049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:38.538527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.546526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.547242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:38.548144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:38.548755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:38.549335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.199743 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-57ddce4b-db03-4dd5-825a-58d1540cea4c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.860416 Aug 29 11:00:39.200414 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2605/5190] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:38 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:39.205456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:39.206120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:39.220316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.225720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.226250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.226695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.229214 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e86e3eae-f1dd-4832-9bc8-788fe59d6223 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1661 microversion: 2.1 time: 0.718650 Aug 29 11:00:39.230811 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2586/5191] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:38 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1661 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:39.234386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.234879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.235470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.236236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:39.236858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:39.243115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.243359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.244107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.245040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.245505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.245982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.562251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.565006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.574369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-658888ff-f39e-4756-a513-4c423540ad8b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.372640 Aug 29 11:00:39.576080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2606/5192] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:39 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:39.578002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51213238-f1ad-4079-a174-1bb8b6ba5ecb tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1527 microversion: 2.1 time: 0.345990 Aug 29 11:00:39.581689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:39.582573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:39.589514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.590182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.590876 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2587/5193] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:39 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:39.591159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.592211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.592854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.593430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.605660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:39.606353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:39.623459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.623971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.624422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.625152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:39.625615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:39.627105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:39.826452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.846196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.851309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.853558 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c6b6666-1baf-4d83-bf42-b97953171d99 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.275971 Aug 29 11:00:39.854826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2607/5194] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:39 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:39.859721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:39.869624 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e46aff4-6603-449f-8491-1fccc38537ab tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1527 microversion: 2.1 time: 0.268348 Aug 29 11:00:39.871936 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2588/5195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:39 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1527 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:40.165273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:40.166493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:40.175337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.176160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.176658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.177659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.178344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.178970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.195204 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] HTTP exception thrown: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Request method failure captured: Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b HTTP/1.1 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJw6VTRil44AFjqks_rvaZIvWyv9Ij_98o2OvchHwCC53zrGk34-9QnCuBY5ROSia5QJX4YITTqwi9y34-SFivfDBUV9AejS_h0_dloQcu7I6a85-h3wgpdoQTKpzaiYR5r4rde_KqJ-J99DvbxmCeNMlyPi5rlwGH48une0CROjrxw Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a2323f672046494cb53478bf589da3de Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2323f672046494cb53478bf589da3de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2323f672046494cb53478bf589da3de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2323f672046494cb53478bf589da3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2323f672046494cb53478bf589da3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a2323f672046494cb53478bf589da3de Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1925617081-project Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 98c289e4af204e27b064e3a7c2eb34d4 Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081-project Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8669fbfd-fec6-4b12-b96e-6b1fe128993b'} Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:00:40.197185 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:40.201574 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:40.203662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Returning 404 to user: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:00:40.204701 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f18cbaf7-1735-4688-ae9a-80580900b2d1 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 404 len: 111 microversion: 2.1 time: 0.313530 Aug 29 11:00:40.205765 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2608/5196] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:00:39 2022] DELETE /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 111 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:00:40.218382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:40.219421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:40.222816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:40.224738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:40.237926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:40.240023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:40.243062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.243647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.244070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.244858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.245296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.245686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.254168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.254597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.255039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.255753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.256205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.270378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.567039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:40.581066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9744e142-c36e-4aca-ae0f-b7194e06c91c tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1527 microversion: 2.1 time: 0.367895 Aug 29 11:00:40.582879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2589/5197] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:40 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1527 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:40.599926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:40.601007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:40.607828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.608588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.609586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.610890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.611652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.612614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.643285 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9053ace-70f5-4ebd-acfd-e4ca9033c969 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.416935 Aug 29 11:00:40.646095 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2609/5198] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:40 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:40.665040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cf50d0-1b39-48f9-9bde-fb26e12bdacf", "name": "network-vif-plugged", "status": "completed", "tag": "73b89409-9286-4464-859a-6c982e7a3ac0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:40.676976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.677792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.678507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.691611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] Creating event network-vif-plugged:73b89409-9286-4464-859a-6c982e7a3ac0 for instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf on n-h2-854121-10 Aug 29 11:00:40.698183 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a4773855-29ab-4312-b3f2-3d6c56289559 req-5da2396f-d9fc-4815-8377-64857f822e18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038279 Aug 29 11:00:40.698971 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2610/5199] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:40.706027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:40.706954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:40.713900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.715474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.717461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:40.718712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:40.719497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:40.720198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.104938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.117521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c66b6958-481a-41ab-8bc7-872b33981537 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.417079 Aug 29 11:00:41.122508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.126646 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2611/5200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:40 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:41.135533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Action: 'update', calling method: >, body: {"server": {"name": "8669fbfd-fec6-4b12-b96e-6b1fe128993b_new"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:41.138568 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74b23618-6d95-4198-9b84-14fc75cf8389 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.554483 Aug 29 11:00:41.155385 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2590/5201] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:40 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:41.160654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:41.161501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.162424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.171712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.172224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.172439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.172673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.173399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.173964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.174411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.174963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.175420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.176157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.176628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.177069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.213203 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] HTTP exception thrown: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Request method failure captured: Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: request: PUT /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b HTTP/1.1 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 64 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJw6VTRil44AFjqks_rvaZIvWyv9Ij_98o2OvchHwCC53zrGk34-9QnCuBY5ROSia5QJX4YITTqwi9y34-SFivfDBUV9AejS_h0_dloQcu7I6a85-h3wgpdoQTKpzaiYR5r4rde_KqJ-J99DvbxmCeNMlyPi5rlwGH48une0CROjrxw Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a2323f672046494cb53478bf589da3de Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2323f672046494cb53478bf589da3de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a2323f672046494cb53478bf589da3de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a2323f672046494cb53478bf589da3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a2323f672046494cb53478bf589da3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a2323f672046494cb53478bf589da3de Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1925617081-project Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 98c289e4af204e27b064e3a7c2eb34d4 Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1925617081-project Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: {"server": {"name": "8669fbfd-fec6-4b12-b96e-6b1fe128993b_new"}} Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8669fbfd-fec6-4b12-b96e-6b1fe128993b', 'body': {'server': {'name': '8669fbfd-fec6-4b12-b96e-6b1fe128993b_new'}}} Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:00:41.215264 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] Returning 404 to user: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b53f9cd-e85c-4315-a6ab-62a5d7253e07 tempest-ServersNegativeTestMultiTenantJSON-1925617081 tempest-ServersNegativeTestMultiTenantJSON-1925617081-project] 10.222.0.47 "PUT /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 404 len: 111 microversion: 2.1 time: 0.089735 Aug 29 11:00:41.219629 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2612/5202] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 11:00:41 2022] PUT /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:00:41.230465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:41.233020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.242629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.243368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.243882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.244707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.250169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.250790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.516450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.530813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.533390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.536117 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38b017c4-ccc6-4bdf-b749-1ec348eab302 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.379344 Aug 29 11:00:41.554027 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2591/5203] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:41 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:41.560741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:41.561567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.571454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.572272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.573002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.574521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.576037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.576883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.627483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.642220 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c31098fa-3ad2-4b5d-8f8a-73b48e3bc257 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.411603 Aug 29 11:00:41.643015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:00:41.643218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2613/5204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:41 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:41.668232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:41.670279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.681688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.682206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.682647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.687708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.688131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.690277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.815501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a9b72f1c-1cb5-4f5d-a445-108202467e13 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 204 len: 0 microversion: 2.1 time: 0.259748 Aug 29 11:00:41.816112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2592/5205] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:00:41 2022] DELETE /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:00:41.824719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:41.826524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:41.843012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.843715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.844359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.846349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:41.847004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:41.855104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:41.990760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:41.999546 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ab8460a-7234-4142-934b-77ecafc86af0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.335007 Aug 29 11:00:42.009856 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2614/5206] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:41 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:42.015741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.023438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.036372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.037028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.038435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.040627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.044855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.045417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.095031 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1b1244d2-0897-494a-8a49-595a41563554 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1466 microversion: 2.1 time: 0.274285 Aug 29 11:00:42.095698 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2593/5207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:41 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1466 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:42.101176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.102058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.149982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.151127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.153509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.155617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.156559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.158962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.418533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:42.429566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fad1dde1-4cbd-4d25-9814-633fdb74946d tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1533 microversion: 2.1 time: 0.418309 Aug 29 11:00:42.447346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2615/5208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1533 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:42.459923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.460640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.478209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.479605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.480064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.483595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.484663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.485513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.496412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:42.506810 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a09ea3b-ee81-48e0-bf78-f5c4b942dae1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.409864 Aug 29 11:00:42.507420 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2594/5209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:42.527237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.527858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.535095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.535808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.536442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.537302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.537957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.538537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.734343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:42.746168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e90b4424-3596-4e95-9cad-eee48c8c106b tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.297439 Aug 29 11:00:42.749232 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2616/5210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:42.759794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.765327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.780011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.780374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:42.780540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.780964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.781682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.782176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.782609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.804331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db366c0b-ccbc-453e-8af6-3651f2759678 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.280832 Aug 29 11:00:42.805450 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2595/5211] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:42.830554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:42.831733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:42.843668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.844329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.858748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:42.859687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:42.860287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:42.862896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.168999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:43.187884 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2fe874c2-1f2f-4020-9a7d-cae8c57d2b77 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.362188 Aug 29 11:00:43.188510 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2596/5212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:43.193590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:43.202799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:43.214927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:43.238962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.239626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:43.240427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.241020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.243793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:43.248289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.248914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.249370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.249561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-421251f1-30a8-485a-843f-12a45a8cebb5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.494072 Aug 29 11:00:43.268486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2617/5213] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:42 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:43.269511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:43.460792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:43.463280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:43.472400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.473674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.474416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.476638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.477323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.478105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.694693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bb82d2a6-ad26-4d39-962f-6a8829f46ff4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1650 microversion: 2.1 time: 0.505198 Aug 29 11:00:43.702021 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2597/5214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:43 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1650 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:43.717546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:43.718410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:43.725382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.726147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.726737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.727596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:43.728203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:43.728777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:43.933071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:43.949241 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01070dd5-a3c0-4dc9-840d-386593e456f0 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1533 microversion: 2.1 time: 0.496728 Aug 29 11:00:43.951947 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2618/5215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:43 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1533 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:44.139467 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0063efce-060a-4e09-8f03-ee35583b1a22 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1650 microversion: 2.1 time: 0.426563 Aug 29 11:00:44.156983 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2598/5216] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:43 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1650 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:44.169027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:44.170078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:44.190276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.191104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.191787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.192701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.193352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.194003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.279820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:44.280663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:44.290798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.297274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.297967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.299378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.300174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.300798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.740432 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a247c896-df13-445a-bf61-442026a4dc9c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1650 microversion: 2.1 time: 0.574278 Aug 29 11:00:44.741174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2599/5217] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:44 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1650 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:44.783083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:44.783739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:44.812734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.815633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.817939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.818926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.821096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.821761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.830894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:44.840005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d492f80-0707-4fae-8e26-bc8fec092ef1 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.886739 Aug 29 11:00:44.850779 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2619/5218] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:43 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:44.863721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8669fbfd-fec6-4b12-b96e-6b1fe128993b", "name": "network-vif-deleted", "tag": "c40bbef8-e5d6-45ad-8f92-b165ec74a07b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:44.896941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:44.897569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:44.898588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:44.941113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] Creating event network-vif-deleted:c40bbef8-e5d6-45ad-8f92-b165ec74a07b for instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b on n-h1-854121-10 Aug 29 11:00:44.957340 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-523a7793-c3f5-42f2-99b7-77fd2719a755 req-1dbe17f9-6e98-4a8f-8638-6ce4cc2bc50c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103836 Aug 29 11:00:44.966987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2620/5219] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:44.995683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:44.996449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:45.018829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:45.019713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:45.022852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:45.029049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:45.031461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:45.032876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:45.084803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:45.085651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:45.086307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:45.086924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lazy-loading 'fault' on Instance uuid 8669fbfd-fec6-4b12-b96e-6b1fe128993b {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:00:45.636748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1ad5a7cd414d27958a5643c2d438a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dc4ee0d40644e8b8a84c70d9e9e610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:45.649517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23bce94e-0ce9-4836-892f-e3e19defbf24 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 200 len: 1317 microversion: 2.1 time: 0.678716 Aug 29 11:00:45.650474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2621/5220] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:44 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:45.660487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1847613316", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "availability_zone": "nova:n-h1-854121-10", "networks": [{"uuid": "0ce292b6-8efc-44f4-9a65-61101b220855"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:45.773690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] validate_networks() for [('0ce292b6-8efc-44f4-9a65-61101b220855', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:00:45.941551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:45.950784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:45.956097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:45.959116 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81b9e6b8-2013-4511-b0f3-ebf370ba6726 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 1.190484 Aug 29 11:00:45.962960 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2600/5221] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:44 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:45.969440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "name": "network-vif-plugged", "status": "completed", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:46.000520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.002020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.003804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.032605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] Creating event network-vif-plugged:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 11:00:46.038058 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f7ae7d01-1bef-49a6-a6e4-1686e4a9a2ed req-d388d2bc-c8c8-4be5-a680-17af7042b32b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073634 Aug 29 11:00:46.038654 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2601/5222] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:46.046524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:46.047389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:46.055183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.055921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.056838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.058026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.058621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.060048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.427408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:46.436372 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f3fecd85-06cd-40fa-b1f9-123508d704a4 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.396241 Aug 29 11:00:46.437867 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2602/5223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:46 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:46.645157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:00:46.646650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:00:46.647733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:00:46.648304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:00:46.649562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:00:46.666650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.667619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.668504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.670813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.685464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:46.687703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] [instance: 8669fbfd-fec6-4b12-b96e-6b1fe128993b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:46.694000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.695515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.706882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.709878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.711091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.713269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:46.714219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:46.716180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:46.755200 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] HTTP exception thrown: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Request method failure captured: Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b HTTP/1.1 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJwgoeguvXNoDMhqs8QZmMknUhLG75iPhRMfYj19hJ__RQwh1FIUJoQ8qQYKVyywTyefVeC8wFGSQg4dEMk1Dd-KPJUCEbyKn7SRGuQEtxNn9ogMGYb97LeBv0VocSpInseZ_-_De0gFDFDqTugJ65xxXHegv3283UCcZD2db06KV-8 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: b1dc4ee0d40644e8b8a84c70d9e9e610 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-636058670 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b1dc4ee0d40644e8b8a84c70d9e9e610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b1dc4ee0d40644e8b8a84c70d9e9e610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b1dc4ee0d40644e8b8a84c70d9e9e610"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b1dc4ee0d40644e8b8a84c70d9e9e610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-636058670 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: b1dc4ee0d40644e8b8a84c70d9e9e610 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-636058670 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestMultiTenantJSON-636058670-project Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bc1ad5a7cd414d27958a5643c2d438a2 Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-636058670-project Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '8669fbfd-fec6-4b12-b96e-6b1fe128993b'} Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:46.756982 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:00:46.760147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] Returning 404 to user: Instance 8669fbfd-fec6-4b12-b96e-6b1fe128993b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:00:46.769549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b98583b1-1810-42e6-811a-986386fa3603 tempest-ServersNegativeTestMultiTenantJSON-636058670 tempest-ServersNegativeTestMultiTenantJSON-636058670-project] 10.222.0.47 "GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b" status: 404 len: 111 microversion: 2.1 time: 0.096965 Aug 29 11:00:46.773451 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2603/5224] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:46 2022] GET /compute/v2.1/servers/8669fbfd-fec6-4b12-b96e-6b1fe128993b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:00:46.789524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Getting quotas for project d85aa32a99fb46509add8a3243c10b02. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:00:46.803010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Getting quotas for user d8f8a4984cad4b5e925cac18808ed8ff and project d85aa32a99fb46509add8a3243c10b02. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:00:46.819178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:00:46.821772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:00:46.886724 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-deeb3912-dd7f-4e15-ad30-c71c66c8e9a8 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234774 Aug 29 11:00:46.888259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2622/5225] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:00:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:00:46.900304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1251d0f-c957-405c-a9cb-ce1f557f25f7 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:46.901234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1251d0f-c957-405c-a9cb-ce1f557f25f7 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:46.989509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:46.990298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:47.007845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:47.009123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:47.009790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:47.010739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:47.011530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:47.012155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:47.259498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1251d0f-c957-405c-a9cb-ce1f557f25f7 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1329 microversion: 2.1 time: 0.362717 Aug 29 11:00:47.261532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2604/5226] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:46 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1329 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:47.365823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:47.370043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:47.380828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:47.382371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:47.383630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-76e6d24d-99e1-4d1a-b873-34ef08d2f70d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.399387 Aug 29 11:00:47.386052 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2623/5227] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:46 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:47.459602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:47.460657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:47.491547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:47.494621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:47.498096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:47.500461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:47.502331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:47.503047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.077921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:48.080953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81bc26a-4457-4577-adda-2f2b76a8a591", "name": "network-vif-plugged", "status": "completed", "tag": "9b6c6348-7203-4c39-b517-b97712333b8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:48.087095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-09004bfb-8e3e-463d-82bf-dcd9848a83cb tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.631817 Aug 29 11:00:48.092885 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2605/5228] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:47 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:48.133608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:48.134026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:48.134468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.172816 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] Creating event network-vif-plugged:9b6c6348-7203-4c39-b517-b97712333b8c for instance e81bc26a-4457-4577-adda-2f2b76a8a591 on n-h1-854121-10 Aug 29 11:00:48.194610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d87c79a1-594c-4321-81b9-e3e963459ccf req-7218cd0c-ddc5-428a-809a-ab8f5a22adb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129973 Aug 29 11:00:48.195609 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2624/5229] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:00:48.286975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:48.293634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:48.304855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:48.305585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:48.306483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.308012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:48.308670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:48.309553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.412539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:48.415305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:48.435530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:48.443683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:48.446219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.447236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:48.449025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:48.449686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:48.737745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a2d18e5a-16a3-4da4-93fb-75cbe9315ad4 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1418 microversion: 2.1 time: 0.460159 Aug 29 11:00:48.740624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2606/5230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:48 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1418 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:48.944060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:48.958731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:48.960572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:48.964166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d69d3c71-bde0-4ac0-a82f-ffeaf19162db tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1808 microversion: 2.20 time: 0.558773 Aug 29 11:00:48.967578 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2625/5231] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:48 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1808 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:00:49.115273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:49.116107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:49.137203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:49.140831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:49.141893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:49.143085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:49.145740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:49.146818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:49.514685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:49.524180 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95a5c9c4-68e8-4f9f-8e55-5a9aea8a765d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1319 microversion: 2.1 time: 0.414463 Aug 29 11:00:49.537346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2607/5232] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:49 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:49.760674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:49.761402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:49.783765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:49.786420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:49.788424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:49.791436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:49.792353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:49.793060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:49.998627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:49.999270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:50.015905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.016422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.016887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:50.017619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.019179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.020243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:50.195912 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d960dd43-f5e2-452d-b524-f18b6236b9ca tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1436 microversion: 2.1 time: 0.439288 Aug 29 11:00:50.201958 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2626/5233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:49 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1436 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:50.513554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:50.525552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:50.531612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:50.534871 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a652588f-87c3-4cff-93f9-c53b06a0413d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1795 microversion: 2.20 time: 0.545591 Aug 29 11:00:50.539660 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2608/5234] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:00:49 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1795 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:00:50.555447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:50.556319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:50.567847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.568639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.570403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:50.574245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.579429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.583759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:50.872068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:00:50.884179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f9a2185-88f0-4c15-9148-32e9931beef0 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1508 microversion: 2.1 time: 0.337851 Aug 29 11:00:50.888280 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2627/5235] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:50 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:50.915260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da936ee5-4a68-408a-922a-7293c44167d4", "device": "/dev/sdb"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:50.918099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:50.933407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.938780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.944396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:50.945414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:50.946324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:50.947099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:51.223631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:51.224482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:51.247967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:51.249372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:51.250028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:51.250936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:51.252058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:51.254297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:51.399808 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a359953-34cc-4d4e-95e5-02923a6006c5 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1424 microversion: 2.1 time: 0.180095 Aug 29 11:00:51.405737 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2628/5236] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:51 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1424 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:51.481948 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64f50ea6-49d5-442b-b448-6ac6cb231163 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "POST /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569429 Aug 29 11:00:51.481948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2609/5237] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:00:50 2022] POST /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:52.426132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:52.426768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:52.443343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:52.443847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:52.444296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:52.445020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:52.445652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:52.446262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:53.135907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ddc72f29-1399-4787-9012-19357e89f839 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.713453 Aug 29 11:00:53.136506 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2629/5238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:52 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:00:54.157800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:54.170766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:54.187120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:54.187813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:54.188458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:54.189666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:54.190348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:54.190986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:54.347703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0397ad6c-c216-4173-b77b-9cd6b91f6b5a", "tag": "0d56a314-5a0b-4900-af20-b06a86544039"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:00:54.364607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:54.372085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:54.372815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:54.394866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] Creating event network-changed:0d56a314-5a0b-4900-af20-b06a86544039 for instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a on n-h1-854121-10 Aug 29 11:00:54.424988 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-16f22e92-a8fd-4c6f-a111-6eef79e5d478 req-8b480b5d-d733-4e48-9fcd-3ad04d9b80b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081939 Aug 29 11:00:54.426216 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2630/5239] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:00:54.461746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf3ff270-a091-4851-9d73-a49ca47349de tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.308558 Aug 29 11:00:54.465432 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2610/5240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:54 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:55.488504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:55.492124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:55.509846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:55.510596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:55.511395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:55.512383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:55.512998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:55.513647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:55.750932 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45f4d142-4046-4ec3-bfa8-3619af181cef tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.266702 Aug 29 11:00:55.751859 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2631/5241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:55 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:56.780334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:56.781185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:56.791405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:56.792135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:56.792794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:56.795761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:56.796447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:56.797078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:57.091455 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a5a5cda7-6ffb-4b35-99a0-2cff631f208f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.322073 Aug 29 11:00:57.093802 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2611/5242] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:56 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:58.118245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:58.120799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:58.128362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:58.131398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:58.139777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:58.141240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:58.142017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:58.143946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:58.145095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:58.145821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:58.385362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c383f04d-c58a-4afc-8a10-04fa6d76b84b tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.272338 Aug 29 11:00:58.402146 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2632/5243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:58 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:00:59.420542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:00:59.421161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:00:59.430217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:00:59.439694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:59.440195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:59.440632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:59.441347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:00:59.446021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:00:59.446473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:00:59.773218 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35fcc836-bf24-4a10-982f-b5c5ad555b9a tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.358215 Aug 29 11:00:59.774082 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2612/5244] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:00:59 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:00.802025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:00.802650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:00.804899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0397ad6c-c216-4173-b77b-9cd6b91f6b5a", "name": "network-vif-plugged", "status": "completed", "tag": "0d56a314-5a0b-4900-af20-b06a86544039"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:00.818560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:00.819071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:00.819505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:00.820361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:00.821041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:00.825608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:00.831897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:00.832434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:00.832879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:00.846217 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] Creating event network-vif-plugged:0d56a314-5a0b-4900-af20-b06a86544039 for instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a on n-h1-854121-10 Aug 29 11:01:00.859664 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1e92e9e2-3031-419f-a0d6-def41251a754 req-42311b4a-ec45-4466-bb33-32147dffe6eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056848 Aug 29 11:01:00.860848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2613/5245] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:01.061188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92dacef4-eccd-464e-8c0b-79cd4ada3308 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.264379 Aug 29 11:01:01.072299 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2633/5246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:00 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:02.088023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:02.088740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:02.101918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:02.105420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:02.106149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:02.107245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:02.107729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:02.108174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:02.359089 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-98c7205c-c539-4f7e-8aef-d0818c95e724 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1466 microversion: 2.1 time: 0.276294 Aug 29 11:01:02.362496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2614/5247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:02 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1466 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:03.379345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:03.380096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:03.388166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.392658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.394364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.396696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.397190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.397644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.445846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:03.474124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:03.482346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.482853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.483298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.484018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.484521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.484957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.521547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:03.601968 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5009c3e3-d19e-4955-8706-904f0a1c0e79 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.160140 Aug 29 11:01:03.602892 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2615/5248] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:01:03 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:01:03.612900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:03.613950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:03.622012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.622720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.623321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.624241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.624851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.625463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.731406 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4d5f100-6ac9-4253-a943-48cd9d910954 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1651 microversion: 2.1 time: 0.354947 Aug 29 11:01:03.745733 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2634/5249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:03 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1651 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:03.754530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:03.755172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:03.764931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.765448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.766332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.767067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:03.767696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:03.769283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:03.996013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:04.005792 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ace38639-4d28-49c7-a717-6079b69e89bf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1671 microversion: 2.1 time: 0.398211 Aug 29 11:01:04.007136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2616/5250] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:03 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:01:04.509316 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb76b889-983f-405d-94ef-e0595c7aaa8c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1651 microversion: 2.1 time: 0.760210 Aug 29 11:01:04.513750 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2635/5251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:03 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1651 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:04.531532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:04.532146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:04.538730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:04.540663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:04.541443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:04.542071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:04.544131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:04.544640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:04.545293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:04.869393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-effc9ec4-c519-4869-9b07-a33bc2f63809 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1651 microversion: 2.1 time: 0.342001 Aug 29 11:01:04.884270 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2617/5252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:04 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1651 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:04.891662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:04.892399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:04.905083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:04.905595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:04.906104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:04.906892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:04.907330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:04.907729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:04.971085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:01:05.029666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:05.030547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:05.041436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:05.042884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:05.044431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:05.045408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:05.046124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:05.046776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:05.158557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:05.171156 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b0bd403-b52f-4124-9fa9-e6b4e597527c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 204 len: 0 microversion: 2.1 time: 0.284006 Aug 29 11:01:05.175142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2636/5253] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:01:04 2022] DELETE /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:01:05.188883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:05.191196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:05.212100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:05.212655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:05.213105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:05.216822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:05.217316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:05.219931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:05.403516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:05.417735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9a665ce1-8b8a-4dc1-8e80-2e4bd26904a1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1671 microversion: 2.1 time: 0.392678 Aug 29 11:01:05.419904 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2618/5254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:05 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:01:05.561960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ff68e7a-bba0-463f-b89e-3ac7d148b271 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1657 microversion: 2.1 time: 0.384015 Aug 29 11:01:05.581798 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2637/5255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:05 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1657 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:06.440277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:06.441061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:06.453268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:06.453811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:06.454380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:06.455120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:06.455589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:06.456022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:06.537616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa0c20f4-3fc6-4b2c-8916-f88299095c8e tempest-ComputeTenantNetworksTest-292085388 tempest-ComputeTenantNetworksTest-292085388-project] Calling method '.version_select at 0x7f66c74f0dc0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:07.158985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:07.183334 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7ff73d27-3a23-4ce4-b8b8-64bf05f87195 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1671 microversion: 2.1 time: 0.747062 Aug 29 11:01:07.191714 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa0c20f4-3fc6-4b2c-8916-f88299095c8e tempest-ComputeTenantNetworksTest-292085388 tempest-ComputeTenantNetworksTest-292085388-project] 10.222.0.47 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.948510 Aug 29 11:01:07.196872 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2619/5256] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 11:01:06 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:07.201122 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2638/5257] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:06 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1671 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:07.205538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:07.207129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:07.222574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ef92eb1-493e-4100-acf3-4b29e4d4e1bb tempest-ComputeTenantNetworksTest-292085388 tempest-ComputeTenantNetworksTest-292085388-project] Calling method '.version_select at 0x7f66c5a41940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:07.224626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:07.226780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:07.228813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:07.232010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:07.232711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:07.238678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:07.487140 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ef92eb1-493e-4100-acf3-4b29e4d4e1bb tempest-ComputeTenantNetworksTest-292085388 tempest-ComputeTenantNetworksTest-292085388-project] 10.222.0.47 "GET /compute/v2.1/os-tenant-networks/1b36d6df-00f5-48d1-89d3-97507fb764fb" status: 200 len: 140 microversion: 2.1 time: 0.284539 Aug 29 11:01:07.488284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2639/5258] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 11:01:07 2022] GET /compute/v2.1/os-tenant-networks/1b36d6df-00f5-48d1-89d3-97507fb764fb => generated 140 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:07.823870 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bbdfab3-3800-4910-b257-0f3bac172454 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1657 microversion: 2.1 time: 0.625176 Aug 29 11:01:07.827267 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2620/5259] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:07 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1657 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:08.219195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:08.220508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:08.233919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.236670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.237452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.239618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.240791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.244360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.733234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0397ad6c-c216-4173-b77b-9cd6b91f6b5a", "name": "network-vif-deleted", "tag": "0d56a314-5a0b-4900-af20-b06a86544039"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:08.769188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.770088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.770733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.835194 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] Creating event network-vif-deleted:0d56a314-5a0b-4900-af20-b06a86544039 for instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a on n-h1-854121-10 Aug 29 11:01:08.848201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7a0996d4-cd7a-448e-a100-49ac005ac1c6 req-9f4e4ce1-462b-430e-89b7-84b0f2c74b8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123072 Aug 29 11:01:08.849277 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2621/5260] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:01:08.861407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:08.862595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:08.869590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.870422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.871130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.872008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.872617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.873201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.926012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:08.926786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:08.927433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:08.928292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lazy-loading 'fault' on Instance uuid 0397ad6c-c216-4173-b77b-9cd6b91f6b5a {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:01:09.140142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:09.163601 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73db8efd-1481-4f34-b45c-a2e56e147aa2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.949539 Aug 29 11:01:09.167001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0360ee67-362f-4376-9eef-ecfae330c22e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 200 len: 1456 microversion: 2.1 time: 0.311498 Aug 29 11:01:09.170622 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2622/5261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:08 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 1456 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:09.182923 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2640/5262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:08 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:10.204719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.205294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: 0397ad6c-c216-4173-b77b-9cd6b91f6b5a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:10.221328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.221858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.222303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.223013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.223471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.223902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.250067 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] HTTP exception thrown: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Request method failure captured: Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a HTTP/1.1 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJw_Cwq-yOZ1rZw_W0fcJsjpFw7Jvgud4nH827rAHArWR2rZJ0ofMGTn2XuS6jSxgeJcp87GI6T6Jh6BpL-enN10etAM8j_Okm0InC5b_mrzcfVooSQmhyHxhXwsb3-YYCkvtWBs5UzN9jsl0Fl5XHbRuyvFBLhjTxVyhw3JMuYyeDw Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d85aa32a99fb46509add8a3243c10b02 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestServerMultinode-98289005 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestServerMultinode-98289005 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d85aa32a99fb46509add8a3243c10b02 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestServerMultinode-98289005 Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestServerMultinode-98289005-project-admin Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d8f8a4984cad4b5e925cac18808ed8ff Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestServerMultinode-98289005-project-admin Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '0397ad6c-c216-4173-b77b-9cd6b91f6b5a'} Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:10.251853 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Returning 404 to user: Instance 0397ad6c-c216-4173-b77b-9cd6b91f6b5a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55e9f469-be93-4b77-a0d7-6c4946eef78c tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a" status: 404 len: 111 microversion: 2.1 time: 0.053545 Aug 29 11:01:10.256306 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2623/5263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/v2.1/servers/0397ad6c-c216-4173-b77b-9cd6b91f6b5a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:01:10.262461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.263054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:10.283550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.284109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.284600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.285417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.285953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.286391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.290901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:10.346925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:01:10.506736 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 204 len: 0 microversion: 2.1 time: 0.245759 Aug 29 11:01:10.508047 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2641/5264] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:01:10 2022] DELETE /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:01:10.520643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.521548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:10.534423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.535117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.535762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.536725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:10.537268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:10.537802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:10.922435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.924511 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002616 Aug 29 11:01:10.925313 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2642/5265] 10.222.0.47 () {56 vars in 886 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 11:01:10.935715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.937266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002022 Aug 29 11:01:10.938853 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2643/5266] 10.222.0.47 () {54 vars in 1035 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 29 11:01:10.945619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.947248 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002044 Aug 29 11:01:10.948007 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2644/5267] 10.222.0.47 () {54 vars in 1041 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:01:10.964023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:10.965966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5ff0bcc-91a7-43ee-a7f2-a57860c8834f tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002255 Aug 29 11:01:10.966525 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2645/5268] 10.222.0.47 () {56 vars in 886 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 11:01:10.991124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb5f845f-8b40-4aee-bab2-f4d05d038708 tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1656 microversion: 2.1 time: 0.471873 Aug 29 11:01:10.995190 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2624/5269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:10 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1656 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:12.027114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:12.028228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:12.036064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:12.038283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:12.038942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:12.040620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:12.041570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:12.042594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:12.459852 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-368131d9-22c9-462f-a456-9218a6d3131d tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1656 microversion: 2.1 time: 0.445226 Aug 29 11:01:12.474778 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2646/5270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:12 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1656 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:13.438332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cf50d0-1b39-48f9-9bde-fb26e12bdacf", "name": "network-vif-deleted", "tag": "73b89409-9286-4464-859a-6c982e7a3ac0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:13.462964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:13.464754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:13.467406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:13.499192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:13.500548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:13.522325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:13.526438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:13.528484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:13.529982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:13.531066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] Creating event network-vif-deleted:73b89409-9286-4464-859a-6c982e7a3ac0 for instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf on n-h2-854121-10 Aug 29 11:01:13.533807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:13.537066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:13.550171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c82ff4ce-7969-405a-beeb-c9ee595c8e36 req-1e4ae40f-c4ae-436a-9e71-a8fd513fa577 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113662 Aug 29 11:01:13.551279 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2625/5271] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:13.713795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10f08981-af99-4698-9e8e-ac59006ec10e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 200 len: 1451 microversion: 2.1 time: 0.230330 Aug 29 11:01:13.718523 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2647/5272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:13 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 1451 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:01:14.739521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:14.740244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] [instance: c3cf50d0-1b39-48f9-9bde-fb26e12bdacf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:14.756690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:14.757424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:14.757932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:14.758666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:14.759169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:14.759658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:14.797808 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] HTTP exception thrown: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Request method failure captured: Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf HTTP/1.1 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJw_Cwq-yOZ1rZw_W0fcJsjpFw7Jvgud4nH827rAHArWR2rZJ0ofMGTn2XuS6jSxgeJcp87GI6T6Jh6BpL-enN10etAM8j_Okm0InC5b_mrzcfVooSQmhyHxhXwsb3-YYCkvtWBs5UzN9jsl0Fl5XHbRuyvFBLhjTxVyhw3JMuYyeDw Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: d85aa32a99fb46509add8a3243c10b02 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestServerMultinode-98289005 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d85aa32a99fb46509add8a3243c10b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestServerMultinode-98289005 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: d85aa32a99fb46509add8a3243c10b02 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestServerMultinode-98289005 Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestServerMultinode-98289005-project-admin Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: d8f8a4984cad4b5e925cac18808ed8ff Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestServerMultinode-98289005-project-admin Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c3cf50d0-1b39-48f9-9bde-fb26e12bdacf'} Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:14.799557 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] Returning 404 to user: Instance c3cf50d0-1b39-48f9-9bde-fb26e12bdacf could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62118579-f0c4-453d-9ed6-df1e4577b02e tempest-TestServerMultinode-98289005 tempest-TestServerMultinode-98289005-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf" status: 404 len: 111 microversion: 2.1 time: 0.067524 Aug 29 11:01:14.802739 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2626/5273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:14 2022] GET /compute/v2.1/servers/c3cf50d0-1b39-48f9-9bde-fb26e12bdacf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:01:22.194199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:22.194668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:22.204438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:22.204845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:22.205336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:22.206028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:22.206835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:22.207713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:22.454278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lazy-loading 'services' on Instance uuid e81bc26a-4457-4577-adda-2f2b76a8a591 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:01:22.604776 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96e5f925-e181-4ed3-8d99-5f1487c50867 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591/os-volume_attachments/da936ee5-4a68-408a-922a-7293c44167d4" status: 202 len: 0 microversion: 2.1 time: 0.414734 Aug 29 11:01:22.606536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2648/5274] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:01:22 2022] DELETE /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591/os-volume_attachments/da936ee5-4a68-408a-922a-7293c44167d4 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:01:24.059468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:24.059999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:24.070737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.074397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.075374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.078453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.079141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.080139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.144787 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdcee495-05d4-417a-abe7-20ed003d9243 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments/86239428-3236-4e8e-85b0-9c8e3297e8c3" status: 200 len: 194 microversion: 2.20 time: 0.089970 Aug 29 11:01:24.149039 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2627/5275] 10.222.0.47 () {60 vars in 1454 bytes} [Mon Aug 29 11:01:24 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments/86239428-3236-4e8e-85b0-9c8e3297e8c3 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:24.321128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:24.321765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:24.344607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.345294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.349106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.349911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.350369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.350813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.585325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lazy-loading 'services' on Instance uuid 94942cf0-a68b-4673-b2d8-cd531bd71d43 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:01:24.781563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a860331e-0131-4577-8c41-41774b33b773 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments/86239428-3236-4e8e-85b0-9c8e3297e8c3" status: 202 len: 0 microversion: 2.20 time: 0.463364 Aug 29 11:01:24.783954 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2649/5276] 10.222.0.47 () {60 vars in 1457 bytes} [Mon Aug 29 11:01:24 2022] DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments/86239428-3236-4e8e-85b0-9c8e3297e8c3 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:01:24.796174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:24.799844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:24.809484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.810558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.811492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.812693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:24.813801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:24.815148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:24.863876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32a9a1e8-0e55-4efd-b1a5-be616e9b318b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074686 Aug 29 11:01:24.869284 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2628/5277] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:24 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 11:01:25.877756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:25.880638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:25.896401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:25.901921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:25.903103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:25.903968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:25.904550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:25.908417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:26.013736 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f818be85-0f2d-4607-83f6-d261cb88f96a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138022 Aug 29 11:01:26.017366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2650/5278] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:25 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:27.028920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:27.031727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:27.048409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:27.052586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:27.053334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:27.054353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:27.055045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:27.056336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:27.145524 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f692188-c24b-4a97-b31e-7918ccf63f28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120734 Aug 29 11:01:27.146517 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2629/5279] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:27 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:28.158736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:28.161564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:28.178702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:28.179467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:28.180096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:28.181006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:28.184874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:28.185331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:28.300155 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-54c617b8-0442-4357-a8c2-93e36977e64c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145564 Aug 29 11:01:28.301763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2651/5280] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:28 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:29.314138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:29.318641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:29.335733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:29.341979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:29.344832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:29.353474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:29.354009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:29.356468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:29.467655 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e8e2416-93ed-49bf-91fe-2e0b727c24c6 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158320 Aug 29 11:01:29.470232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2630/5281] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:29 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:30.483811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:30.487203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:30.508189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:30.508189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:30.508494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:30.509418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:30.510043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:30.510487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:30.591194 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8109f53f-8ea8-4a9b-97af-17a2777722ee tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113683 Aug 29 11:01:30.596340 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2652/5282] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:30 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:31.604236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:31.607279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:31.634779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:31.635288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:31.654823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:31.655713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:31.656884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:31.656884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:31.663480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:31.663991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:31.691051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:31.691569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:31.692019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:31.692753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:31.693224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:31.693667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:31.777976 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc8d45ef-7e9e-4fff-ba73-52970dfbcbec tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.177052 Aug 29 11:01:31.778894 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2631/5283] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:31 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:31.779916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:01:32.084568 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ab3fbdeb-aadb-4d5f-a09e-1f008f4aa800 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 204 len: 0 microversion: 2.1 time: 0.422324 Aug 29 11:01:32.085136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2653/5284] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:01:31 2022] DELETE /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:01:32.096444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:32.097535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:32.105731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:32.106820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:32.107723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:32.108897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:32.109936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:32.110754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:32.574164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:32.581882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1235f60-c92d-4b29-bdb4-bf81ba1b1539 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1514 microversion: 2.1 time: 0.491685 Aug 29 11:01:32.582579 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2632/5285] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:32 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1514 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:01:32.807224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:32.832684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:32.848720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:32.849218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:32.849664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:32.850417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:32.850881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:32.851314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:32.903604 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec281af4-3f3b-4733-af19-ef5b906352b9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116505 Aug 29 11:01:32.908326 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2654/5286] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:32 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:33.613917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:33.617441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:33.627513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:33.629107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:33.629750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:33.631054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:33.632163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:33.633297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:33.646058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:33.915819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:33.919553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:33.944471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:33.950047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:33.950640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:33.951395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:33.952937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:33.953383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:34.040213 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fa42a2a-0bc7-42c4-be1d-864713afee16 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128327 Aug 29 11:01:34.040803 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2655/5287] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:33 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:34.156366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:34.165191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-31648f30-e2bf-4db0-a781-1da353affc40 tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1514 microversion: 2.1 time: 0.565588 Aug 29 11:01:34.179230 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2633/5288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:33 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1514 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:34.875806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81bc26a-4457-4577-adda-2f2b76a8a591", "name": "network-vif-deleted", "tag": "9b6c6348-7203-4c39-b517-b97712333b8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:34.900685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:34.902580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:34.905226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:34.932042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] Creating event network-vif-deleted:9b6c6348-7203-4c39-b517-b97712333b8c for instance e81bc26a-4457-4577-adda-2f2b76a8a591 on n-h1-854121-10 Aug 29 11:01:34.938843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7e8118eb-b470-48c8-9495-33a0410d3a8f req-dbc83eea-b874-485f-939a-7abb1080df9d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066684 Aug 29 11:01:34.940753 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2656/5289] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:35.053639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:35.058818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:35.074336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=34 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:35.078688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:35.081316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:35.082038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:35.084344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:35.086637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:35.088339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:35.132253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a61153c-e18b-434a-85d2-71a0065a965e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083312 Aug 29 11:01:35.132933 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2634/5290] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:35 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:35.209978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:35.210987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:35.239199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:35.242578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:35.244879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:35.246605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:35.264400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:35.264400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:35.352708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:35.357467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:35.358533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:35.359156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lazy-loading 'fault' on Instance uuid e81bc26a-4457-4577-adda-2f2b76a8a591 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:01:35.368747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:35.435716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f93235c2504b0c9e2ab30692590ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac15cf0999714c30b3994ffbb4c6cb8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:35.444540 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0f24f0c-28cb-4562-b75b-daa3a72ef2ba tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 200 len: 1309 microversion: 2.1 time: 0.247696 Aug 29 11:01:35.449098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2657/5291] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:35 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:36.145279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:36.150019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:36.166095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:36.166756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:36.169898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:36.170925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:36.171477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:36.173401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:36.246892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ef5d0ae-04a8-49c7-9eb2-692da4f6787b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105528 Aug 29 11:01:36.247972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2635/5292] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:36 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:36.470110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:36.470806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] [instance: e81bc26a-4457-4577-adda-2f2b76a8a591] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:36.473564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:36.484398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:36.494562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:36.496098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:36.496860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:36.497332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:36.497790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:36.528376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] HTTP exception thrown: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Request method failure captured: Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 HTTP/1.1 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJsuRx3cABU3sRA9Mm8nVW1KsMRaXnQKX85EfAgyQ_EC0Bcf9CNU-dX6iYrqgB_yuPVpD4MnLrWKbMmU9wmnRxzkQh7eb_7ExQSfvinkXVBXLDKmNDolneL6-zN1zoBU-4cd7KqAsmpROUA4hz6ucWdHJCjt4aEkg9KnW4iIzBNQoeI Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ac15cf0999714c30b3994ffbb4c6cb8c Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac15cf0999714c30b3994ffbb4c6cb8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ac15cf0999714c30b3994ffbb4c6cb8c Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1118135908 Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesSnapshotTestJSON-1118135908-project Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 69f93235c2504b0c9e2ab30692590ddc Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesSnapshotTestJSON-1118135908-project Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e81bc26a-4457-4577-adda-2f2b76a8a591'} Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:36.538208 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] Returning 404 to user: Instance e81bc26a-4457-4577-adda-2f2b76a8a591 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:01:36.541690 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f08f0cb-42ed-47c2-acad-523cf842f69d tempest-VolumesSnapshotTestJSON-1118135908 tempest-VolumesSnapshotTestJSON-1118135908-project] 10.222.0.47 "GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591" status: 404 len: 111 microversion: 2.1 time: 0.073544 Aug 29 11:01:36.548511 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2658/5293] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:36 2022] GET /compute/v2.1/servers/e81bc26a-4457-4577-adda-2f2b76a8a591 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:01:37.260102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:37.263543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:37.284270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:37.284779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:37.285289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:37.286112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:37.286594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:37.287578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:37.340993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-deae6c2a-90e6-414a-a283-360e2f02c3b2 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085748 Aug 29 11:01:37.341601 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2636/5294] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:37 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:38.353519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:38.357376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:38.377837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:38.378332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:38.378775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:38.379484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:38.379941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:38.391268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:38.491941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e2817cd-23d0-4b26-838f-3b8a329a4908 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143241 Aug 29 11:01:38.493155 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2659/5295] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:38 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:39.506465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:39.508990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:39.531907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:39.532442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:39.533058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:39.534239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:39.534754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:39.535190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:39.583938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fce2247f-453a-446d-a193-e5aa4e759de5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083305 Aug 29 11:01:39.586442 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2637/5296] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:39 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:01:40.618271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:40.628031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:40.658396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:40.660784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:40.661470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:40.663228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:40.665677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:40.666425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:40.752859 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a6f6472-17b4-4453-a24f-64deafad777d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.157398 Aug 29 11:01:40.753810 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2660/5297] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:01:40 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:40.911511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:40.911867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:40.927615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:40.929930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:40.930735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:40.933975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:40.934620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:40.938145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:41.013573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:01:41.146701 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a289d7b8-3f18-4680-85ea-19967eb3cefc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 204 len: 0 microversion: 2.20 time: 0.242943 Aug 29 11:01:41.149202 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2638/5298] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 11:01:40 2022] DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 11:01:41.157319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:41.157882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:41.166736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:41.167569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:41.168273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:41.170410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:41.171758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:41.172375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:41.571523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:41.586544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:41.593031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:41.597449 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e43edaf-2be4-4041-9b25-6cb5c7c01f79 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.444198 Aug 29 11:01:41.600068 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2661/5299] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:41 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:01:41.947237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:41.949069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:41.982861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:41.985226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:41.985891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:41.987564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:41.992104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:42.000290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:42.545875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:42.557082 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b76fd63a-2165-4b0a-b603-45d3d904a712 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.614187 Aug 29 11:01:42.565922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2639/5300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:41 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:42.594873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:42.596407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:42.615752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:42.622014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:42.622860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:42.623912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:42.624129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:42.624749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:42.626271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:42.626723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:42.640101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:42.641208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:42.641849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:42.642729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:42.643342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:42.643924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:43.373198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:43.382441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:43.384130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:43.386452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5d8ad3b1-3202-47fa-bf48-a8f3bee01b82 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 0.766379 Aug 29 11:01:43.402160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2640/5301] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:42 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:01:43.466531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:43.480331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a846498-5e85-4297-b140-7561e8adaa59 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.892176 Aug 29 11:01:43.494251 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2662/5302] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:42 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:43.501141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:43.502066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:43.508985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:43.509748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:43.510361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:43.511307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:43.511925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:43.512835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:43.847007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:43.871115 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7c15359-8502-466e-820a-f8cef05361c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.373604 Aug 29 11:01:43.887962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2641/5303] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:43 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:43.899600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:43.900235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:43.917004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:43.917681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:43.918681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:43.918905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:43.919375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:43.919811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:44.410377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:44.411261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:44.428423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:44.437663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:44.443716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:44.444915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:44.448858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:44.452255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:44.496985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:44.520149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8b80846e-1aea-4255-862d-327e7c9c53eb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.612025 Aug 29 11:01:44.524123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2663/5304] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:43 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:44.794919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-590245030", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "603a8da8-8c3d-423e-879b-e3e712d1b689"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:45.040939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] validate_networks() for [('603a8da8-8c3d-423e-879b-e3e712d1b689', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:01:45.860931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:45.877011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:45.882120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:45.887674 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86a01827-0405-4865-b9fd-64026dc9564b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1723 microversion: 2.20 time: 1.477345 Aug 29 11:01:45.889751 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2642/5305] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:44 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1723 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:01:46.919470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:46.921207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:46.939833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:46.943235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:46.946295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:46.952429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:46.953193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:46.956626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:47.322234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:47.336536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:47.337925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:47.343152 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0868098c-426f-4284-97f8-b73037d0c0fc tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1656 microversion: 2.20 time: 0.428449 Aug 29 11:01:47.367697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2643/5306] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:46 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1656 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:01:47.650002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:01:47.651454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:01:47.652171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:01:47.652780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:01:47.653424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:01:47.683769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:47.684751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:47.685643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:47.689690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:47.690427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:47.691346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:47.699361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94942cf0-a68b-4673-b2d8-cd531bd71d43", "name": "network-vif-deleted", "tag": "e0176ae9-8fdb-45fe-af36-194271bd14f9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:47.749431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:01:47.750343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:47.750916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:47.751374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:47.756289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:01:47.804657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:01:47.815020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:01:47.816540 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] Creating event network-vif-deleted:e0176ae9-8fdb-45fe-af36-194271bd14f9 for instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 on n-h1-854121-10 Aug 29 11:01:47.850731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b4dceaef-7104-47a6-a5a6-0a4684bd834c req-2802efc8-bbfe-402f-86e1-8d807c178b14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155713 Aug 29 11:01:47.856701 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2644/5307] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:01:48.008805 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-111a6f48-2add-43b5-8b96-c5cece6f6c65 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.218564 Aug 29 11:01:48.010653 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2664/5308] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:01:48.023185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-556d436d-39e3-4929-8abc-9e3bdfd5a374 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:48.024022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-556d436d-39e3-4929-8abc-9e3bdfd5a374 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:48.374648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:48.375657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:48.384640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-556d436d-39e3-4929-8abc-9e3bdfd5a374 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:48.399081 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-556d436d-39e3-4929-8abc-9e3bdfd5a374 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1214 microversion: 2.1 time: 0.381909 Aug 29 11:01:48.403610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2645/5309] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:48 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:48.409578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:48.419266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:48.430894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:48.430894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:48.430894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:48.431483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:48.625690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:48.628609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:48.634161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:48.636828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lazy-loading 'fault' on Instance uuid 94942cf0-a68b-4673-b2d8-cd531bd71d43 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:01:48.743438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:48.757547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:48.763064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:48.770985 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87dc7cf9-04b3-43c5-89cf-5c9f5f99ad61 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 200 len: 1372 microversion: 2.20 time: 0.395420 Aug 29 11:01:48.774512 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2665/5310] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:48 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:01:49.425689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:49.426877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:49.457466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:49.462588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:49.463085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:49.463955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:49.465893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:49.466371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:49.656058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:49.687004 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6986c43d-1873-491d-9258-208063863bd2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1218 microversion: 2.1 time: 0.267123 Aug 29 11:01:49.701606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2646/5311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:49 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1218 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:49.803451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:49.804095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:49.826857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:49.829427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:49.832601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:49.834555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:49.836298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:49.840241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:49.876178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 HTTP/1.1 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '94942cf0-a68b-4673-b2d8-cd531bd71d43'} Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:49.878669 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:01:49.882260 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:01:49.884197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:01:49.885846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3d9aa69c-f532-42c9-bd3b-1fff3404a054 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 404 len: 111 microversion: 2.20 time: 0.088124 Aug 29 11:01:49.890372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2666/5312] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:01:49 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 11:01:49.899326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5961eb8d-0fdc-4316-90d7-cc86d18eb87c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '.version_select at 0x7f66c5cb4b80>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:49.950924 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5961eb8d-0fdc-4316-90d7-cc86d18eb87c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358544637" status: 204 len: 0 microversion: 2.20 time: 0.055282 Aug 29 11:01:49.951732 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2647/5313] 10.222.0.47 () {60 vars in 1262 bytes} [Mon Aug 29 11:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358544637 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 11:01:50.717491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:50.718138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:50.734107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:50.734626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:50.736239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:50.740375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:50.741042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:50.742651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:50.952530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:50.967787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-631e12e5-4340-4974-8266-31e6948c2beb tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1272 microversion: 2.1 time: 0.255182 Aug 29 11:01:50.968388 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2667/5314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:50 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:51.993933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:51.995273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:52.014109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:52.016517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:52.018273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:52.018273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:52.018273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:52.018680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:53.069474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:53.085909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ddc93e5-7a12-4d25-a02d-03854070d59a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 1.097182 Aug 29 11:01:53.124224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2648/5315] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:51 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:53.795578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f698843-e464-4a3b-992a-c0d227cb470c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: .version_select at 0x7f66c5e2e0d0>, body: {"keypair": {"name": "tempest-keypair-536168970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3BL7RU9WzZdRJrTNbwqF8AAKOl9/6s5tw2mGPweqeig/4NX7uWPLGVSQSHhDzrc7lC2gS6PJdUD+HXKBIgO5TGAQXsVk8bn3SfrRuR87BGxbAaI6cAM41Ls7NKGdAZNg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:53.814684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0f698843-e464-4a3b-992a-c0d227cb470c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:01:53.823361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0f698843-e464-4a3b-992a-c0d227cb470c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for user b7521435d76b4ad49b2810bee5f177e5 and project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:01:53.871627 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f698843-e464-4a3b-992a-c0d227cb470c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.082297 Aug 29 11:01:53.888721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2668/5316] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 29 11:01:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 11:01:54.153727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:54.154403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:54.177553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:54.179083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:54.184844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:54.187120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:54.187919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:54.190919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:55.007044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:55.028170 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-56edef37-5c7e-40e9-be0b-a4750b78f1f8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.889263 Aug 29 11:01:55.029061 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2649/5317] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:54 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:01:55.672584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dfd964-6d94-4881-9eb8-73a83928fdfc", "tag": "9cb3bc8f-e197-4843-8b1a-14602c71e988"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:55.692869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:55.702509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:55.703218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:55.720706 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] Creating event network-changed:9cb3bc8f-e197-4843-8b1a-14602c71e988 for instance 61dfd964-6d94-4881-9eb8-73a83928fdfc on n-h2-854121-10 Aug 29 11:01:55.740738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-82a7298c-e32c-41c7-ab1a-2fa29357c220 req-617a6f30-940c-4c70-886c-e8f5f225cc86 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060659 Aug 29 11:01:55.741905 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2669/5318] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:01:56.053586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:56.056788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:56.078198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:56.079027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:56.084124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:56.085919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:56.091369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:56.092353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:56.770629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:56.772929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:56.794181 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e067df9b-1d2a-4403-bc3c-ddea485969bc tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.734352 Aug 29 11:01:56.795063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2650/5319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:56 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:57.817746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:57.819430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:57.848753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:57.855373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:57.856217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:57.857115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:57.858126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:57.858821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:57.859457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:58.051626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:58.063111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-28d36a71-e5f3-4848-aacb-ab39debe6d5e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.248526 Aug 29 11:01:58.079075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2670/5320] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:57 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:59.090920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:01:59.091458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:01:59.094537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:01:59.120738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:59.122729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:59.129596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:59.130510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:01:59.131174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:01:59.131764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:01:59.484893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:01:59.530388 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff0d3fdd-bfb0-4f7d-8cd3-755b106b284d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.443982 Aug 29 11:01:59.533325 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2651/5321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:01:59 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:01:59.657869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-985927748", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5fcf898-805b-4b1f-8916-bfd24b2dec7d"}], "security_groups": [{"name": "tempest-securitygroup--1962038095"}], "key_name": "tempest-keypair-536168970", "user_data": "}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:01:59.892572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] validate_networks() for [('b5fcf898-805b-4b1f-8916-bfd24b2dec7d', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:02:00.554737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:00.556282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:00.578744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:00.584270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:00.587192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:00.591870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:00.593046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:00.595803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:00.938523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:02:00.939033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:02:00.939530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:02:00.940353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:02:00.940783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:02:00.966338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:00.970375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:00.970841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:00.973476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:00.975974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:00.977489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:01.019694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:02:01.027323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Getting quotas for user b7521435d76b4ad49b2810bee5f177e5 and project 8a60fb2140c44eedb7ff3ac2f649c304. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:02:01.052715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:02:01.055715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:02:01.119416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:01.134626 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55667e16-1419-433b-ad3f-5dff33edba27 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.577311 Aug 29 11:02:01.136880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2652/5322] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:00 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:02:01.205132 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f1cf8ef-6c4b-49e0-a05c-da3acd62c866 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.551739 Aug 29 11:02:01.205820 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2671/5323] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 11:01:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 11:02:01.217814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:01.218649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:01.384041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:01.398735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:01.406374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:01.408265 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb0a6dbd-f1d9-46ab-bef1-99df6c5c77c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1280 microversion: 2.20 time: 0.195366 Aug 29 11:02:01.409369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2653/5324] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:01 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:02.162974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:02.163600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:02.194695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:02.198435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:02.201400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:02.202615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:02.204787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:02.205981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:02.431527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:02.432202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:02.442498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:02.458590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:02.459060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:02.460122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:02.463497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:02.464104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:02.633848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:02.643800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:02.653804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:02.658081 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1901bb81-c466-4ec7-a103-888e4284d18e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1276 microversion: 2.20 time: 0.230426 Aug 29 11:02:02.663583 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2654/5325] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:02 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:02.765759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:02.784175 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c03ee46b-a5d5-4ed3-949f-e289a4cac08b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.627957 Aug 29 11:02:02.785677 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2672/5326] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:02 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:03.631975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dfd964-6d94-4881-9eb8-73a83928fdfc", "name": "network-vif-plugged", "status": "completed", "tag": "9cb3bc8f-e197-4843-8b1a-14602c71e988"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:03.668885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:03.669613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:03.670247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:03.689941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:03.691243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:03.698643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:03.704658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:03.705357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:03.706995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:03.710129 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] Creating event network-vif-plugged:9cb3bc8f-e197-4843-8b1a-14602c71e988 for instance 61dfd964-6d94-4881-9eb8-73a83928fdfc on n-h2-854121-10 Aug 29 11:02:03.710970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:03.711616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:03.724241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-38d6aeff-62cb-468f-b7dc-c719ac7ec211 req-50ba3918-d15a-47d7-a015-94d79ac09936 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095965 Aug 29 11:02:03.729264 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2655/5327] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:02:03.808863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:03.814971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:03.827360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:03.838858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:03.840016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:03.840978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:03.841612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:03.842232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:04.050293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:04.060497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:04.069105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:04.070519 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ec5cdf0-7413-49cb-988d-665b34039db4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1338 microversion: 2.20 time: 0.385563 Aug 29 11:02:04.071582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2673/5328] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:03 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1338 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:04.240713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:04.252114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86b189d5-6f23-47c5-98f5-1886120574cd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.448504 Aug 29 11:02:04.260052 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2656/5329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:03 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:02:05.099211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:05.100233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:05.116860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:05.117334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:05.117801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:05.118531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:05.118994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:05.120290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:05.248548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:05.265269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:05.267119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:05.268462 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-477d4684-8eab-4cf2-84ad-37d07ae24510 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1338 microversion: 2.20 time: 0.173322 Aug 29 11:02:05.269536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2674/5330] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:05 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:05.280540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:05.281844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:05.296794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:05.299022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:05.299731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:05.300485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:05.301369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:05.302155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:05.302801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:05.854774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:05.870449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2519e9c3-958f-46cb-a2a1-0a9d0bfccc2b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1314 microversion: 2.1 time: 0.593869 Aug 29 11:02:05.871283 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2657/5331] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:05 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:06.297012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:06.297621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:06.319543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:06.323141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:06.323663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:06.327064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:06.327564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:06.328008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:06.380643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=81 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:06.904849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:06.906655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:06.926712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:06.928037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:06.931599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:06.940898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:06.942878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:06.944910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:06.945636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:06.949294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:06.954801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:06.962146 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-547f5fc1-f38e-4361-85e0-15f5424db298 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.664682 Aug 29 11:02:06.966394 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2675/5332] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:06 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:07.517475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:07.542531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:07.542531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:07.542531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:07.542531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:07.550291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:07.582345 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] Creating event network-changed:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h1-854121-10 Aug 29 11:02:07.583158 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ad854190-ba95-435b-a317-7976453b1608 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1501 microversion: 2.1 time: 0.694972 Aug 29 11:02:07.599131 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2658/5333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:06 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1501 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:07.601114 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-07132ba6-bf68-441b-8d9f-22eead0dc87c req-2ccbc4bf-349e-4aca-be27-d37798b825f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088243 Aug 29 11:02:07.602559 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2676/5334] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:02:07.605599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:07.606267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:07.613110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:07.614052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:07.614685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:07.616208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:07.616857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:07.617474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:08.001036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:08.001943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:08.008117 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.security_group_api [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Removing security group 977d70bc-6c0b-40fc-8760-239ee4fc6c66 from port 9cb3bc8f-e197-4843-8b1a-14602c71e988 Aug 29 11:02:08.037150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:08.038629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:08.039885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:08.042391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:08.043688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:08.045843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:08.512806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:08.544032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:08.559176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:08.560580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92f89236-b851-4f79-a1ab-1336eb36496c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.567686 Aug 29 11:02:08.581577 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2677/5335] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:07 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:02:09.595773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:09.596442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:09.624241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:09.625439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:09.626084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:09.627487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:09.628245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:09.628870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:09.775723 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f46227d4-34bd-448f-8e17-80790fe68028 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc/action" status: 202 len: 0 microversion: 2.1 time: 2.173764 Aug 29 11:02:09.787804 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2659/5336] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:02:07 2022] POST /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc/action => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:02:09.794807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:09.795587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:09.804331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:09.805969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:09.805969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:09.806836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:09.807541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:09.808199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:10.193617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:10.235179 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1f20988-7192-420f-acef-d9416f6edb7d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1459 microversion: 2.1 time: 0.445979 Aug 29 11:02:10.239798 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2660/5337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:09 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1459 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:02:10.256703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dfd964-6d94-4881-9eb8-73a83928fdfc", "tag": "9cb3bc8f-e197-4843-8b1a-14602c71e988"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:10.274790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:10.276194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:10.278974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:10.300550 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] Creating event network-changed:9cb3bc8f-e197-4843-8b1a-14602c71e988 for instance 61dfd964-6d94-4881-9eb8-73a83928fdfc on n-h2-854121-10 Aug 29 11:02:10.311257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e77fe342-f5fe-43ac-b251-09e387e370fa req-cc7554d4-3ec6-48aa-9cc4-7c77bc81bd64 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067936 Aug 29 11:02:10.312957 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2661/5338] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:02:10.319844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:10.321978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:10.331385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:10.332276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:10.332938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:10.334189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:10.334871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:10.335832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:10.516952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:10.571849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:10.574444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:10.575630 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19b2e01d-3dc4-47bb-a0b5-a784551b122e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.991106 Aug 29 11:02:10.585509 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2678/5339] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:09 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:11.076825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:11.092287 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0d69c9bc-7a41-46f0-a6d6-e589396fc8a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.777641 Aug 29 11:02:11.094959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2662/5340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:10 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:11.119890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:11.120594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:11.123681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:11.125276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:11.143714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:11.144488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:11.145100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:11.146043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:11.146663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:11.147250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:11.612800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:11.613816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:11.617803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:11.626558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:11.628076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:11.628699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:11.629599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:11.630714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:11.631353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:12.032803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:12.059750 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-70ac267a-8b31-40ab-9645-d5f71cc26f4b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.935884 Aug 29 11:02:12.063041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2679/5341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:11 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:12.087890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:12.088712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:12.111732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:12.112246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:12.112703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:12.113429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:12.116878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:12.122472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:12.145896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:12.160619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:12.163282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:12.164704 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d68a02e-f670-4022-a481-b0d69aa66f68 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.556824 Aug 29 11:02:12.166630 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2663/5342] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:11 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:02:13.128601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:13.139069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a3bd896-b552-4e25-81a5-27015d5c20d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.054983 Aug 29 11:02:13.144763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2680/5343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:12 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:02:13.174175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:13.174796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:13.190385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:13.191241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:13.193297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:13.193944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:13.195277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:13.196187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:13.197018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:13.197655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:13.202460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:13.202970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:13.203418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:13.206315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:13.206802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:13.207260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:13.689287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:13.700795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:13.701250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:13.702782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:13.703955 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9a2fb406-7b6d-4ceb-8e07-3403c0092593 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.518149 Aug 29 11:02:13.710505 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa6d5f59-5b14-4b1c-973d-eec8ea54e53f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.540400 Aug 29 11:02:13.717053 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2681/5344] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:13 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:02:13.719741 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2664/5345] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:13 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:13.999553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-444817524", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "603a8da8-8c3d-423e-879b-e3e712d1b689"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:14.117782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] validate_networks() for [('603a8da8-8c3d-423e-879b-e3e712d1b689', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:02:14.747898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:14.748585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:14.768074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:14.770171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:14.774223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:14.775506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:14.776757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:14.777558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:15.648679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:15.667046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:15.670714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:15.672406 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41da5126-c00e-4099-8c25-42542d029783 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.931732 Aug 29 11:02:15.690604 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2665/5346] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:14 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:15.699353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "name": "network-vif-plugged", "status": "completed", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:15.713233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:15.714002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:15.714665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:15.738062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] Creating event network-vif-plugged:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h1-854121-10 Aug 29 11:02:15.746822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8ad0d1c4-dae8-40d2-9200-666d9d99693e req-1872644d-a8cc-4bc1-9608-69083b167c15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054086 Aug 29 11:02:15.748248 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2666/5347] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:02:16.360708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:02:16.361208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:02:16.361660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:02:16.362395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:02:16.363193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:02:16.383746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:16.385490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:16.386490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:16.387626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:16.388273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:16.389774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:16.440369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:02:16.449559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Getting quotas for user 92ee70745b4b47d1bb6729d0ed653adc and project f46a3ee5766d416cbd8bf2295ddd5816. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:02:16.501184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:02:16.504205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:02:16.653802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb383431-ae6e-4441-a872-b1905b6d8617 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.658566 Aug 29 11:02:16.660952 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2682/5348] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:02:16.668311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4de1ca54-1296-431a-bbb3-00377da2c840 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:16.669138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4de1ca54-1296-431a-bbb3-00377da2c840 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:16.700020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:16.700653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:16.722717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:17.278971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4de1ca54-1296-431a-bbb3-00377da2c840 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:17.317041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4de1ca54-1296-431a-bbb3-00377da2c840 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1214 microversion: 2.1 time: 0.654840 Aug 29 11:02:17.318219 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2667/5349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:16 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1214 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:02:17.473683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:17.489250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:17.496156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:17.499903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9bcb5b44-a933-445f-9048-a661125c711a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1406 microversion: 2.20 time: 0.807213 Aug 29 11:02:17.502681 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2683/5350] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:16 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1406 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:18.341347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:18.342381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:18.364689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:18.367647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:18.368319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:18.369553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:18.370319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:18.370999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:18.517264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:18.528580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:18.529674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:18.530506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-45e30a66-34f7-4b34-867a-c45213ee8abe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1210 microversion: 2.1 time: 0.195342 Aug 29 11:02:18.548393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2668/5351] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:18 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:18.559651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:18.560516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:18.561209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:18.562219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:18.562849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:18.563479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:19.554140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:19.556708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:19.591200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:19.595963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:19.597527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:19.599183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:19.600580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:19.605610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:20.105352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:20.148397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8903c61-25ee-4974-9985-bc2cb559ce09 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1266 microversion: 2.1 time: 0.597306 Aug 29 11:02:20.159483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2669/5352] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:19 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1266 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:20.485000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:20.510338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:20.520082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:20.521565 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e706951f-96dc-4bda-9e5d-0eb3c3fa8018 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1598 microversion: 2.20 time: 2.000717 Aug 29 11:02:20.528182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2684/5353] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:02:18 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1598 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:02:20.552072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:20.552952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:20.561303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:20.562778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:20.563735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:20.564711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:20.565378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:20.566251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:21.176788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:21.177588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:21.191141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:21.192451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:21.193678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:21.195428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:21.197004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:21.198131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:21.275465 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d2e5979-a4d2-48c0-92d5-5bf116810b28 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.728242 Aug 29 11:02:21.283525 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2670/5354] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 29 11:02:20 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-interface => generated 284 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:02:21.377087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:21.391516 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67af22c8-9bdb-4860-9912-762937d48a05 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1272 microversion: 2.1 time: 0.218756 Aug 29 11:02:21.392654 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2685/5355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:21 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:22.432890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:22.434575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:22.503897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:22.508186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:22.511656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:22.512310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:22.519814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:22.520071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:23.410273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:23.419322 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1f0bc73-ddb9-47cf-82c0-c49990e112c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 1.009309 Aug 29 11:02:23.426083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2671/5356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:22 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:24.452537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:24.454799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:24.477866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:24.478945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:24.479690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:24.480683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:24.490488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:24.491281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:25.283278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:25.304661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60ced266-f0f2-488b-a51c-e3b3cdd1c2db tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.856225 Aug 29 11:02:25.305906 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2686/5357] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:24 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:25.959746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:25.991447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:25.991986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:25.992435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:26.012313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:26.015385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] Creating event network-changed:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h1-854121-10 Aug 29 11:02:26.023850 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e95cdd72-d604-4733-913c-0e89e060c195 req-2ad06749-5a92-4ac3-be0c-0470a427e312 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075202 Aug 29 11:02:26.024962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2672/5358] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:02:26.328606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:26.329361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:26.342046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:26.346867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:26.346867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:26.347774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:26.350836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:26.351683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:26.416774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:26.475622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:26.525408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e663b4e4-72e9-4d00-92c0-536309c86bef", "tag": "c7f946de-4c0e-45f0-b183-17be8f939bc1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:26.540706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:26.542097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:26.544137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:26.610115 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] Creating event network-changed:c7f946de-4c0e-45f0-b183-17be8f939bc1 for instance e663b4e4-72e9-4d00-92c0-536309c86bef on n-h2-854121-10 Aug 29 11:02:26.637509 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-52004578-de1c-416c-9dce-a3ff752c3e3a req-fddc1b10-3b0a-4be3-8d80-5579ff0532a3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112723 Aug 29 11:02:26.643238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2673/5359] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:02:28.080526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:28.094580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2411ed26-ad60-4815-a0cf-52ad16fa18c6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 1.771393 Aug 29 11:02:28.095373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2687/5360] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:26 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:29.117318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:29.123154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:29.124086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:29.143240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:29.143911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:29.144503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:29.145601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:29.146272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:29.147072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:29.498618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:29.513330 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4371438e-8d0b-4da1-8bbd-796cc398a85e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.396838 Aug 29 11:02:29.526768 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2674/5361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:29 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:30.535660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:30.536348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:30.557458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:30.566201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:30.567007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:30.567943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:30.568794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:30.569243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:30.928810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:30.950526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec7c3d74-1318-453c-9064-df79663b0d87 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.418631 Aug 29 11:02:30.960888 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2688/5362] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:30 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:31.977839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:31.979738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:32.011911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:32.014067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:32.014775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:32.017180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:32.018265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:32.022255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:33.121927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:33.134637 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b0286229-cd2a-41e5-80fa-1c5b7319d146 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 1.165342 Aug 29 11:02:33.150989 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2675/5363] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:31 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:34.174649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:34.176411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:34.190152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:34.190953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:34.191658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:34.192591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:34.193278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:34.194278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:34.508245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:34.521643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c87d21f2-7c7b-4b95-8c0a-95fc819a0135 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.348749 Aug 29 11:02:34.525285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2689/5364] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:34 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:35.548054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:35.548805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:35.560581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=40 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:35.562848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:35.563639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:35.564445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:35.566088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:35.566502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:35.567088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:35.976091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:36.005178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e83e27c9-856f-46d5-aaad-aaf798737902 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.462089 Aug 29 11:02:36.006342 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2676/5365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:35 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:37.028067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:37.028865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:37.038697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:37.054534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:37.056854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:37.057764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:37.059103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:37.061834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:37.138754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=82 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:37.834891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:37.843821 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a6c8535-9530-4307-b471-d67b2ede6d58 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.821752 Aug 29 11:02:37.850077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2690/5366] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:37 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:38.865028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:38.866047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:38.923348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:38.925079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:38.927750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:38.929470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:38.934475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:38.935326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:39.534880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e663b4e4-72e9-4d00-92c0-536309c86bef", "name": "network-vif-plugged", "status": "completed", "tag": "c7f946de-4c0e-45f0-b183-17be8f939bc1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:39.546577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:39.557099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:39.561258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:39.562011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:39.590611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] Creating event network-vif-plugged:c7f946de-4c0e-45f0-b183-17be8f939bc1 for instance e663b4e4-72e9-4d00-92c0-536309c86bef on n-h2-854121-10 Aug 29 11:02:39.600945 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6d161dc5-01f9-4928-813d-417cce533f57 req-d666e46b-296c-4a03-93d1-866e8ece3faf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070222 Aug 29 11:02:39.604450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2691/5367] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:02:40.003683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:40.024251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa803b3a-afea-4678-a3bd-c2e55124c9d1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 1.158790 Aug 29 11:02:40.040990 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2677/5368] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:38 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:41.047039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:41.048508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:41.083352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:41.090464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:41.101822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:41.105322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:41.108201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:41.109602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:41.946918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:41.962954 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bbabfd26-e09b-413b-ab06-fdfea43e2651 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1314 microversion: 2.1 time: 0.920391 Aug 29 11:02:41.968752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2692/5369] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:41 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:42.988549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:42.989147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:43.011450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.011945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.014430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:43.015181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.015654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.016081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:43.408424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:43.419624 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ecbac5f2-087f-4b1c-b6eb-28bb9a6bc97c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1502 microversion: 2.1 time: 0.435003 Aug 29 11:02:43.420978 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2678/5370] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:42 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:43.442720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:43.443922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:43.453756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.454214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.454663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:43.455401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.456049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.456488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:43.534697 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6cecd6a8-1609-43ba-bcc2-623775227235 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef/action" status: 202 len: 0 microversion: 2.1 time: 0.096473 Aug 29 11:02:43.539808 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2693/5371] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:02:43 2022] POST /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:02:43.556452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:43.557090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:43.564659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.565495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.566287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:43.567190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:43.567800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:43.568369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:44.267624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:44.290265 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd64d035-40e5-46aa-9764-f96dd85fc2b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1507 microversion: 2.1 time: 0.737675 Aug 29 11:02:44.293592 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2679/5372] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:43 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1507 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:45.318573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:45.319281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:45.332009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:45.333665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:45.334338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:45.335075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:45.337742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:45.338743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:45.773571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:45.783643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9e01618-ba14-451b-89c7-d0819247b905 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1487 microversion: 2.1 time: 0.469775 Aug 29 11:02:45.786528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2694/5373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:45 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1487 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:45.814150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:45.814805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:45.835823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:45.837303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:45.838248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:45.839129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:45.846467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:45.847087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:45.893923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lazy-loading 'flavor' on Instance uuid e663b4e4-72e9-4d00-92c0-536309c86bef {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:02:46.216885 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f1021c2-2b54-4b07-b58b-928221d80011 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef/action" status: 202 len: 0 microversion: 2.1 time: 0.413518 Aug 29 11:02:46.221832 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2680/5374] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:02:45 2022] POST /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:02:46.233305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:46.233957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:46.256265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:46.256727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:46.257433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:46.264596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:46.264912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:46.267471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:46.870105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:46.890120 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e378423c-c75d-444b-934c-79cd3d8deb22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1493 microversion: 2.1 time: 0.664528 Aug 29 11:02:46.902035 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2695/5375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:46 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1493 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:47.925106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:47.927199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:47.941074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:47.956041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:47.957590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:47.959429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:47.960127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:47.965467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:48.436774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:48.457422 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0effecd8-eaea-49f1-ae0a-616ec0628342 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1514 microversion: 2.1 time: 0.544653 Aug 29 11:02:48.458828 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2681/5376] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:47 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:49.484452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:49.485213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:49.510736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:49.512855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:49.514303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:49.515252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:49.518240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:49.518888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:50.413069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:50.437020 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4ae9c54-0062-4946-b03c-17ebc126e621 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.960944 Aug 29 11:02:50.437668 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2696/5377] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:49 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:51.459966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:51.463024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:51.495823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:51.509676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:51.510396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:51.512578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:51.513452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:51.517501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:51.832551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e663b4e4-72e9-4d00-92c0-536309c86bef", "name": "network-vif-plugged", "status": "completed", "tag": "c7f946de-4c0e-45f0-b183-17be8f939bc1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:02:51.866954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:51.870285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:51.871053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:51.897560 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] Creating event network-vif-plugged:c7f946de-4c0e-45f0-b183-17be8f939bc1 for instance e663b4e4-72e9-4d00-92c0-536309c86bef on n-h2-854121-10 Aug 29 11:02:51.907730 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-677997e9-75a4-4fe5-84f7-124db73b8687 req-37957188-828c-4204-8916-d3b3619c8259 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079525 Aug 29 11:02:51.910448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2697/5378] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:02:52.209511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:52.220559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d479f11c-e1b4-4326-a235-c0d5ff7a21fd tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.765172 Aug 29 11:02:52.231973 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2682/5379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:51 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:53.250762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:53.252361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:53.291967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:53.293524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:53.294203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:53.295667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:53.295903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:53.296667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:53.773374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:53.789822 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02dfd9aa-1bfd-4c29-b38b-2cdd36761819 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.544688 Aug 29 11:02:53.790679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2698/5380] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:53 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:54.819487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:54.822392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:54.845688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:54.852332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:54.853024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:54.854067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:54.854694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:54.857636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:56.268323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:56.276805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:02:56.289872 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4afa083-dce9-4c36-a8ab-85502c53fb0a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.467769 Aug 29 11:02:56.290549 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2683/5381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:54 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:02:56.599330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:56.599883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:56.614904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:56.616172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:56.617489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:56.620774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:56.621653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:56.623606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:56.669251 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b75ebd60-618d-4c50-b923-520f2a74e7c9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/ips" status: 200 len: 152 microversion: 2.20 time: 0.075895 Aug 29 11:02:56.670488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2699/5382] 10.222.0.47 () {60 vars in 1289 bytes} [Mon Aug 29 11:02:56 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/ips => generated 152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:02:57.313213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:02:57.313960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:02:57.340483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:57.342662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:57.343462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:57.349983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:02:57.351430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:02:57.355535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:02:59.223198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:02:59.233084 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9deb0b46-62f6-44a9-8499-6d0ae7ee2d45 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.924233 Aug 29 11:02:59.241361 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2684/5383] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:02:57 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:00.263198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:00.263826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:00.283649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:00.284183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:00.284636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:00.288759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:00.290555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:00.293764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:01.366793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:01.387957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e7a95a4-5250-4f0f-af45-733f656faba0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.128343 Aug 29 11:03:01.393873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2700/5384] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:00 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:01.470774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:01.471733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:01.512896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:01.519481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:01.525672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:01.534585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:01.536827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:01.537462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:01.626247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lazy-loading 'flavor' on Instance uuid e99953b1-6158-488e-813e-a9da2a4b9b65 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:03:02.423873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:02.424806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:02.441400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:02.444538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:02.451595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:02.456652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:02.457356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:02.460133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:03.735432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:03.745106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b72fda46-8275-4838-b45a-38ae6bda0b22 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.328055 Aug 29 11:03:03.748793 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2701/5385] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:02 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:04.779927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:04.781298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:04.803384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:04.809175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:04.814964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:04.816273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:04.817913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:04.818619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:05.152738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:05.164777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d259f6bb-0a79-47e2-835c-7063c3b76fcf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.394051 Aug 29 11:03:05.170531 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2702/5386] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:04 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:06.191369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:06.192010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:06.213742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:06.214242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:06.223002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:06.224307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:06.224813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:06.225267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:07.369169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:07.372207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:07.394009 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb056fce-7b63-45a7-9f0a-ab04eaa35508 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.199680 Aug 29 11:03:07.394723 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2703/5387] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:06 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:08.415037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:08.415810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:08.434422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:08.434918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:08.435363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:08.436098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:08.436560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:08.436988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:09.516131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:09.534517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-952cb123-1ce2-45d5-9cad-fdbbeb4bd742 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 1.122904 Aug 29 11:03:09.550794 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2704/5388] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:08 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:10.558966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:10.568598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:10.592026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=28 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:10.607187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:10.608136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:10.610507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:10.611491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:10.613329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:10.615981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:11.093323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:11.103040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30ac74c9-7141-417f-9ddf-b09d7051eb6c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.550591 Aug 29 11:03:11.103618 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2705/5389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:10 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:11.507953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=19 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:11.859477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:12.123567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:12.125159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:12.143870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:12.144375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:12.155959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:12.160457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:12.164080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:12.171035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:12.675582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:12.686904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2895e323-a70c-4ff0-a107-78a12797ba4e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.567341 Aug 29 11:03:12.688965 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2706/5390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:12 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:13.727382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:13.729429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:13.741760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:13.743100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:13.743727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:13.745198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:13.746650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:13.747274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:14.258919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:14.274000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7af2828a-bdec-498a-996c-75d6fdc8c2cf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.559181 Aug 29 11:03:14.275457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2707/5391] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:13 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:15.309139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:15.314258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:15.330900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:15.332318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:15.334799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:15.338025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:15.345668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:15.346514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:15.579828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:15.595994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e2246af2-989e-4685-bd96-ea7b9cb7532a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.304115 Aug 29 11:03:15.597678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2708/5392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:15 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:16.622320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:16.623694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:16.639436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:16.639851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:16.640287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:16.655334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:16.656910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:16.659326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:17.320860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:17.338982 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa6e1624-1d29-4f92-a5cf-2d71bb8e74c9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.718752 Aug 29 11:03:17.341182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2709/5393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:16 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:18.374867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:18.376875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:18.417275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:18.418910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:18.425940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:18.433746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:18.439767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:18.442750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:19.174820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:19.188214 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df115cba-b11f-48f6-827e-705b29e3ea7f tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.827548 Aug 29 11:03:19.208396 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2710/5394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:18 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:20.171780 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-605b0863-5614-4886-b931-591f564aa19a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/action" status: 202 len: 0 microversion: 2.20 time: 18.691646 Aug 29 11:03:20.176671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2685/5395] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 11:03:01 2022] POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/action => generated 0 bytes in 18716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:03:20.185352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:20.186313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:20.194750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:20.195524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:20.196332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:20.197254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:20.198353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:20.199008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:20.221437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:20.222432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:20.249172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:20.254382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:20.255494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:20.268791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:20.285781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:20.287321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:20.792329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:20.801291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:20.815636 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d83f673-9622-4bd5-943d-c25203780300 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1509 microversion: 2.1 time: 0.598370 Aug 29 11:03:20.817200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:20.835085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2686/5396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:20 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:20.837549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:20.839141 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0ed0f6cd-bfee-49eb-9d45-9002156a4b06 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.657989 Aug 29 11:03:20.839874 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2711/5397] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:20 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:21.840670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:21.841497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:21.862803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:21.864787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:21.865584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:21.880844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:21.881821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:21.883150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:22.062928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1843902146", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "56f2e3d2-d18d-4e2f-bacf-d7c96127ed80"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:22.133919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] validate_networks() for [('56f2e3d2-d18d-4e2f-bacf-d7c96127ed80', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:03:22.277211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:22.302067 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-125acd87-4a6e-41b8-84be-966a1e26ace2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1506 microversion: 2.1 time: 0.464603 Aug 29 11:03:22.303475 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2712/5398] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:21 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:22.312002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:22.313268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:22.319993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:22.320799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:22.321389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:22.323854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:22.324488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:22.325076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:22.596658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:22.613237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:22.615766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:22.617503 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-847f44b8-874c-4475-b819-63fdf0e5b01e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.312411 Aug 29 11:03:22.618175 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2713/5399] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:22 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:22.902691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:03:22.903229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:03:22.904159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:03:22.904649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:03:22.905926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:03:22.916022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:22.916504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:22.916948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:22.917694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:22.918184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:22.918617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:22.940283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Getting quotas for project c3e61f6d56fa4f588c3e55d82ad37411. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:03:22.948586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Getting quotas for user 4de10c6dd2d3429b9d2d313432df0a35 and project c3e61f6d56fa4f588c3e55d82ad37411. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:03:22.963634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:03:22.966332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:03:23.026653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed21578f-b1e8-4a4e-98a2-e9518fadd58b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230038 Aug 29 11:03:23.027996 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2687/5400] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:03:23.041913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83dcdb8e-3c19-4a92-b5a7-968fefc7e389 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:23.043469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83dcdb8e-3c19-4a92-b5a7-968fefc7e389 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:23.312440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83dcdb8e-3c19-4a92-b5a7-968fefc7e389 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:23.323686 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83dcdb8e-3c19-4a92-b5a7-968fefc7e389 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1215 microversion: 2.1 time: 0.287473 Aug 29 11:03:23.324282 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2714/5401] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:23 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:23.327114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:23.328269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:23.349351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:23.353093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:23.374442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:23.375450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:23.376043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:23.376585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:23.641071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:23.641727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:23.658561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:23.659061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:23.659720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:23.660600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:23.661344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:23.661839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:23.764392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:23.785320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d8b105f-7be8-4cb9-96a6-5b0637f2e443 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1506 microversion: 2.1 time: 0.464165 Aug 29 11:03:23.786559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2688/5402] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:23 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:24.172047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:24.185629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:24.188064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:24.189364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f584f45-23b1-4819-b85e-8ba25bdcb04c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.552900 Aug 29 11:03:24.201736 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2715/5403] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:23 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:24.346205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:24.347772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:24.358330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:24.363265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:24.370422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:24.371954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:24.372602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:24.373317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:24.481520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:24.493324 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7e49474-c162-4cd7-9d18-f80c149b3602 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1211 microversion: 2.1 time: 0.151343 Aug 29 11:03:24.495261 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2689/5404] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:24 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:24.808499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:24.811998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:24.829401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:24.833291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:24.834037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:24.835138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:24.837292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:24.839347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:25.215900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:25.217132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:25.231481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:25.232186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:25.233311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:25.235461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:25.236242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:25.237682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:25.675281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:25.687179 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d744155a-b6d7-40b6-b68a-a00fac7dadea tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 200 len: 1449 microversion: 2.1 time: 0.883160 Aug 29 11:03:25.709853 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2716/5405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:24 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 1449 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:25.721501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e663b4e4-72e9-4d00-92c0-536309c86bef", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f946de-4c0e-45f0-b183-17be8f939bc1"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:25.732513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:25.733263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:25.733880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:25.758972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.server_external_events [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] Unable to find a host for instance e663b4e4-72e9-4d00-92c0-536309c86bef. Dropping event network-vif-unplugged {{(pid=128681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 11:03:25.767429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-dd18cc11-a567-4070-9904-58b7a0e01a8a req-9436d3fa-9e88-41f7-950e-0f0d491d88f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056178 Aug 29 11:03:25.775999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2717/5406] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 11:03:25.783715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:25.792251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:25.815621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:25.816011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:25.816457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:25.817258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:25.817891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:25.818109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:26.057869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.074966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-edf64822-cea4-4f8f-aa34-b253becc9975 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1273 microversion: 2.1 time: 0.297436 Aug 29 11:03:26.077526 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2718/5407] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:25 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:26.083026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:26.083831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:26.098993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:26.102234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:26.102870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:26.103958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:26.104630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:26.105214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:26.140774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.154849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.156587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.158028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5f24f8b-a347-42fa-869b-1f38157053f5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.946791 Aug 29 11:03:26.174376 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2690/5408] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:25 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:26.526720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.537285 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff1c4967-6650-487c-b1dc-7e5b280e7137 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.458454 Aug 29 11:03:26.558812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2719/5409] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:26 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:26.570300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:26.571320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:26.586539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:26.587162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:26.588019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:26.588671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:26.589250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:26.589990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:26.953384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:26.971956 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-71c6a659-f7da-4f36-81af-575bac229015 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.406453 Aug 29 11:03:26.994247 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2691/5410] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:26 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:27.010631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:27.011017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:27.018461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.019612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.020269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.021204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.021864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.023060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.096487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:27.097369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:27.119792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.120771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.121475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.122602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.123381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.124090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.371135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:27.393542 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c0b724e-41c0-4ad8-b5e6-5181c0391c66 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1273 microversion: 2.1 time: 0.301091 Aug 29 11:03:27.395249 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2692/5411] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:27 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:27.410143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:27.411281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:27.423084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.424424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.425341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.426859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.427959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.429124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.620538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:27.643339 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72a5882e-3411-4791-ada1-4bd838c7d023 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.636863 Aug 29 11:03:27.644303 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2720/5412] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:27 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:27.671580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:27.672877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:27.683563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.687831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.688515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.689875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:27.690780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:27.693090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:27.906227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:27.915478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:27.926589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:27.928129 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ffb1ef86-b502-45d3-b04e-97119295f77e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.531560 Aug 29 11:03:27.929436 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2693/5413] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:27 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:28.090966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:28.107373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e7443d4-789b-45f8-b9da-3c3690b24a62 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.440395 Aug 29 11:03:28.136229 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2721/5414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:27 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:28.137470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:28.147035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:28.147622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:28.148072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:28.227049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Going to try to stop instance {{(pid=128682) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 11:03:28.316080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d3c0f36-77f5-4684-be94-3d59b44518a6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.181927 Aug 29 11:03:28.316712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2694/5415] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:28 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:28.330645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:28.331281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:28.339207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:28.339714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:28.340164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:28.340896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:28.341368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:28.341835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:28.346334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:28.420149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:28.420858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:28.440226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:28.440975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:28.441576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:28.442672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:28.443293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:28.445547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:29.002455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:29.020478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2baaf0ab-ef83-487f-90c3-1520403c0aa3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.697949 Aug 29 11:03:29.027763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2722/5416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:28 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:29.036387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:29.037549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:29.048466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:29.048901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:29.050852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:29.054625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:29.058446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:29.059194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:29.110051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:29.120002 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3816c34-7d9a-454f-a470-fac617088f14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.704075 Aug 29 11:03:29.129983 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2695/5417] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:28 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:29.597092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:29.626798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:29.630003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:29.632106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3443c4f-85ce-4da1-a0e6-e4b365b33622 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.602343 Aug 29 11:03:29.651545 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2723/5418] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:29 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:30.057139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:30.057933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:30.066411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.067138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.067738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.069947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.073018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.074288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.141684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:30.142341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:30.156732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.157236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.157684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.158423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.166844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.167497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.774827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:30.787259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:30.797106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77b369c5-d98d-4206-8d5e-c0e6e2686178 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.658142 Aug 29 11:03:30.797743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2724/5419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:30 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:30.805150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:30.806377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:30.818478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e00350a-5fe1-4b23-9726-2e2e60fe0558 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.767343 Aug 29 11:03:30.825514 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2696/5420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:30 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:30.830063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.831781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.832225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.834110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.834639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.836323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.913066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6ab3f6-7062-48b1-ac97-1e7be49beabf", "tag": "be42a146-772c-4aed-944f-9e9af8d646b5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:30.927776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:30.928696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:30.935331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:30.976309 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] Creating event network-changed:be42a146-772c-4aed-944f-9e9af8d646b5 for instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf on n-h2-854121-10 Aug 29 11:03:30.992315 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f1c7dd13-d6e8-4310-ac3a-6605967a9224 req-69ca2836-a008-424a-b6bb-dd2f423e17db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082045 Aug 29 11:03:30.999377 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2697/5421] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:03:31.303144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:31.315356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:31.316830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:31.318098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a47fb8d-829e-4cf9-a98a-10a5f1cafbf1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.518140 Aug 29 11:03:31.330036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2725/5422] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:30 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:31.824853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:31.825925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:31.852878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:31.854161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:31.855453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:31.856045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:31.856917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:31.871460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:31.872757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:31.875900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:31.876425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:31.878415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:31.878547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:31.880594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:31.882510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:31.893295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:32.415232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:32.423354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:32.431029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e122847b-df63-4074-9e27-90b2760b5118 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.582527 Aug 29 11:03:32.441155 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2878765c-cb7e-4342-b1fe-e83887ecec7a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.623137 Aug 29 11:03:32.444912 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2698/5423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:31 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:32.446541 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2726/5424] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:31 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:32.466649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:32.471071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:32.497639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:32.500305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:32.501240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:32.502747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:32.504650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:32.507483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:32.926942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:32.956941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:33.472461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:33.473274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:33.485685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:33.497142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:33.509081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:33.514850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:33.523630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:33.528512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:33.532694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:33.671622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:33.730626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:33.732181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:33.738182 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73871dc4-0200-4696-ba7d-201d09c5501e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 1.285733 Aug 29 11:03:33.738911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2699/5425] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:32 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:33.760743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:33.761371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:33.772322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:33.773505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:33.774206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:33.775980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:33.776614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:33.777394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:34.179749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:34.190101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9eabf385-e30d-47d8-af43-9bcedd81b9e5 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.450058 Aug 29 11:03:34.209169 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2700/5426] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:33 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:34.269394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:34.285866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01ce8d4a-548f-4fa8-a107-78f38bbf086a tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.826459 Aug 29 11:03:34.287109 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2727/5427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:33 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:34.771172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:34.772163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:34.791966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:34.792554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:34.797447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:34.798789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:34.799285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:34.799731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:35.135509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:35.145570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:35.147849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:35.149608 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e29745a6-b47f-499c-af25-8ad9c66418d4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.382793 Aug 29 11:03:35.150476 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2701/5428] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:34 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:35.217273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:35.218019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:35.228471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:35.228972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:35.233617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:35.235061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:35.235241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:35.237430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:35.315560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:35.316338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:35.327902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:35.330240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:35.333667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:35.336048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:35.338483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:35.341091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:35.815278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:35.840381 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6ae9768-2566-4119-b13b-b9e4b8a3426a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.627192 Aug 29 11:03:35.849999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2728/5429] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:35 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:35.868517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:35.872697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:35.906131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0a7f1e4-f308-4e7a-88ff-4369c1d6fe0b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.601017 Aug 29 11:03:35.908526 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2702/5430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:35 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:36.180477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:36.181104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:36.194470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.195500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.196116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:36.200513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.201623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.207104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:36.576710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:36.586292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:36.587642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:36.589016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a319cbba-0890-428f-b5c0-4a75b855ad2f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.417301 Aug 29 11:03:36.612197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2729/5431] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:36 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:36.871320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:36.872054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:36.879305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.879796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.880241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:36.880953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.889948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.890898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:36.929593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:36.930117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:36.940615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.941130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.941587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:36.942348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:36.950469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:36.951170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:37.305836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:37.326440 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1bdadab-0986-4bdc-8505-9d6d558aa863 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.400969 Aug 29 11:03:37.327049 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2730/5432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:36 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:37.406639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:37.422686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f90dd1c-1389-46ee-99d2-7d7dfe98cf4b tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.555413 Aug 29 11:03:37.424823 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2703/5433] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:36 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:37.485442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ab3f6-7062-48b1-ac97-1e7be49beabf", "name": "network-vif-plugged", "status": "completed", "tag": "be42a146-772c-4aed-944f-9e9af8d646b5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:37.504830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:37.505558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:37.510266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:37.544261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] Creating event network-vif-plugged:be42a146-772c-4aed-944f-9e9af8d646b5 for instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf on n-h2-854121-10 Aug 29 11:03:37.550294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-eb2c0ece-80c5-483b-a728-ec3105003023 req-43e307d3-721d-4f46-bcf1-7c6227d9a1ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069032 Aug 29 11:03:37.552821 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2731/5434] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:03:37.620860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:37.621495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:37.633554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:37.634128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:37.634592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:37.635330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:37.639796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:37.640138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:37.934029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:37.943648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:37.948219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:37.950059 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-33493098-9db8-4e63-a0a4-ec579f88a42e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.334725 Aug 29 11:03:37.950809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2704/5435] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:37 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:38.348787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:38.349539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:38.364608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:38.365516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:38.367895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:38.370507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:38.371219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:38.372395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:38.444551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:38.445483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:38.455657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:38.464305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:38.465034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:38.466025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:38.467055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:38.467918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:38.775364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:38.790941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a7274c2-5afa-4ca1-80eb-a14bd4983607 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1679 microversion: 2.1 time: 0.446753 Aug 29 11:03:38.806421 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2732/5436] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:38 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:38.907391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:38.920531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e94dee0e-8bb9-42df-a076-c796986b5dc0 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1315 microversion: 2.1 time: 0.479916 Aug 29 11:03:38.928453 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2705/5437] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:38 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:38.982175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:38.983085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:38.999342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:38.999856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.000306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:39.001035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:39.001505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.008174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:39.552892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:39.567662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:39.571353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:39.573097 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df19dcac-9ba3-41ac-a0c3-178c7ac4ade1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.600549 Aug 29 11:03:39.576976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2733/5438] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:38 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:39.812911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:39.813538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:39.823355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:39.824107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.824745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:39.825646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:39.826287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.826881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:39.953831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:39.954434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:39.966937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:39.967444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.969596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:39.970841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:39.971332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:39.989450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:40.586697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:40.604442 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e0e4fe3-ac8a-4083-9876-bc952294daa6 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1656 microversion: 2.1 time: 0.795569 Aug 29 11:03:40.608176 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2706/5439] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:39 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1656 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:40.623789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:40.624841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:40.641743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:40.642629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:40.645304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:40.646462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:40.648326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:40.650086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:40.669881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:40.684303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-47592799-c053-45f3-ad44-6a3e321611eb tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1502 microversion: 2.1 time: 0.736227 Aug 29 11:03:40.686240 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2734/5440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:39 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1502 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:40.702453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:40.709054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=62 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:40.714556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:40.721667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:40.722165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:40.791733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Going to try to start instance {{(pid=128681) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 11:03:40.907323 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ee061fc2-f994-4b7c-9bfa-cc2b6cb297e0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.219267 Aug 29 11:03:40.909753 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2735/5441] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:40 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:40.918339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:40.919133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:40.940507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:40.941323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:40.941968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:40.942881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:40.943506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:40.944699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:41.298935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:41.315638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:41.317345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:41.319574 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2c1ce4d4-5a43-4dd6-8092-f620af7ff023 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.708949 Aug 29 11:03:41.320660 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2707/5442] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:40 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:41.326788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:41.328508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:41.336584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:41.337398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:41.338157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:41.339194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:41.340039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:41.340795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:41.583014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:41.597134 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fecf8b4-cd9a-4c10-9fc8-4642ffb8eaac tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1502 microversion: 2.1 time: 0.682959 Aug 29 11:03:41.601973 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2736/5443] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:40 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1502 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:41.627306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:41.638657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:41.670017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:41.673137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:41.676283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:41.676283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:41.677579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:41.678791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:41.762186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lazy-loading 'flavor' on Instance uuid 9a6ab3f6-7062-48b1-ac97-1e7be49beabf {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:03:41.894501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:41.956714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b57ba3b6-5a78-42a5-a95f-e7f829c54e01 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action" status: 202 len: 0 microversion: 2.1 time: 0.333141 Aug 29 11:03:41.961519 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2737/5444] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:41 2022] POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:41.981237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:41.983993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:41.999919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:42.001863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:42.001863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:42.002913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:42.003994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:42.004660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:42.048519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:42.062226 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-842c62c6-4ac6-4941-a25e-1f658b95eb75 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1665 microversion: 2.1 time: 0.739524 Aug 29 11:03:42.062819 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2708/5445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:41 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1665 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:42.346893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:42.348364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:42.359700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:42.361958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:42.364262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:42.371224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:42.372415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:42.373075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:42.373694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:43.415144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:43.429594 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fc1f53af-a4c8-4436-adbb-767a70162a21 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1510 microversion: 2.1 time: 1.462456 Aug 29 11:03:43.432695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2738/5446] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:41 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1510 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:43.446951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:43.448031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:43.463049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:43.464118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:43.466442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:43.467350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:43.468682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:43.470637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:43.505153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:43.517050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:43.524755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:43.527571 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da52142e-2cc9-4a28-8ca7-09a518b41797 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1744 microversion: 2.20 time: 1.184923 Aug 29 11:03:43.530288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2709/5447] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:42 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1744 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:43.734214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "name": "network-vif-plugged", "status": "completed", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:43.805326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:43.806918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:43.811954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:43.875136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] Creating event network-vif-plugged:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h1-854121-10 Aug 29 11:03:43.896160 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-59514622-31c8-4e4d-b97d-3c143c3a84fe req-d8db1604-37a2-4764-9974-cc8ceba67826 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166272 Aug 29 11:03:43.902545 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2710/5448] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:03:44.150284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:44.170497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bbfdea12-f99f-400e-86ee-42ca593265ec tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1665 microversion: 2.1 time: 0.736458 Aug 29 11:03:44.176093 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2739/5449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:43 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1665 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:44.456489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:44.457207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:44.476408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:44.477956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:44.479504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:44.481744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:44.482954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:44.485975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:44.552454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:44.553461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:44.574418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:44.574971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:44.575419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:44.576163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:44.576636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:44.577186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:45.332583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:45.343138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e335bb14-4689-466b-8a4d-d1f41b5ebde8 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1493 microversion: 2.1 time: 0.891554 Aug 29 11:03:45.348177 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2711/5450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:44 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1493 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:45.357551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:45.361586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:45.380209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:45.380713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:45.383850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:45.385059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:45.385556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:45.394931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:46.720745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:46.734707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:46.747628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:46.750924 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fcb250c-8111-4c3c-ad49-fd76046ff97c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 2.201029 Aug 29 11:03:46.751707 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2740/5451] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:44 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:46.761035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:46.774264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:46.793416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:46.794947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:46.795390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:46.796121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:46.796594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:46.797083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:46.863635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:46.877407 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78afe2b1-4225-49f5-9a3a-aaa8ecf0d3c4 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.527161 Aug 29 11:03:46.878508 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2712/5452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:45 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:46.910169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:46.912952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:46.935766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:46.938481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:46.939675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:46.940681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:46.944693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:46.946491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.046394 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02d7921e-9815-4834-bc47-4e4771e24dfc tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action" status: 202 len: 0 microversion: 2.1 time: 0.291206 Aug 29 11:03:47.048001 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2741/5453] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:46 2022] POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:47.066546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:47.067449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:47.081335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.086648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.087391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.088319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.094609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.100444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.768392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:47.780316 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49bd3cee-c811-44e8-9528-13a58ba61755 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.881520 Aug 29 11:03:47.780933 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2713/5454] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:46 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:47.791650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:47.796302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:47.811568 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e6c36158-f0c7-44a6-bb6c-94172d23c1c6 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1499 microversion: 2.1 time: 0.757086 Aug 29 11:03:47.812202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2742/5455] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:47 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1499 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:47.825567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:47.841129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:47.848140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.848642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.849203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.853196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:47.854808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.858514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.858989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.876668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.877366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.877850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:47.878577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:47.880944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:47.882614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:48.598497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:48.606548 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72c7cae4-0ead-4578-9fd9-205c36be272c tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.772073 Aug 29 11:03:48.626997 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2743/5456] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:47 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:48.634785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:48.635568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:48.642712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:48.643407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:48.643852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:48.644638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:48.645111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:48.646305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:48.677436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:48.696020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:48.697805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:48.699019 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f79c6d32-f421-4f29-9df2-0db1625ba8e5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.917140 Aug 29 11:03:48.699598 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2714/5457] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:47 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:48.841875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:48.843443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:48.873513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:48.878116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:48.879786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:48.886080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:48.890818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:48.892783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:49.572702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:49.594977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91854b3a-e9d3-4fd6-965b-c3016b51a7a8 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.966717 Aug 29 11:03:49.595604 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2744/5458] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:48 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:49.622280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:49.632853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:49.633007 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0647f7f-36f3-4dd0-81c9-bf0574779c14 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1499 microversion: 2.1 time: 0.795527 Aug 29 11:03:49.639272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:49.660318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:49.661492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2715/5459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:48 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1499 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:49.664596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:49.665606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:49.666667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:49.671064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:49.672646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:49.726985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:49.727670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:49.755906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:49.756580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:49.757162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:49.757944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:49.758416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:49.758854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:50.730112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:50.762214 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d3e5b04-336e-4825-aed8-4954bf2fe926 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 1.144437 Aug 29 11:03:50.781880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2745/5460] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:49 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:50.806308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:50.814641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:50.830104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:50.835566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:50.836839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:50.838015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:50.840658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:50.843328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:50.843955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:50.848396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:50.850598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:50.851980 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-617c7f3d-710d-4727-87de-7e272c9b2d01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 1.132858 Aug 29 11:03:50.856426 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2716/5461] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:49 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:50.863867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:50.865407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:50.875357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:50.877025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:50.878527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:50.880003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:50.880634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:50.882008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:50.919095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lazy-loading 'flavor' on Instance uuid 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:03:51.245044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-173cde40-719d-48e3-816a-70abefbcecbe tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.385931 Aug 29 11:03:51.246612 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2717/5462] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:50 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:51.265241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:51.267532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:51.279155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.280994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.281868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:51.282960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.283620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.285303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:51.319415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:51.436395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:51.480540 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8af471e-f07f-47c9-91b2-ceb07f4b92ed tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1502 microversion: 2.1 time: 0.694944 Aug 29 11:03:51.481495 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2746/5463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:50 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1502 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:51.510783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:51.511640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:51.532386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.532912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.533253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:51.534033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.534486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.534914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:51.616872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lazy-loading 'flavor' on Instance uuid 9a6ab3f6-7062-48b1-ac97-1e7be49beabf {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:03:51.801773 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eac167ee-a121-42c7-953e-ee133f6b0373 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action" status: 202 len: 0 microversion: 2.1 time: 0.294831 Aug 29 11:03:51.806277 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2747/5464] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:51 2022] POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:03:51.823426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:51.825190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:51.841072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.841840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.843326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:51.844515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:51.845305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:51.846058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:52.153279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:52.164605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ce055a7-c55d-4c2c-8f3d-07d8a18b9cc3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1677 microversion: 2.1 time: 0.913939 Aug 29 11:03:52.169718 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2718/5465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:51 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1677 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:52.185735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:52.186548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:52.199023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:52.199648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:52.200188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:52.201011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:52.201553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:52.203831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:52.517174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:52.539358 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7eedd6e7-b4d8-4ad5-a306-cb41e5ddf24e tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1510 microversion: 2.1 time: 0.728445 Aug 29 11:03:52.543906 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2748/5466] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:51 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1510 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:52.783356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:52.799967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:52.808440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:52.811752 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6faf6b7-bc06-4087-9ba1-57ed7fc27c01 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.640908 Aug 29 11:03:52.813644 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2719/5467] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:52 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:53.196339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:53.198032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:53.215241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.216153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.217278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.218276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.220043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.220693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.544953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:53.556912 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dd9dcb49-5f10-4a98-a113-f7c3705bead3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1660 microversion: 2.1 time: 0.369881 Aug 29 11:03:53.559393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2749/5468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:53 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1660 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:53.567700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:53.568838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:53.578566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:53.579381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:53.585290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.587667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.588128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.588896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.589358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.589837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.597839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.598336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.598772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.600391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.602054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.602735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.640343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:03:53.722741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d62538c4-1c16-40f6-b784-eea376a84546 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action" status: 202 len: 0 microversion: 2.1 time: 0.147166 Aug 29 11:03:53.724188 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2750/5469] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:53 2022] POST /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:03:53.772719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:53.775785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:53.818963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.818963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.823362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:53.824178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:53.824679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:53.828329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:54.921204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:54.940672 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ef7f0a1-706e-422f-84fd-bac560ce6d11 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1666 microversion: 2.1 time: 1.197373 Aug 29 11:03:54.941715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2751/5470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:53 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1666 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:54.958764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:54.960120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:54.969254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:54.969947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:54.970497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:54.982692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:54.983536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:54.984207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.075205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:55.085135 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9146032c-0bc9-4535-ad83-cb82179de767 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1493 microversion: 2.1 time: 1.521615 Aug 29 11:03:55.094879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2720/5471] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:53 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1493 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:55.119095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:03:55.120016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:55.128989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.131529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.137616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.138661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.139355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.140098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.289069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-275ce2ab-71b1-40c1-897a-d1c010332bfe tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action" status: 202 len: 0 microversion: 2.1 time: 0.174469 Aug 29 11:03:55.290511 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2721/5472] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:03:55 2022] POST /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:03:55.303602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:55.305292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:55.322188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.323093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.324863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.326190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.330111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.331547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.928856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:55.944863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:55.947211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:55.951106 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d477daed-3ddd-4f98-8c99-ba9b689abe85 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 1.008209 Aug 29 11:03:55.952353 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2752/5473] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:54 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:55.969379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:55.970968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:55.983107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.985923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.986559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:55.988459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:55.989930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:55.991707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:56.086930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:56.100392 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-386b61e6-cf8e-456c-9a2b-b217f87cf8ea tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1499 microversion: 2.1 time: 0.805091 Aug 29 11:03:56.106175 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2722/5474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:55 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1499 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:56.776326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:56.788619 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-22dacd7f-cac7-4bdc-8a84-7bbd62f16698 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1666 microversion: 2.1 time: 0.823573 Aug 29 11:03:56.802042 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2753/5475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:55 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1666 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:56.978260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:56.979449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:57.000629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.001123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.001560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.002354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.002817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.003243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.129653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:57.131066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:57.139921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.140778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.141480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.142433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.143099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.143749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.643552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:57.659304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:57.661135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:57.663321 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-94adcf44-6f1e-409e-8dd1-26442ee84f4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.689099 Aug 29 11:03:57.666518 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2723/5476] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:56 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:03:57.810910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:57.811892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:57.825838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.829156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.829752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.831737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:57.834989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:57.837819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:57.863303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:57.875346 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b6dfc679-7697-40ae-af7b-3fa0095a14f3 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1499 microversion: 2.1 time: 0.750579 Aug 29 11:03:57.885116 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2754/5477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:57 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1499 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:58.392412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:58.407278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f3693e3b-39fd-4b64-ad5a-24ffbebaec52 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.598469 Aug 29 11:03:58.424910 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2724/5478] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:57 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:58.430405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:58.431174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:58.451954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:58.452716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:58.454080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:58.455812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:58.457020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:58.457195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:58.691775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:58.692426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:58.701819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:58.702293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:58.707947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:58.710140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:58.711336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:58.713650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.028340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:59.058300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b360e51d-2aa5-4a49-80a9-3e69f095f732 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1669 microversion: 2.1 time: 0.632437 Aug 29 11:03:59.074645 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2755/5479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:58 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1669 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:03:59.082525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:59.083412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:59.090980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.091740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.092340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.093246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.093916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.095109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.120352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:59.128870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:59.130633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:59.133245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab5caab5-e7f2-476c-986c-c8c68ee5a54f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.448648 Aug 29 11:03:59.134335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2725/5480] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:03:58 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:03:59.139521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:59.140195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:59.147878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.148978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.150075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.150992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.151661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.152253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.199977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:03:59.210501 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.api [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Working on deleting snapshot c0b1cc4b-506a-48f0-8650-7f47c7ab6c88 from shelved instance... Aug 29 11:03:59.421644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:03:59.440302 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-449b600a-6a8c-4cc0-b61d-dcb8e97bd977 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1502 microversion: 2.1 time: 0.364145 Aug 29 11:03:59.441684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2756/5481] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:59 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1502 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:03:59.469929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:59.470820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:59.487998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.488973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.489871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.491404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.494827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.496794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.569333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:03:59.798865 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c73137a-8cf3-4ac4-a1e9-17f517d168b4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 204 len: 0 microversion: 2.1 time: 0.327266 Aug 29 11:03:59.800116 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2757/5482] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:03:59 2022] DELETE /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:03:59.823068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:03:59.838967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:03:59.849068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.851715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.852383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:03:59.853441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:03:59.854246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:03:59.855894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:00.510261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Doing local delete in cell 63165a55-b78c-49ff-95c5-fdaa65ea00cf(cell1) {{(pid=128682) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 11:04:00.517947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:00.518466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:00.518922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:00.519370 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.api [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 11:04:00.522301 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [425e721c-3ee3-427f-816b-2a01f0feb536] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:04:01.009751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:01.041133 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27e8de34-63a8-4849-8468-9f0c425874ae tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1508 microversion: 2.1 time: 1.235552 Aug 29 11:04:01.042701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2758/5483] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:03:59 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1508 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:01.050057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:01.051335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:01.059789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:01.060451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:01.061205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:01.064299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:01.066096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:01.070015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:01.540222 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [425e721c-3ee3-427f-816b-2a01f0feb536] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43648. Aug 29 11:04:01.548671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] deallocate_for_instance() {{(pid=128682) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 29 11:04:01.736799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:01.749468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:01.756455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:01.761436 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43f29cf0-97c5-4f9d-b218-013a4f59a8c0 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.717347 Aug 29 11:04:01.764561 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2759/5484] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:01 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:02.071634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:02.073311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:02.084734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:02.085833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:02.086743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:02.088706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:02.095303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:02.097534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:02.977162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:03.008950 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-411a5478-5dee-45b4-84ed-b52023e1594a tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1508 microversion: 2.1 time: 0.940294 Aug 29 11:04:03.035189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2760/5485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:02 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1508 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:03.043374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:03.044252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:03.064423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:03.066332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:03.071267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:03.072682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:03.073804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:03.074402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:03.906007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Updating instance_info_cache with network_info: [] {{(pid=128682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 11:04:04.314074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:04.323672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:04.325132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:04.348228 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e88346a-3b99-4f89-a34e-9ae2d76cef45 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 1.311270 Aug 29 11:04:04.378707 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2761/5486] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:03 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:04.411582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:04.426310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:04.444974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:04.449113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:04.451402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:04.452191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:04.454512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:04.464978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:04.829531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7fc97489-335a-42b0-bff3-9d283a84b641 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 204 len: 0 microversion: 2.1 time: 5.692458 Aug 29 11:04:04.835895 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2726/5487] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:03:59 2022] DELETE /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 0 bytes in 5697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:04.855168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e663b4e4-72e9-4d00-92c0-536309c86bef", "name": "network-vif-deleted", "tag": "c7f946de-4c0e-45f0-b183-17be8f939bc1"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:04.905465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:04.908014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:04.908565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:04.935718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_external_events [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] Unable to find a host for instance e663b4e4-72e9-4d00-92c0-536309c86bef. Dropping event network-vif-deleted {{(pid=128682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 11:04:04.939128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f3acbad4-e604-4327-b70d-063f9cbfe869 req-8eaccfd8-ab45-444d-8da4-f72de0d19516 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.100961 Aug 29 11:04:04.940010 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2727/5488] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 11:04:04.954447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:04.955644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e663b4e4-72e9-4d00-92c0-536309c86bef] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:04.967381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:04.967690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:04.968153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:04.992882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:04.994466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:04.994982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.036526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef HTTP/1.1 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e663b4e4-72e9-4d00-92c0-536309c86bef'} Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:05.041539 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. Aug 29 11:04:05.047695 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:05.051961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 404 to user: Instance e663b4e4-72e9-4d00-92c0-536309c86bef could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:05.057502 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f3719d7-d087-491a-bebf-fdddb8b140c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef" status: 404 len: 111 microversion: 2.1 time: 0.115570 Aug 29 11:04:05.058421 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2728/5489] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:04 2022] GET /compute/v2.1/servers/e663b4e4-72e9-4d00-92c0-536309c86bef => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:04:05.078699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:05.079679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:05.089987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.090718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.091450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.092426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.093540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.095447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.138700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:05.144154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:04:05.322287 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9cd4a189-3e7b-4076-b709-0efed9ce087b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 204 len: 0 microversion: 2.1 time: 0.258774 Aug 29 11:04:05.327744 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2729/5490] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:04:05 2022] DELETE /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:05.345279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:05.352489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:05.393551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.398250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.399515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.405451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.406573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.408466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.604866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:05.620281 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10a75166-9d68-457b-ae1b-8ee26dfd26a4 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1508 microversion: 2.1 time: 1.240283 Aug 29 11:04:05.635914 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2762/5491] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:04 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1508 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:05.642562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:05.643445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:05.651140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.651873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.652510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.653409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:05.654266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:05.654866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:05.884660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:05.907496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-658d716a-e627-455b-b0d9-d411398e07b0 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1465 microversion: 2.1 time: 0.577990 Aug 29 11:04:05.914997 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2730/5492] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:05 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1465 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:06.037907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:06.048959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:06.050934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:06.053159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d96ff05d-aa95-47cf-a6a6-e87e4af7e0c4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.415173 Aug 29 11:04:06.054421 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2763/5493] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:05 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:06.648198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:06.649296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:06.660547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:06.661364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:06.665829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:06.666964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:06.667650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:06.668275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:06.739187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:06.741230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:06.744425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:06.745152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lazy-loading 'fault' on Instance uuid 9a6ab3f6-7062-48b1-ac97-1e7be49beabf {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:04:06.886476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de10c6dd2d3429b9d2d313432df0a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e61f6d56fa4f588c3e55d82ad37411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:06.916766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-05753b28-128c-460c-aec4-58025e799837 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 200 len: 1305 microversion: 2.1 time: 0.273297 Aug 29 11:04:06.923432 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2731/5494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:06 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:06.939141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:06.940425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:06.958274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:06.959338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:06.961286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:06.998803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:06.999683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.000445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:07.081147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:07.081955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:07.103215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:07.110013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.110637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:07.111500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:07.116869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.117605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:07.347585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:07.351360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:07.365616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5860bbf0-602a-4753-b2ef-86f2c770b31d tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1465 microversion: 2.1 time: 0.430173 Aug 29 11:04:07.371575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2764/5495] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:06 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1465 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:07.388519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ab3f6-7062-48b1-ac97-1e7be49beabf", "name": "network-vif-deleted", "tag": "be42a146-772c-4aed-944f-9e9af8d646b5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:07.435890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:07.444617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.445098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:07.464200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] Creating event network-vif-deleted:be42a146-772c-4aed-944f-9e9af8d646b5 for instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf on n-h2-854121-10 Aug 29 11:04:07.480154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-993b6732-feb6-427a-85f9-639da7b1f792 req-d3fbcd57-71cb-48c4-b682-7a9f7795a6dc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095648 Aug 29 11:04:07.481197 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2765/5496] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:07.950552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:07.951275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] [instance: 9a6ab3f6-7062-48b1-ac97-1e7be49beabf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:07.974100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:07.975177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.977461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:07.978447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:07.980422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:07.985391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:08.034866 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] HTTP exception thrown: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Request method failure captured: Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf HTTP/1.1 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJz1iZEC7Oi52kLi3aVJwAYZH1AtpLt2HSJ0CE3tW2jwZsKg2yjv8KAiZkgCk5yZPyWXqtGF66SHYapTqlDoiOt4xW5RVkBO1bvqf-QISPaLmAm8hzcYRDiWf9fAV8juUBGVVp4d9Q2bfArWDQkOnpGKkNdZhL9owEGrN9sw3rqfb_E Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c3e61f6d56fa4f588c3e55d82ad37411 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestServerAdvancedOps-1439429361 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c3e61f6d56fa4f588c3e55d82ad37411"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c3e61f6d56fa4f588c3e55d82ad37411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c3e61f6d56fa4f588c3e55d82ad37411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c3e61f6d56fa4f588c3e55d82ad37411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestServerAdvancedOps-1439429361 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c3e61f6d56fa4f588c3e55d82ad37411 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestServerAdvancedOps-1439429361 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestServerAdvancedOps-1439429361-project Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4de10c6dd2d3429b9d2d313432df0a35 Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestServerAdvancedOps-1439429361-project Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9a6ab3f6-7062-48b1-ac97-1e7be49beabf'} Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:08.036718 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] Returning 404 to user: Instance 9a6ab3f6-7062-48b1-ac97-1e7be49beabf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:08.040792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33fe878d-0c70-4286-8a9a-1e0842b20838 tempest-TestServerAdvancedOps-1439429361 tempest-TestServerAdvancedOps-1439429361-project] 10.222.0.47 "GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf" status: 404 len: 111 microversion: 2.1 time: 0.092652 Aug 29 11:04:08.049119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2766/5497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:07 2022] GET /compute/v2.1/servers/9a6ab3f6-7062-48b1-ac97-1e7be49beabf => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:04:08.396657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:08.398562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:08.418635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:08.421511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:08.424622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:08.430139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:08.431219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:08.433792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:08.669076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:08.681362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e3e5ea32-a3d1-4ed9-95f9-2a2869e6f544 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1465 microversion: 2.1 time: 0.292941 Aug 29 11:04:08.689423 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2767/5498] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:08 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1465 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:08.746378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:08.758655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:08.766912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:08.768169 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0e4b7c1-9cc7-4ec9-a2fb-c15083981723 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 1.692178 Aug 29 11:04:08.773336 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2732/5499] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:07 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:09.511629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dfd964-6d94-4881-9eb8-73a83928fdfc", "name": "network-vif-deleted", "tag": "9cb3bc8f-e197-4843-8b1a-14602c71e988"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:09.536419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.539753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.542114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.577649 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] Creating event network-vif-deleted:9cb3bc8f-e197-4843-8b1a-14602c71e988 for instance 61dfd964-6d94-4881-9eb8-73a83928fdfc on n-h2-854121-10 Aug 29 11:04:09.597670 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e36cce36-0053-42f9-98d2-6abcf0fe9d4d req-d103d849-970d-4640-8a65-7465b89838f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090377 Aug 29 11:04:09.621370 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2768/5500] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:09.715714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:09.716264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:09.731790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.732314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.732772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.734899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.735376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.738317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.801257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:09.802333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:09.813220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.815453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.816105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.818511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.819235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.821470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.884577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:09.885862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:09.895651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:09.896559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lazy-loading 'fault' on Instance uuid 61dfd964-6d94-4881-9eb8-73a83928fdfc {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:04:10.106060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:10.122567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58da4c42-04c7-4941-b42e-406e2f2811a3 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 200 len: 1304 microversion: 2.1 time: 0.411650 Aug 29 11:04:10.123594 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2733/5501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:09 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 1304 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:10.267288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:10.281485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:10.283109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:10.285341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf6d9180-2925-4639-a3db-1ada881b5585 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1739 microversion: 2.20 time: 0.488714 Aug 29 11:04:10.287876 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2769/5502] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:09 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1739 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:04:11.144565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:11.145185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 61dfd964-6d94-4881-9eb8-73a83928fdfc] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:11.160403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.160908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.161353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.162156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.162612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.174400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.211751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc HTTP/1.1 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '61dfd964-6d94-4881-9eb8-73a83928fdfc'} Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:11.213483 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 404 to user: Instance 61dfd964-6d94-4881-9eb8-73a83928fdfc could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a935ce0-d118-42a2-a417-5a813cef7b67 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc" status: 404 len: 111 microversion: 2.1 time: 0.074197 Aug 29 11:04:11.217462 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2734/5503] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:11 2022] GET /compute/v2.1/servers/61dfd964-6d94-4881-9eb8-73a83928fdfc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:04:11.224792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:11.226063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:11.234161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:11.236605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.237394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.238124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.239065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.240441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.241232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.299996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:04:11.313666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:11.314707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:11.326199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.341635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.342381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.343377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.344015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.344452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.493445 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43fe4972-185c-4f19-a3c4-41b45f95c2ce tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 204 len: 0 microversion: 2.1 time: 0.272819 Aug 29 11:04:11.494636 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2770/5504] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:04:11 2022] DELETE /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:11.507545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:11.508271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:11.514964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.515859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.516928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.517913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:11.518597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:11.519220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:11.928216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:11.937641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:11.939993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:11.941688 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1c9dff1-1422-4722-89c6-839855ceaf8c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1721 microversion: 2.20 time: 0.631888 Aug 29 11:04:11.942958 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2735/5505] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:11 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1721 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:04:12.100482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:12.109017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e71591e-6379-4210-9312-24acab8d6734 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1508 microversion: 2.1 time: 0.606947 Aug 29 11:04:12.127106 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2771/5506] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:11 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1508 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:12.978155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:12.979392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:13.000166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:13.006042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:13.010944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:13.011891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:13.016673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:13.017677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:13.020142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:13.143946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:13.144573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:13.164903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:13.175874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:13.176514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:13.178072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:13.178819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:13.179444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:13.648644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:13.674583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:13.676397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:13.677824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7ce9b68-f538-4f67-a4e2-7df2a2a8ba40 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1721 microversion: 2.20 time: 0.705100 Aug 29 11:04:13.691446 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2736/5507] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:12 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1721 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:13.767947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:13.793408 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8f256d8-9f1c-4c92-b14a-2d82bdf461b2 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1508 microversion: 2.1 time: 0.644402 Aug 29 11:04:13.795214 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2772/5508] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:13 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:04:14.712589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:14.715707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:14.746342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:14.746836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:14.747388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:14.748285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:14.748896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:14.749524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:14.815672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:14.817282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:14.834292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:14.834822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:14.835313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:14.836156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:14.836718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:14.837378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:16.054851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:16.064741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb8c4754-65fb-4b5f-85b6-ac84f04722c1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 200 len: 1466 microversion: 2.1 time: 1.252891 Aug 29 11:04:16.068722 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2773/5509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:14 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 1466 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:04:16.083641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e408b892-3e22-4781-9cd7-c7f2e78a9980", "name": "network-vif-deleted", "tag": "743bf234-fdc1-48cc-b14e-2b8223019469"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:16.108295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:16.109055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:16.109949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:16.123697 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] Creating event network-vif-deleted:743bf234-fdc1-48cc-b14e-2b8223019469 for instance e408b892-3e22-4781-9cd7-c7f2e78a9980 on n-h1-854121-10 Aug 29 11:04:16.131616 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b19c52aa-4baf-4cd7-b7d7-eec68a478394 req-006e8a93-902c-4394-91a1-6c7ac7a3679d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061175 Aug 29 11:04:16.132581 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2774/5510] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:16.138294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "name": "network-vif-unplugged", "status": "completed", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:16.153449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:16.154392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:16.156094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:16.172694 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] Creating event network-vif-unplugged:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h1-854121-10 Aug 29 11:04:16.181919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b54f412e-b6c4-4c81-a6aa-632693ed2fcc req-555ebe48-1cd3-4085-9e31-da085ad60a0c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047513 Aug 29 11:04:16.183580 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2775/5511] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:16.419223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:16.432875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:16.434440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:16.438494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee64590b-0cfc-41af-a33d-480f757b5c27 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1721 microversion: 2.20 time: 1.735659 Aug 29 11:04:16.439020 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2737/5512] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:14 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1721 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:17.094884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:17.095752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e408b892-3e22-4781-9cd7-c7f2e78a9980] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:17.117831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.120436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.122100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.123479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.129048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.129518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.153026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 HTTP/1.1 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e408b892-3e22-4781-9cd7-c7f2e78a9980'} Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:17.155397 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. Aug 29 11:04:17.159632 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:04:17.161369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 404 to user: Instance e408b892-3e22-4781-9cd7-c7f2e78a9980 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:17.167766 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25a28f52-7f33-437b-a2c6-a531d98d3529 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980" status: 404 len: 111 microversion: 2.1 time: 0.078722 Aug 29 11:04:17.175743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2776/5513] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:17 2022] GET /compute/v2.1/servers/e408b892-3e22-4781-9cd7-c7f2e78a9980 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:04:17.203304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:17.203823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:17.223615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.230968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.231610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.232546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.234050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.234870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.286802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:04:17.425978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81616752-686a-4af7-8b1f-ce23cfe3e509 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 204 len: 0 microversion: 2.1 time: 0.236640 Aug 29 11:04:17.426643 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2738/5514] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:04:17 2022] DELETE /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:17.436297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:17.438676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:17.445811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.446824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.448090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.449052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.449994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.450640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.468984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:17.469691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:17.486313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.486827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.487276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.494179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:17.494742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:17.495188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:17.950157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:17.959861 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbc949c1-a2f8-4dc2-8f30-ae34bc330e36 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1496 microversion: 2.1 time: 0.528164 Aug 29 11:04:17.977293 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2777/5515] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:17 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1496 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:18.035409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:18.048298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:18.055197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:18.056882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41c6a5e7-7198-4b3f-adc9-1cf28cf5fde4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1664 microversion: 2.20 time: 0.594010 Aug 29 11:04:18.063034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2739/5516] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:17 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1664 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:18.084865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6d9f38b-d6a5-498f-8ade-799c4f18221d"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:18.088495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:18.095307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:18.096480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:18.097094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:18.098001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:18.098620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:18.100076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:18.744636 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7be60a0f-5a39-4bdf-b4f0-a6ca38c2c8e7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.664679 Aug 29 11:04:18.745259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2778/5517] 10.222.0.47 () {62 vars in 1364 bytes} [Mon Aug 29 11:04:18 2022] POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments => generated 188 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:04:18.996178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:18.996861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:18.998004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:18.998590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:19.013068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.013565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.014039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.015835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.016339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.016782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.017498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.017985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.023795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.025511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.026944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.031300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.219242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:19.235119 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ae816e5-287a-4eff-b73b-9f74357c703e tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1454 microversion: 2.1 time: 0.252028 Aug 29 11:04:19.252334 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2740/5518] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:18 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1454 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:19.311185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:19.541353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e243f21f-961d-46b0-b737-de55006a0242", "name": "network-vif-deleted", "tag": "777032bd-bbca-4f54-9dee-e72e8bf5b808"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:19.565598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.570815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.571307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.618927 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] Creating event network-vif-deleted:777032bd-bbca-4f54-9dee-e72e8bf5b808 for instance e243f21f-961d-46b0-b737-de55006a0242 on n-h1-854121-10 Aug 29 11:04:19.624894 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2134e1f7-5bc7-4148-bfdf-169810a08290 req-7ad96628-8668-43c5-bbb8-f4d9508e50c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089632 Aug 29 11:04:19.629017 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2741/5519] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:19.705055 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98875263-7761-410b-9e13-0480750bb5c3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments/b6d9f38b-d6a5-498f-8ade-799c4f18221d" status: 202 len: 0 microversion: 2.20 time: 0.719411 Aug 29 11:04:19.705757 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2779/5520] 10.222.0.47 () {60 vars in 1457 bytes} [Mon Aug 29 11:04:18 2022] DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments/b6d9f38b-d6a5-498f-8ade-799c4f18221d => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:19.866150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:19.867833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:19.891428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.891947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.892400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:19.893137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:19.893596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:19.911990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.057299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128682) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 11:04:20.164170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:20.232143 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-181f81d5-d5e3-4379-b063-85d82cc36b9a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/action" status: 202 len: 0 microversion: 2.20 time: 0.369411 Aug 29 11:04:20.238083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2742/5521] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 11:04:19 2022] POST /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:20.242489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:20.243250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:20.260961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:20.262077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:20.265506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:20.268538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:20.269354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.272487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:20.273151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:20.274987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.304475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:20.305075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:20.306271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.309934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:20.311557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:20.313068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.449330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:20.450131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:20.450778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:20.454751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lazy-loading 'fault' on Instance uuid e243f21f-961d-46b0-b737-de55006a0242 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:04:20.680069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:20.690711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e9a5e42-930e-4aac-a35f-dbcc42df7cdf tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 200 len: 1305 microversion: 2.1 time: 0.435502 Aug 29 11:04:20.691638 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2743/5522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:20 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 1305 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:04:20.816116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:20.852125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:20.856451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:20.864783 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa84aaa7-94a8-4d11-bc82-a6a22003b226 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1672 microversion: 2.20 time: 0.623243 Aug 29 11:04:20.866774 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2780/5523] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:20 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1672 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:21.715769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:21.717584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: e243f21f-961d-46b0-b737-de55006a0242] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:21.730779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.732908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.734009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:21.736856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.738579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.741186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:21.790882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 HTTP/1.1 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e243f21f-961d-46b0-b737-de55006a0242'} Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:21.798866 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. Aug 29 11:04:21.804047 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:21.808086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 404 to user: Instance e243f21f-961d-46b0-b737-de55006a0242 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:21.809228 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ab11481-d6e8-4124-91c3-13a7f6342b23 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242" status: 404 len: 111 microversion: 2.1 time: 0.100366 Aug 29 11:04:21.812826 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2744/5524] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:21 2022] GET /compute/v2.1/servers/e243f21f-961d-46b0-b737-de55006a0242 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:04:21.823425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:21.823983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:21.840239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.844781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.846325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:21.846701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.847192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.847729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:21.895181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:21.897083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:21.908444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.911846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.912702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:21.913488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:04:21.913609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:21.914126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:21.914564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:22.149769 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-848e962f-9172-49f3-99e8-e93a5ec7365b tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 204 len: 0 microversion: 2.1 time: 0.331986 Aug 29 11:04:22.150410 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2781/5525] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:04:21 2022] DELETE /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:04:22.173311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:22.174091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:22.205940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:22.206689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:22.207151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:22.215251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:22.217363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:22.219379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:22.268356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:22.279326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:22.288483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:22.289917 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8a76463-a011-4d3e-ab21-45ad36cbcaa7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1672 microversion: 2.20 time: 0.399453 Aug 29 11:04:22.292165 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2745/5526] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:21 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:23.330072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:23.330072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:23.334214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:23.334214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:23.334214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:23.341852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:23.343317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:23.344744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:23.360565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:23.393298 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ffe459d-4511-4d53-bcf2-c8673c221013 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1675 microversion: 2.1 time: 1.218496 Aug 29 11:04:23.398468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2782/5527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:22 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1675 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:04:24.341734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:24.357094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:24.361104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:24.368106 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-279427c2-2c7e-4f1c-95a7-177561126b81 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1672 microversion: 2.20 time: 1.049271 Aug 29 11:04:24.368956 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2746/5528] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:23 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1672 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:24.425207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:24.428559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:24.454281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:24.457079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:24.458930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:24.463477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:24.464291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:24.466471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:25.276159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:25.296612 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd31ed21-68f4-4276-9169-417ddc8f7636 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1675 microversion: 2.1 time: 0.877109 Aug 29 11:04:25.313963 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2783/5529] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:24 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1675 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:25.393532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:25.394065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:25.414431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:25.416134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:25.416779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:25.421600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:25.422360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:25.423251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:26.305794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:26.328217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:26.329975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:26.331209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-79c2de91-66af-424d-9d04-c6b71d9086ce tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 0.943447 Aug 29 11:04:26.331778 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2747/5530] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:25 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:26.340114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:26.340815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:26.357146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:26.357748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:26.358275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:26.359069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:26.359626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:26.360133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:27.094438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:27.111941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b80406ce-0e64-4be1-8ae5-5e4b23b35eb1 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1607 microversion: 2.1 time: 0.775622 Aug 29 11:04:27.112543 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2784/5531] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:26 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1607 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:27.354725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:27.355532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:27.364056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:27.365784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:27.367452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:27.368430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:27.369094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:27.369927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:27.765959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a6ae2b-2bf1-4cf2-9517-b8236cfefdac", "name": "network-vif-deleted", "tag": "7290defa-cf6b-439f-97a9-c1a5d3391ed0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:27.808433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:27.808976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:27.809431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:27.861275 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] Creating event network-vif-deleted:7290defa-cf6b-439f-97a9-c1a5d3391ed0 for instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac on n-h1-854121-10 Aug 29 11:04:27.878806 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a1cd6df4-319e-46c1-b995-cafc7091ca34 req-ca1c64a8-d4b5-4deb-9335-0af155703994 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122565 Aug 29 11:04:27.886946 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2785/5532] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:04:28.140549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:28.141468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:28.162720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:28.166729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:28.170114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:28.171189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:28.178513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:28.179359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:28.388115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:28.388616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:28.389128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:28.389594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lazy-loading 'fault' on Instance uuid 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:04:28.680034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ee70745b4b47d1bb6729d0ed653adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46a3ee5766d416cbd8bf2295ddd5816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:28.691738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-844437e2-2530-4f04-8599-b646e9a6acd9 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 200 len: 1327 microversion: 2.1 time: 0.560923 Aug 29 11:04:28.695284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2786/5533] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:28 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 1327 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:04:28.712500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:28.752568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:28.771686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:28.780613 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f48c8607-d970-4c79-a95a-0e3481da5426 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.429608 Aug 29 11:04:28.789319 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2748/5534] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:27 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:29.576650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:29.628944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:29.629419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:29.636035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:29.689235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] Creating event network-changed:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h2-854121-10 Aug 29 11:04:29.704719 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9892ffeb-7730-4d55-a3e5-b66955bb5212 req-a30376da-949c-4dfa-a6f7-7723c9a07a96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131494 Aug 29 11:04:29.707108 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2787/5535] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:29.719667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:29.720280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] [instance: 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:29.735342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:29.735715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:29.740341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:29.741364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:29.742056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:29.742678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:29.775923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] HTTP exception thrown: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Request method failure captured: Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac HTTP/1.1 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJrxUH2CvZMYlEttkxkXZM4bbQ32KBwIAf2itIH9JeiuI2izg6gcA_lR_AQRbHgiJbmN9LV0AkCIZl02uhDMYzxAPIxlfo8AHyU-VV6KY6Scy_ES0CErAztexRlQCFK_ODN4Ijp8Iti-dSVcHgPMi-xY_tmgwTakvdfLGsuGSZdAS2Y Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f46a3ee5766d416cbd8bf2295ddd5816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: f46a3ee5766d416cbd8bf2295ddd5816 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-120703521 Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 92ee70745b4b47d1bb6729d0ed653adc Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-120703521-project Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '63a6ae2b-2bf1-4cf2-9517-b8236cfefdac'} Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:04:29.782355 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. Aug 29 11:04:29.787934 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:04:29.790067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Returning 404 to user: Instance 63a6ae2b-2bf1-4cf2-9517-b8236cfefdac could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:04:29.791320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7db06ced-5b8a-4b37-8881-61dac3e38c04 tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac" status: 404 len: 111 microversion: 2.1 time: 0.075918 Aug 29 11:04:29.794835 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2749/5536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:04:29 2022] GET /compute/v2.1/servers/63a6ae2b-2bf1-4cf2-9517-b8236cfefdac => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:04:29.807300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-673a5448-4f91-414a-920b-d8a0b48292fa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] Calling method '.version_select at 0x7f66cb13edc0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:29.820208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:29.830227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:29.858349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:29.860405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:29.861418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:29.867492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:29.870172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:29.872828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:29.877406 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-673a5448-4f91-414a-920b-d8a0b48292fa tempest-ServerActionsTestJSON-120703521 tempest-ServerActionsTestJSON-120703521-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777544132" status: 202 len: 0 microversion: 2.1 time: 0.072711 Aug 29 11:04:29.880799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2788/5537] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 11:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777544132 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:04:31.645807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:31.656158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:31.661663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:31.672735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6dd57591-434e-446f-bc7d-4d96a0abd133 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.857440 Aug 29 11:04:31.674238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2750/5538] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:29 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:04:32.705591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:32.712594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:32.738626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:32.743070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:32.743786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:32.744785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:32.748954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:32.749478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:33.388354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:33.407935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:33.409400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:33.425442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dacf3283-c554-404c-ae3d-9eafe7ec42f3 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 0.724797 Aug 29 11:04:33.442084 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2789/5539] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:32 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:34.456568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:34.458281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:34.479817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:34.485227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:34.485791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:34.493468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:34.494072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:34.494538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:35.800407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:35.817726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:35.836236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:35.840041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fcb206bc-8b3d-4c09-8ca3-1652d1fe392e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.388252 Aug 29 11:04:35.851567 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2751/5540] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:34 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:36.869567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:36.870285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:36.886622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:36.887129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:36.887607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:36.888348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:36.888814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:36.889250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:38.214722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:38.232816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:38.242572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:38.243937 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-498ad158-a9a5-45fd-bdb3-f429f675cfe8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.378532 Aug 29 11:04:38.273200 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2790/5541] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:36 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:39.280813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:39.281578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:39.304939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:39.311164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:39.311758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:39.320095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:39.321205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:39.323780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:40.853407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:40.864866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:40.881337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:40.895597 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b1cf431-b856-4ee5-814f-0f1789bf5d4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.618119 Aug 29 11:04:40.896115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2752/5542] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:39 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:41.923278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:41.923897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:41.927884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:41.954696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:41.957784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:41.961720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:41.963470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:41.968024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:41.971404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:43.531848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:43.560782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:43.562789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:43.564315 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-af2f3d20-af4d-4a2f-b2ff-28bb944376c7 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.645773 Aug 29 11:04:43.565522 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2791/5543] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:41 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:44.591705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:44.593083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:44.603780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:44.609627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:44.611909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:44.615922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:44.616996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:44.617880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:44.618496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:46.015278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:46.030061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:46.031817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:46.038195 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03b85354-5bd4-4236-880e-ab0c69add718 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.447111 Aug 29 11:04:46.038894 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2753/5544] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:44 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:04:47.064967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:47.067190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:47.083694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:47.086015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:47.086793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:47.091360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:47.092147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:47.093058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:49.439251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:49.448201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=77,nova_cell1:UPDATE=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:49.460521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:49.470777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:49.476450 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32b40616-2249-4146-9ada-128ae42adfb4 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 2.415819 Aug 29 11:04:49.494457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2792/5545] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:47 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:50.508610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:50.512076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:50.525554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:50.531811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:50.535195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:50.536483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:50.538272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:50.541165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:50.604744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:04:51.493114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:51.510923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:51.515274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:51.524956 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1261d427-b5a4-4935-9665-a3cd0229068c tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.021827 Aug 29 11:04:51.530918 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2754/5546] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:50 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:52.555600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:52.557033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:52.583005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:52.583834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:52.585580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:52.588670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:52.591407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:52.592861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:53.010952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1672020893", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": "none"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:53.149013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:04:53.149442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:04:53.149946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:04:53.150358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:04:53.150774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:04:53.182620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:53.183114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:53.183563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:53.184367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:53.184831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:53.185261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:53.229716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Getting quotas for project 81a56da07dad4d0883b71cc89ac6a48d. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:04:53.249663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Getting quotas for user 4eb82dd1a66f4b22bfbba34c82602e05 and project 81a56da07dad4d0883b71cc89ac6a48d. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:04:53.299063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:04:53.305566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:04:53.405556 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e7a98107-def5-4bde-a645-9060317afc60 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.682610 Aug 29 11:04:53.407086 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2755/5547] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 29 11:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 11:04:53.425189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:53.427810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:53.901692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:53.914821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:53.919657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:53.922425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70c6e2b6-db01-47d8-98bc-386c2cad1b7f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1281 microversion: 2.47 time: 0.505118 Aug 29 11:04:53.926328 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2756/5548] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:53 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1281 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:54.050799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:54.067402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:54.069187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:54.086395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ddd22ef-529a-4888-9c9c-c2c3160eb1fd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.537634 Aug 29 11:04:54.094159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2793/5549] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:52 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:54.953788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:54.954834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:54.968228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:54.968726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:54.970212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:54.970212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:54.970422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:54.986395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:55.124785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:55.126049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:55.138010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:55.140975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:55.141868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:55.142908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:55.146274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:55.146983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:56.142262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.154684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.157273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.160910 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4ee2810-d6a3-4e60-96b7-9d4611588f68 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1333 microversion: 2.47 time: 1.210557 Aug 29 11:04:56.167834 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2757/5550] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:54 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1333 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:56.720892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c677c07-2afa-45f9-854c-35913298307d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Action: 'create', calling method: .version_select at 0x7f66c5b7cee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1847755968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJVi2qw7b0y8q5VbP9AHRDYZQr0Q+hN3gCTFZYKTiOznAXWQfmdXaarUtqm1jYZLqLc8IJxkx5TQa2TxvyGYH1ZiaWbCLruVUUAEkCd/fV0+IWjEGq6WIoBlEXN86mllw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:56.760171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.771673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.775070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5c677c07-2afa-45f9-854c-35913298307d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for project 324addf743cd4496aee6b8c87fe58c17. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:04:56.782521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:56.783926 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b8b1b99-6901-40f9-baa8-a78eb374b0b1 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.670990 Aug 29 11:04:56.793733 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2794/5551] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:55 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:56.797949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5c677c07-2afa-45f9-854c-35913298307d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for user 758ff8fafb5b4dae86f5e5fdfd3e4ab2 and project 324addf743cd4496aee6b8c87fe58c17. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:04:56.883063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c677c07-2afa-45f9-854c-35913298307d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.384130 Aug 29 11:04:56.890618 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2758/5552] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:04:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:04:57.198638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:57.199590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:57.225447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:57.228565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:57.229330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:57.230600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:57.231392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:57.232169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:57.463754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:57.478039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:57.482848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:57.486259 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d04b07a-c890-417b-8e90-0156c2f5182f tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1339 microversion: 2.47 time: 0.296043 Aug 29 11:04:57.503079 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2795/5553] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:57 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1339 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:57.810533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:57.811686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:57.849620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:57.852859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:57.854316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:57.857807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:57.858621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:57.859358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:58.513855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:58.515239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:58.522828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.529650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:58.530204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:58.532007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:58.532913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:58.533392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:58.535373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.535940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:58.536958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.541439 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ecd8be9a-9193-439c-9063-a5961f5825fb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 0.737050 Aug 29 11:04:58.542063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2759/5554] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:57 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:04:58.703413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.717558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.719484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:58.725944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60d0a1e8-4399-4f42-9e6f-96cc68cae72c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1360 microversion: 2.47 time: 0.217159 Aug 29 11:04:58.748681 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2796/5555] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:58 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:04:58.756146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1900284490"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:04:58.758688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:58.769556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:58.770100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:58.770548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:58.771278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:58.771740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:58.780546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.230410 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c217b86c-5a87-4d14-93cb-3c5ea39c22e8 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "POST /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af/action" status: 202 len: 52 microversion: 2.47 time: 0.478580 Aug 29 11:04:59.244465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:59.244974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:59.246948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2760/5556] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 29 11:04:58 2022] POST /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af/action => generated 52 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 29 11:04:59.258153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.259764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.262519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.263646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.264804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.267333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.344758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:04:59.450898 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d33d39c-785e-465d-8a7f-f4f23b4d4508 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 204 len: 0 microversion: 2.47 time: 0.207396 Aug 29 11:04:59.451884 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2797/5557] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 11:04:59 2022] DELETE /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 11:04:59.463282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:59.464286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:59.479947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.482352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.484270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.486943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.489002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.489654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.569362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:04:59.571378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:04:59.585775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.586850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.602468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.603645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:04:59.604290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:04:59.604902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:04:59.806431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:59.828033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:59.835894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:04:59.846155 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-002f2236-dcb4-4373-8d18-c26c55e5f9ad tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1366 microversion: 2.47 time: 0.384747 Aug 29 11:04:59.847000 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2761/5558] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:59 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:00.769883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "name": "network-vif-plugged", "status": "completed", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:00.790363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:00.791370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:00.793908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:00.823706 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] Creating event network-vif-plugged:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h2-854121-10 Aug 29 11:05:00.833320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b6a25f06-f5a7-4e55-b888-53c379167fa7 req-fbc953b5-5069-407c-8f0a-f8d61d3d5197 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065837 Aug 29 11:05:00.834725 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2762/5559] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:00.881927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:00.883062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:00.899648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:00.900334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:00.900944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:00.901859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:00.902477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:00.903256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:01.166174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.176634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.196619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.198026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06e2c18d-f950-4b26-bfd7-94ed62ab50b8 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.635980 Aug 29 11:05:01.199048 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2798/5560] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:04:59 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:01.309435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.319013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.325520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:01.327041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9b75245-9e0f-49ef-b5c9-cf7807991efd tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1366 microversion: 2.47 time: 0.456796 Aug 29 11:05:01.333493 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2763/5561] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:00 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:05:01.355592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd293494-61ce-4617-ace4-e46e030f8959 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: .version_select at 0x7f66c75059d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1319027575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtFKabx8ovn4VwASNGbY89AkwmKa0/h/g5nvxrqQjdswnAQjB+063O0kNdm9Uo6+68yF0ScniXPbFz8vPWPT7I6vzFDZqCt7KBtbtY/z26ZNbr4zT5V6O9p4OTPbhIQxQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:01.384279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fd293494-61ce-4617-ace4-e46e030f8959 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:05:01.405473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fd293494-61ce-4617-ace4-e46e030f8959 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:05:01.477373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd293494-61ce-4617-ace4-e46e030f8959 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.148543 Aug 29 11:05:01.484955 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2799/5562] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:05:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:02.215740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1743215894", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1847755968", "security_groups": [{"name": "tempest-secgroup-smoke-800383997"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "03f377de-8dd7-4bb1-a72d-ada024ea99dc"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:02.228575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:02.229376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:02.240977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:02.241487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:02.241969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:02.242697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:02.243166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:02.273504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:02.549806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] validate_networks() for [('03f377de-8dd7-4bb1-a72d-ada024ea99dc', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:05:03.077504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.101352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.109448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.110998 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bbca6d7f-3ae5-4180-bdb7-71838968317a tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 0.886945 Aug 29 11:05:03.115477 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2800/5563] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:02 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:03.120682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:03.131056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:03.146817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:03.147698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:03.152627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:03.153644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:03.154306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:03.154901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:03.208014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:03.220467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:03.220980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:03.225638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:03.227487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lazy-loading 'fault' on Instance uuid d1c1edae-107b-4969-94e5-c5637198d3af {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:05:03.352010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.363814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.373925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eb82dd1a66f4b22bfbba34c82602e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a56da07dad4d0883b71cc89ac6a48d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:03.375689 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-38f9282c-5a55-4be0-a674-2bd4bb862e3c tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 200 len: 1371 microversion: 2.47 time: 0.258908 Aug 29 11:05:03.385484 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2801/5564] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:03 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:04.146042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:04.147919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:04.166070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:04.166970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:04.167752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:04.169138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:04.172432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:04.173499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:05.197685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for project 324addf743cd4496aee6b8c87fe58c17. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:05:05.219195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for user 758ff8fafb5b4dae86f5e5fdfd3e4ab2 and project 324addf743cd4496aee6b8c87fe58c17. Resources: dict_keys(['metadata_items']) {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:05:05.248222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:05.270741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:05:05.272978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:05:05.273488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:05:05.276257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:05:05.276716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:05:05.278620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:05.281865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:05.285036 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7dbb0444-7ca4-4f21-8034-4ba41dac7ce5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1730 microversion: 2.20 time: 1.144861 Aug 29 11:05:05.287251 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2802/5565] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:04 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1730 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:05.296614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:05.297946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] [instance: d1c1edae-107b-4969-94e5-c5637198d3af] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:05.309663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:05.310191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:05.310638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:05.313283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:05.314527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:05.314992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:05.316699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:05.317901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:05.319346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:05.321151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:05.322597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:05.324455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:05.366708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for project 324addf743cd4496aee6b8c87fe58c17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:05:05.370540 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] HTTP exception thrown: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Request method failure captured: Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af HTTP/1.1 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ1UbqqnWrvtCRK7YRo1pxBnNQ3PdgaqYJprmEUqUEp0lxPR7Bh4rpP3sAvOseHDZK-_7yauo_pnUUx1El8ZFJKxAwEJMScEoOJX55BDW2EBFjpUyeJuxHE7JkQsk5tWQ5Kkuf-HdJrlSN562FR-F0t2VlvzOBHLZ9nN8WxmXrFso84 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 81a56da07dad4d0883b71cc89ac6a48d Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAaction247Test-1486145995 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/81a56da07dad4d0883b71cc89ac6a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_81a56da07dad4d0883b71cc89ac6a48d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/81a56da07dad4d0883b71cc89ac6a48d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/81a56da07dad4d0883b71cc89ac6a48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAaction247Test-1486145995 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 81a56da07dad4d0883b71cc89ac6a48d Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAaction247Test-1486145995 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAaction247Test-1486145995-project Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4eb82dd1a66f4b22bfbba34c82602e05 Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAaction247Test-1486145995-project Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd1c1edae-107b-4969-94e5-c5637198d3af'} Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:05.374867 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. Aug 29 11:05:05.385023 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:05.386869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Getting quotas for user 758ff8fafb5b4dae86f5e5fdfd3e4ab2 and project 324addf743cd4496aee6b8c87fe58c17. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:05:05.391683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] Returning 404 to user: Instance d1c1edae-107b-4969-94e5-c5637198d3af could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:05.395420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c07855eb-485b-4c34-b71a-aa8f132a4853 tempest-ServersAaction247Test-1486145995 tempest-ServersAaction247Test-1486145995-project] 10.222.0.47 "GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af" status: 404 len: 111 microversion: 2.47 time: 0.106395 Aug 29 11:05:05.397854 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2803/5566] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:05 2022] GET /compute/v2.1/servers/d1c1edae-107b-4969-94e5-c5637198d3af => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 11:05:05.425298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:05:05.432941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:05:05.489323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-132957140", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2eca09d6-42f2-4cc5-ae0f-70aa5aad2fd8"}], "key_name": "tempest-TestNetworkBasicOps-1319027575", "security_groups": [{"name": "tempest-secgroup-smoke-469392407"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:05.560025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-710ddcb1-2e26-43eb-9bf5-39b02c130887 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.348070 Aug 29 11:05:05.564898 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2764/5567] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:05:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:05:05.577185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b02866c4-2f24-4656-9a94-569a0a292278 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:05.577896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b02866c4-2f24-4656-9a94-569a0a292278 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:05.718462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b02866c4-2f24-4656-9a94-569a0a292278 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:05.726751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b02866c4-2f24-4656-9a94-569a0a292278 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1303 microversion: 2.1 time: 0.154045 Aug 29 11:05:05.739606 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2765/5568] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:05 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:05.811765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] validate_networks() for [('2eca09d6-42f2-4cc5-ae0f-70aa5aad2fd8', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:05:06.351490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:06.352498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:06.373678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:06.374321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:06.374820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:06.376406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:06.377255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:06.379037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:06.707252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:05:06.707848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:05:06.708688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:05:06.709337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:05:06.709944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:05:06.726446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:06.729157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:06.730587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:06.733474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:06.736395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:06.737033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:06.782444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:05:06.790484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:05:06.811156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:05:06.814209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:05:06.902123 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b0444a3-3e6f-4474-b65d-7c9b609922ee tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.415246 Aug 29 11:05:06.902123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2804/5569] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:05:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:05:06.915131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2889363e-9fd8-4500-a9b5-b7230cac60f4 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:06.918864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2889363e-9fd8-4500-a9b5-b7230cac60f4 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:07.368097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:07.383080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:07.384537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:07.385771 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ed99466-16b8-44ef-a7df-7db64e4b5b4f tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1717 microversion: 2.20 time: 1.048387 Aug 29 11:05:07.386345 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2766/5570] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:06 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1717 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:07.395398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-553eb9b6-93e7-4357-8e68-c9a7b501db65 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:07.415896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-553eb9b6-93e7-4357-8e68-c9a7b501db65 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:07.811157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-553eb9b6-93e7-4357-8e68-c9a7b501db65 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:07.831478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-553eb9b6-93e7-4357-8e68-c9a7b501db65 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1248 microversion: 2.1 time: 0.440318 Aug 29 11:05:07.849221 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2767/5571] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:07 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1248 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:07.854473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2889363e-9fd8-4500-a9b5-b7230cac60f4 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:07.863438 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2889363e-9fd8-4500-a9b5-b7230cac60f4 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1303 microversion: 2.1 time: 0.961105 Aug 29 11:05:07.874743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2805/5572] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:06 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1303 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:08.855207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:08.855678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:08.871010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:08.871499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:08.871954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:08.872786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:08.879966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:08.880624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:08.884965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:08.885589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:08.901937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:08.906227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:08.906854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:08.912103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:08.912774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:08.918343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:09.058381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:09.074534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a81e580-0ac9-4bf4-9a54-b45ee92d1858 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1300 microversion: 2.1 time: 0.223959 Aug 29 11:05:09.081037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:09.091461 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa99d9bf-1805-4043-af93-d09aa346f243 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1361 microversion: 2.1 time: 0.210291 Aug 29 11:05:09.092711 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2768/5573] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:08 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:09.096244 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2806/5574] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:08 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:10.100902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:10.102251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:10.117435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:10.118130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:10.124261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:10.124772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:10.125196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:10.137332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:10.137865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:10.138323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:10.139057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:10.139524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:10.139963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:10.142927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:10.143442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:10.144767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:10.457877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:10.475391 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-111a773f-26cc-4559-b7b6-9a01528aa09c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1306 microversion: 2.1 time: 0.375571 Aug 29 11:05:10.491964 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2769/5575] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:10 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1306 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:10.492800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:10.503949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b384ce5-7fdc-4852-86ce-6648cf5aefc2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1361 microversion: 2.1 time: 0.390324 Aug 29 11:05:10.505057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2807/5576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:10 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:11.509754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:11.511485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:11.525327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:11.526674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:11.536685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:11.537195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:11.539558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:11.541589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:11.542666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:11.544635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:11.545315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:11.545801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:11.546562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:11.546804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:11.547038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:11.551317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:12.241083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:12.249338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a06c2aee-68c6-4639-8597-f056a2132aa3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.727623 Aug 29 11:05:12.252714 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2808/5577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:11 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:12.340722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:12.351746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8001d15-8b54-43aa-8178-b113729d7d78 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.852128 Aug 29 11:05:12.358056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2770/5578] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:11 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:13.274726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:13.276231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:13.283461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:13.298094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:13.302275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:13.302923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:13.306012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:13.306717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:13.308516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:13.381081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:13.381693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:13.395771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:13.396269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:13.396712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:13.397423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:13.411667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:13.412575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:13.654091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:13.664052 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4fc354a6-0e33-4a54-aef1-656e93e75b42 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.395257 Aug 29 11:05:13.682277 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2809/5579] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:13 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:13.961941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:13.984441 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27553289-be98-443d-b59e-59297f2a5f17 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.606262 Aug 29 11:05:13.986018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2771/5580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:13 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:14.373419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f490ac73-3579-4a3b-8022-c3df535cb26b", "tag": "bf307c65-3340-40fc-b46c-dad9b99f4ed5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:14.390094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:14.390907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:14.402202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:14.421356 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] Creating event network-changed:bf307c65-3340-40fc-b46c-dad9b99f4ed5 for instance f490ac73-3579-4a3b-8022-c3df535cb26b on n-h1-854121-10 Aug 29 11:05:14.435709 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-11bdf721-6fab-4b90-917b-387c46f78e15 req-298c20d2-dd4e-4fbb-ae64-3bed3bf89fc2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065866 Aug 29 11:05:14.436338 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2810/5581] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:14.688820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:14.691881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:14.702093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:14.726867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:14.734258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:14.734787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:14.735570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:14.736058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:14.736509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:14.932374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f885c335-1663-4f6d-a7e2-09b61c6aef36", "tag": "862e538f-162a-4344-84aa-35ed619aba43"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:14.958233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:14.959096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:14.959778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:14.990308 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] Creating event network-changed:862e538f-162a-4344-84aa-35ed619aba43 for instance f885c335-1663-4f6d-a7e2-09b61c6aef36 on n-h1-854121-10 Aug 29 11:05:14.995571 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f57655dc-8d6a-463b-911c-a45ff98f7aad req-960bb6cf-44de-41a7-92e9-0185e0c81ad5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067379 Aug 29 11:05:14.996560 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2811/5582] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:05:15.006187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:15.010648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:15.025691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:15.026710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:15.027405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:15.028367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:15.030537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:15.031271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:15.042966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:15.060731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:15.071954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d81eff1-6d1f-4eb4-8c60-491562707dec tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.387001 Aug 29 11:05:15.073350 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2772/5583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:14 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:15.667205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:15.684978 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aaed54db-ecca-4a89-b16c-db910b184593 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.681949 Aug 29 11:05:15.687393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2812/5584] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:15 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:16.120666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:16.124522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:16.133942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:16.140858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:16.141538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:16.142145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:16.142900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:16.144294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:16.150073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:16.708445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:16.709068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:16.719713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:16.720366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:16.722715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:16.723978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:16.724422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:16.724958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:16.725605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:16.735743 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a539ac72-3068-417b-8329-6e5ee19a5cfd tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.640452 Aug 29 11:05:16.736350 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2773/5585] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:16 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:16.772437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:17.664553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:17.683876 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f3eaa78-6cc0-402c-b93c-d24def892538 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.974968 Aug 29 11:05:17.684941 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2813/5586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:16 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:17.757781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:17.759208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:17.770212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:17.774515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:17.779451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:17.780604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:17.781313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:17.782241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:17.827643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=26 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:18.710788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:18.712106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:18.715917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=12 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:18.733787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:18.734524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:18.735165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:18.736096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:18.736763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:18.738466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:18.914305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:18.927468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c0434b6-e32c-4c38-860a-fcc208f8b001 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 1.172352 Aug 29 11:05:18.928208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2774/5587] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:17 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:19.407438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:19.416695 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-45922a6f-5323-4f98-8ea7-158c379c755c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.710384 Aug 29 11:05:19.421303 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2814/5588] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:18 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:19.950801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:19.951837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:19.964796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:19.965622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:19.971998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:19.973125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:19.973862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:19.975025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:20.019097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:20.282209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:20.298630 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-632f8cbf-b9a9-4ad7-b036-b32011f8238a tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.351692 Aug 29 11:05:20.300154 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2775/5589] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:19 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:20.445414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:20.447009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:20.466683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:20.467484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:20.468109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:20.469027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:20.469677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:20.470383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:21.073109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:21.087442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58adfdde-cfa0-47d8-ba7a-72310edd2b67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.648602 Aug 29 11:05:21.105968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2815/5590] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:20 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:21.322006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:21.322812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:21.336073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:21.340169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:21.341243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:21.343970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:21.344795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:21.352088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:22.115033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:22.116662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:22.139423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:22.143202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:22.145096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:22.147466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:22.148797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:22.149580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:22.452535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:22.468816 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc228b7c-b73c-493e-ae7a-3a49ac90e0ac tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 1.150434 Aug 29 11:05:22.471527 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2776/5591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:21 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:22.554598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:22.574281 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d8c7a2d3-46a5-4d61-b633-bcf4a79b5c66 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.463901 Aug 29 11:05:22.576579 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2816/5592] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:22 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:23.493988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:23.495460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:23.516836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:23.521272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:23.523605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:23.524585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:23.527397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:23.528163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:23.599250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:23.599885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:23.611049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:23.611560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:23.612207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:23.613295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:23.628618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:23.631643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:24.122506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:24.135471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-75972cd5-ce20-44f7-9553-065039f9e49a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.538576 Aug 29 11:05:24.154077 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2817/5593] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:23 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:24.362932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:24.387207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0fea6e6-147a-4141-abfc-b10b0089d2a9 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.898899 Aug 29 11:05:24.390803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2777/5594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:23 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:25.159634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:25.161236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:25.173397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:25.175439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:25.181397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:25.182929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:25.183695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:25.184327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:25.410099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:25.410902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:25.426399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:25.427838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:25.428497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:25.429127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:25.430965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:25.432756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:25.434206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:25.439155 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c24e3cd9-d93e-483f-9018-d952dedb7769 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.284963 Aug 29 11:05:25.440967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2818/5595] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:25 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:25.775592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:25.791534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68448b55-54a8-4cc2-98f1-5ee67fde8811 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.383246 Aug 29 11:05:25.798096 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2778/5596] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:25 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:26.463480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:26.464797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:26.479600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:26.480203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:26.480745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:26.481589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:26.494760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:26.498476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:26.758034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:26.798415 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f7b17e0f-1aa7-4c42-b0f0-f1bd089136d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.338350 Aug 29 11:05:26.803315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2819/5597] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:26 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:26.810438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f490ac73-3579-4a3b-8022-c3df535cb26b", "name": "network-vif-plugged", "status": "completed", "tag": "bf307c65-3340-40fc-b46c-dad9b99f4ed5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:26.843127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:26.851851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:26.859802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:26.865333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:26.866033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:26.878717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:26.880181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:26.880647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:26.881489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:26.884188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:26.884791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:26.895039 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] Creating event network-vif-plugged:bf307c65-3340-40fc-b46c-dad9b99f4ed5 for instance f490ac73-3579-4a3b-8022-c3df535cb26b on n-h1-854121-10 Aug 29 11:05:26.914427 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d603c8d8-3498-4b45-861d-d03e1867b329 req-82bf249f-3275-45c1-9945-51dcec172fcf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108773 Aug 29 11:05:26.915582 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2779/5598] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:27.284659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1935568050", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "18d6076e-8812-4083-a043-79571c14afbf"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:27.287253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:27.307108 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-038ad7e2-a9cb-49dd-9477-c034368a640d tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.487783 Aug 29 11:05:27.307729 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2820/5599] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:26 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:27.369809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] validate_networks() for [('18d6076e-8812-4083-a043-79571c14afbf', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:05:27.828630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:27.829261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:27.858318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:27.861203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:27.873097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:27.874239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:27.874852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:27.875413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:28.735046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:28.751644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e7247df-0ac0-422f-b4bb-2bdfce7cf85b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1373 microversion: 2.1 time: 0.925627 Aug 29 11:05:28.766162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2821/5600] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:27 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1373 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:28.781254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:28.782092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:28.790933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:28.802672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:28.803285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:28.804330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:28.805270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:28.806151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:28.829048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:05:28.829526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:05:28.830320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:05:28.831576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:05:28.832052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:05:28.858692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:28.859194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:28.862316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:28.864481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:28.866277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:28.868587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:28.935306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Getting quotas for project bd0a4485fcda4b309863384dbd55413b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:05:28.951403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Getting quotas for user 4461e2c065194f9fb32f0449595bd59e and project bd0a4485fcda4b309863384dbd55413b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:05:29.000160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:05:29.004410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:05:29.085397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-516b7341-2998-47db-94ea-818fb84bafc9 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166228 Aug 29 11:05:29.105096 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2780/5601] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:05:29.105096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f885c335-1663-4f6d-a7e2-09b61c6aef36", "name": "network-vif-plugged", "status": "completed", "tag": "862e538f-162a-4344-84aa-35ed619aba43"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:29.132948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:29.133523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:29.134090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:29.159277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] Creating event network-vif-plugged:862e538f-162a-4344-84aa-35ed619aba43 for instance f885c335-1663-4f6d-a7e2-09b61c6aef36 on n-h1-854121-10 Aug 29 11:05:29.165732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3f4ab19e-e500-4e1b-bae5-5c28a5f324c7 req-f88365a3-4450-440d-9343-4aac2760a2eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065649 Aug 29 11:05:29.167239 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2781/5602] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:29.194580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed41380d-ab3e-47e1-8dee-6cb23fb05385 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:29.195631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed41380d-ab3e-47e1-8dee-6cb23fb05385 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:29.231934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:29.241118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f68eb2a-275c-4600-8f0d-296edc3a1df2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.472252 Aug 29 11:05:29.252166 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2822/5603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:28 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:29.461733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed41380d-ab3e-47e1-8dee-6cb23fb05385 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:29.477361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed41380d-ab3e-47e1-8dee-6cb23fb05385 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1217 microversion: 2.1 time: 0.308559 Aug 29 11:05:29.500744 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2782/5604] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:29 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:29.772393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:29.773273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:29.784404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:29.786092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:29.787598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:29.789740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:29.790705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:29.794340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:30.271732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:30.272946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:30.278896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:30.293341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f22eec5-cee4-4161-95a1-8066d3551ef2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1544 microversion: 2.1 time: 0.524815 Aug 29 11:05:30.295470 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2823/5605] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:29 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1544 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:30.303825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:30.307345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:30.307989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:30.310375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:30.311139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:30.313152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:30.315560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:30.316464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:30.333064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:30.340777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:30.341415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:30.342424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:30.343051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:30.343654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:31.145960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:31.168405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:31.203251 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d71c58c1-eb2e-40e3-b472-4712b3addeaf tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1428 microversion: 2.1 time: 0.933126 Aug 29 11:05:31.207404 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f3c46078-04b3-4859-bedd-83eb84efce9f tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1544 microversion: 2.1 time: 0.896001 Aug 29 11:05:31.216908 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2783/5606] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:30 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1428 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:31.228538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2824/5607] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:30 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1544 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:31.252051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:31.254213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:31.287567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:31.288369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:31.289937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:31.302175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:31.305107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:31.306816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:31.755832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:31.766920 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-364275ad-e5c1-49d8-b2b6-d084e7ee1638 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1277 microversion: 2.1 time: 0.548063 Aug 29 11:05:31.771035 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2784/5608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:31 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1277 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:32.229680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:32.230541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:32.241615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.244165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.244768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.245616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.249187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.249801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.566122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:32.578549 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e4484723-d1fe-4720-8faf-a9b0f8c6534e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1608 microversion: 2.1 time: 0.354836 Aug 29 11:05:32.579152 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2825/5609] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:32 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1608 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:32.609484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:32.614072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:32.616445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:32.624908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:32.645632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.646198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.646646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.651270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.652374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.659116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.660169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.668752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.669190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.670220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.670702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.671145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.801216 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6a0893d-37b5-458d-a80b-3e27ee3c7618 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.206142 Aug 29 11:05:32.801861 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2785/5610] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 29 11:05:32 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:32.828723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:32.830114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:32.865446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.869955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.872008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:32.874966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:32.875916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:32.876858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.177283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:33.220761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b468c76-9b23-4b86-89b5-474c11c7bb94 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1275 microversion: 2.1 time: 0.417678 Aug 29 11:05:33.233972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2786/5611] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:32 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1275 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:33.255533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:33.257928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:33.294785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.295995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.298230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.300290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.303235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.304881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.381389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:05:33.481358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:33.490994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a37b75d2-cc13-4e04-b4ab-d463b2778b32 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1608 microversion: 2.1 time: 0.886131 Aug 29 11:05:33.505685 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2826/5612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:32 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1608 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:33.514440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:33.525071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:33.537055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.537570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.538062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.538881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.539271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.539706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.591249 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0f8dd6b-db4c-4115-b201-5f0fc2ee8aea tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 204 len: 0 microversion: 2.20 time: 0.354872 Aug 29 11:05:33.592902 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2787/5613] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 11:05:33 2022] DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 11:05:33.610986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:33.612983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:33.631761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.632918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.633390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:33.634199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:33.640651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:33.641126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:34.037818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:34.051904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-543ec4c1-d595-42ab-a1a5-8e1bd9c3693e tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1608 microversion: 2.1 time: 0.536371 Aug 29 11:05:34.053132 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2827/5614] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:33 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1608 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:34.106790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:34.119766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:34.121320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:34.123337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f9a3de3e-7a13-4c83-b6a4-3c182fe7cebd tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.524090 Aug 29 11:05:34.124118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2788/5615] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:33 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:34.256092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:34.256687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:34.277825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:34.280968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:34.281562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:34.284533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:34.285357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:34.286388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:34.884385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:34.888163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:34.917114 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-665ab580-18d9-4822-b987-b942360ca7a5 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.661067 Aug 29 11:05:34.934805 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2828/5616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:34 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:35.150674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:35.151994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:35.163912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:35.164681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:35.166592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:35.167558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:35.171188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:35.171861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:35.944558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:35.951040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:35.951832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:35.961187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:35.967186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:35.968462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-447fb2be-36f3-40ff-932f-f5760c2c9ccf tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 0.821742 Aug 29 11:05:35.969536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:35.971530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:35.975433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:35.976453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:35.979086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:35.981653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:35.997552 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2789/5617] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:35 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:37.004212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:37.005669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:37.020000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:37.020891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:37.021623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:37.022625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:37.023860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:37.024688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:37.174476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:37.202820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51474c2f-f169-4a45-aa62-204511b3eb2f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 1.259046 Aug 29 11:05:37.214695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2829/5618] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:35 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:37.964065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:37.992048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:37.996719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:38.003255 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6f82201-0f1e-428a-9cb4-d4babf8e6cb9 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1723 microversion: 2.20 time: 1.007842 Aug 29 11:05:38.019071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2790/5619] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:36 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1723 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 11:05:38.251325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:38.278808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:38.294787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:38.296030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:38.296679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:38.297618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:38.299575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:38.300264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:38.649986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99953b1-6158-488e-813e-a9da2a4b9b65", "name": "network-vif-deleted", "tag": "c20baa9c-3e50-4c87-881e-2e5204800c77"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:38.670511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:38.671287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:38.671987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:38.696203 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] Creating event network-vif-deleted:c20baa9c-3e50-4c87-881e-2e5204800c77 for instance e99953b1-6158-488e-813e-a9da2a4b9b65 on n-h2-854121-10 Aug 29 11:05:38.702259 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b3ca9c23-3df0-4e0a-86f7-245895e72e89 req-43bfb816-a7cb-41fc-acd6-5b3bb908d679 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155786 Aug 29 11:05:38.703635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2791/5620] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:38.884217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da65068a-0d6e-4feb-a315-d2839c2a1923", "tag": "86058131-772a-4714-a24b-e57f198c09fa"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:38.903447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:38.906902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:38.908943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:38.909100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:38.926797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:38.931554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] Creating event network-changed:86058131-772a-4714-a24b-e57f198c09fa for instance da65068a-0d6e-4feb-a315-d2839c2a1923 on n-h2-854121-10 Aug 29 11:05:38.941116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f104499a-b8c1-4cbb-be79-4be81b89bff3 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.709793 Aug 29 11:05:38.943627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2830/5621] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:38 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:38.945921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3fd364bd-6ef2-41a3-b3f9-c5eaaac1bd93 req-d812d8ae-5e77-4a17-9e11-435eaef42283 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159801 Aug 29 11:05:38.946839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2792/5622] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:39.035615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:39.038687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:39.054596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:39.055820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:39.056818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:39.058267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:39.059014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:39.060642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:39.126453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:39.127367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:39.128422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:39.129114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lazy-loading 'fault' on Instance uuid e99953b1-6158-488e-813e-a9da2a4b9b65 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:05:39.378775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:39.388995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:39.395207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7521435d76b4ad49b2810bee5f177e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a60fb2140c44eedb7ff3ac2f649c304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:39.401515 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e0656aa-c428-47b6-9dde-384b8c65f90d tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 200 len: 1370 microversion: 2.20 time: 0.376745 Aug 29 11:05:39.402761 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2831/5623] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:39 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 11:05:39.973793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:39.973793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:39.973793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:39.979883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:39.980650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:39.981255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:39.995489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:39.996201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:39.998766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:40.428009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:40.428692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:40.441050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:40.443216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:40.443852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:40.444970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:40.447741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:40.448389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:40.494572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 HTTP/1.1 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e99953b1-6158-488e-813e-a9da2a4b9b65'} Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:40.496559 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:40.501504 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:05:40.506627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:40.510327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f0024d3-ed1d-453d-b8ed-37f29443547b tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 404 len: 111 microversion: 2.20 time: 0.086567 Aug 29 11:05:40.513883 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2832/5624] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:40 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 11:05:40.535696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a665776-1810-4cff-8ff6-7eb4786602b5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '.version_select at 0x7f66c66364c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:40.588144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a665776-1810-4cff-8ff6-7eb4786602b5 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-536168970" status: 204 len: 0 microversion: 2.20 time: 0.068453 Aug 29 11:05:40.589380 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2833/5625] 10.222.0.47 () {60 vars in 1259 bytes} [Mon Aug 29 11:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-536168970 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 11:05:40.739155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f490ac73-3579-4a3b-8022-c3df535cb26b", "tag": "bf307c65-3340-40fc-b46c-dad9b99f4ed5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:40.763651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:40.764153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:40.765498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:40.792165 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] Creating event network-changed:bf307c65-3340-40fc-b46c-dad9b99f4ed5 for instance f490ac73-3579-4a3b-8022-c3df535cb26b on n-h1-854121-10 Aug 29 11:05:40.806196 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-641b5425-fe9e-43f5-b5e0-4a4abefa961d req-649eca18-fc9d-4729-8595-9dab909ba6ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071455 Aug 29 11:05:40.807361 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2834/5626] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:40.807794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:40.821831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e528c058-3a2d-4e6a-9b81-4a4036a0e760 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.862715 Aug 29 11:05:40.823177 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2793/5627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:39 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:41.856769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:41.859177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:41.885465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:41.887072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:41.888649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:41.891347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:41.895284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:41.897395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:42.618540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:42.627881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7581e754-3e1b-4a63-8b5a-95be15c8550d tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.782741 Aug 29 11:05:42.629357 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2835/5628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:41 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:42.674914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f885c335-1663-4f6d-a7e2-09b61c6aef36", "tag": "862e538f-162a-4344-84aa-35ed619aba43"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:42.687799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:42.688589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:42.689777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:42.702955 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] Creating event network-changed:862e538f-162a-4344-84aa-35ed619aba43 for instance f885c335-1663-4f6d-a7e2-09b61c6aef36 on n-h1-854121-10 Aug 29 11:05:42.710226 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6df9c62b-8246-4239-8a4f-8b698976e123 req-8b002c2f-8543-4124-ad7b-ddc57b049315 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038834 Aug 29 11:05:42.711533 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2794/5629] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:43.649777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:43.650430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:43.653888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:43.677791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:43.678310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:43.678767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:43.679824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:43.679958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:43.680398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:43.905452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:43.921787 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8269b1d6-442d-41c7-afcf-0cce71d7d575 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.276387 Aug 29 11:05:43.922923 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2836/5630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:43 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:44.958111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:44.960489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:44.964193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:44.996728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:44.997487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:45.000957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:45.010857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:45.012632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:45.013477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:45.049856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:05:46.243709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:46.291534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-47bed1ec-afd6-4dd9-93b2-780119b4b148 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 1.349744 Aug 29 11:05:46.292491 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2795/5631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:44 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:47.319856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:47.320396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:47.351002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.351676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.352182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.359282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.365208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.368062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.611786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:47.613480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:47.633471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.635386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.637570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.641797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.644527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.645407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.698547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 HTTP/1.1 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e99953b1-6158-488e-813e-a9da2a4b9b65'} Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:47.709347 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:47.714303 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c6dd75b-4742-4c24-b756-4acd92683980 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 404 len: 111 microversion: 2.20 time: 0.106236 Aug 29 11:05:47.715958 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2796/5632] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 11:05:47 2022] DELETE /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 11:05:47.731659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:47.732310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: e99953b1-6158-488e-813e-a9da2a4b9b65] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:47.751179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.752240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.753005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.755182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:47.755182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:47.755182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:47.774385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 HTTP/1.1 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e99953b1-6158-488e-813e-a9da2a4b9b65'} Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.776379 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance e99953b1-6158-488e-813e-a9da2a4b9b65 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-244a6bd7-39ac-4647-ad19-1a66ebbcaf09 tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65" status: 404 len: 111 microversion: 2.20 time: 0.061201 Aug 29 11:05:47.780963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2797/5633] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:47 2022] GET /compute/v2.1/servers/e99953b1-6158-488e-813e-a9da2a4b9b65 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 11:05:48.247232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:48.293159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-28cf866b-fec5-4c90-9086-b00ef0872a4c tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.981665 Aug 29 11:05:48.295753 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2837/5634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:47 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:48.841430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da65068a-0d6e-4feb-a315-d2839c2a1923", "name": "network-vif-plugged", "status": "completed", "tag": "86058131-772a-4714-a24b-e57f198c09fa"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:48.888577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:48.892624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:48.893197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:48.937317 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] Creating event network-vif-plugged:86058131-772a-4714-a24b-e57f198c09fa for instance da65068a-0d6e-4feb-a315-d2839c2a1923 on n-h2-854121-10 Aug 29 11:05:48.952890 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-85aeba98-7f7c-4044-acea-db4fad50f41f req-5f070089-e629-4124-8295-384f1faf1040 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300177 Aug 29 11:05:48.958729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2798/5635] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:05:49.318915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:49.319608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:49.338861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:49.340303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:49.351359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:49.352719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:49.353379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:49.355387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:50.000367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:50.021233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9b83231-7112-4378-be98-6faababcb704 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1317 microversion: 2.1 time: 0.707201 Aug 29 11:05:50.023627 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2838/5636] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:49 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:51.046901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:51.047574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:51.067994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.069070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.070107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.072057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.072850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.074068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.655937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:51.670669 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38d636a4-fdea-463c-a877-840ba8f6804b tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1506 microversion: 2.1 time: 0.628659 Aug 29 11:05:51.693832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:51.694439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:51.697861 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2799/5637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:51 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:51.702430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.703313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.703416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.704045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.705279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.705894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.735325 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a91736d-0e11-4cae-b1b6-2f83fca4b299 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips" status: 200 len: 109 microversion: 2.1 time: 0.045317 Aug 29 11:05:51.749602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:51.750135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:51.754911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2839/5638] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 11:05:51 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips => generated 109 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:51.762642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.763371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.764399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.772315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.773568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.774250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.831809 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50e594e6-7210-4501-b952-a991366b5c22 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips" status: 200 len: 109 microversion: 2.1 time: 0.084003 Aug 29 11:05:51.845214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:51.847087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:51.852337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2800/5639] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 29 11:05:51 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips => generated 109 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:05:51.856128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.856744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.857526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.858887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.859775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.860527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.905493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73c5174d-2ceb-4c82-ab44-4f29944e3eff tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips/tempest-ServerAddressesTestJSON-649296990-network" status: 200 len: 94 microversion: 2.1 time: 0.065100 Aug 29 11:05:51.913858 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2840/5640] 10.222.0.47 () {58 vars in 1398 bytes} [Mon Aug 29 11:05:51 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923/ips/tempest-ServerAddressesTestJSON-649296990-network => generated 94 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:05:51.920962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:51.921649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:51.945543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.947366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.947836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.948574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:51.949037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:51.949467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:51.991920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:05:52.162650 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca6e8db7-edde-4840-bc2a-9593ee246ac8 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "DELETE /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 204 len: 0 microversion: 2.1 time: 0.245713 Aug 29 11:05:52.164942 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2801/5641] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:05:51 2022] DELETE /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:05:52.178716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:52.180311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:52.191593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:52.192613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:52.194413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:52.195615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:52.199031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:52.199696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:52.589262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:52.607624 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fb2a226e-6d24-43fd-88dd-f4b1a2f3d978 tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1512 microversion: 2.1 time: 0.438617 Aug 29 11:05:52.611904 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2841/5642] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:52 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:53.551206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:53.551821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:53.577089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.577575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.578212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.580731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.581514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.582124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.624508 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 HTTP/1.1 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '94942cf0-a68b-4673-b2d8-cd531bd71d43'} Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:53.627250 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.633144 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.636517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:53.637269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:53.649823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:53.651049 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb5d2eab-61c1-4413-869d-aefe3119b38e tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 404 len: 111 microversion: 2.20 time: 0.106591 Aug 29 11:05:53.652340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2802/5643] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 29 11:05:53 2022] DELETE /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 11:05:53.662489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:53.663548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] [instance: 94942cf0-a68b-4673-b2d8-cd531bd71d43] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:53.668914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.670756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.671544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.673070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.674090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.674922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.675492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.676411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.678362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.679646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:53.682736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:53.683536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:53.727549 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] HTTP exception thrown: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Request method failure captured: Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 HTTP/1.1 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJt3tMtpWU-EEnQt040y8tcXNwJtLaWfsPjhra4UvWpu0zJMuY8HoDF66GEPxr1Qq9YWkSUcRKIgzsFufoYFLcizHXioitnrBNM39AJGvrUhmmwmTyh2FLn1HCS0w0FKrogAwRVk7Smo8mdGUU2hjX6DLslPr1wVLQZboR_g2wwU1gQ Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8a60fb2140c44eedb7ff3ac2f649c304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 8a60fb2140c44eedb7ff3ac2f649c304 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674784294 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b7521435d76b4ad49b2810bee5f177e5 Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674784294-project Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '94942cf0-a68b-4673-b2d8-cd531bd71d43'} Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.734173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. Aug 29 11:05:53.739685 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:53.742546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] Returning 404 to user: Instance 94942cf0-a68b-4673-b2d8-cd531bd71d43 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:53.744599 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c6ec53a-f1d5-4cae-a8eb-2f26d5ea7ffb tempest-AttachVolumeShelveTestJSON-1674784294 tempest-AttachVolumeShelveTestJSON-1674784294-project] 10.222.0.47 "GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43" status: 404 len: 111 microversion: 2.20 time: 0.087393 Aug 29 11:05:53.753031 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2803/5644] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 29 11:05:53 2022] GET /compute/v2.1/servers/94942cf0-a68b-4673-b2d8-cd531bd71d43 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 11:05:54.308033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:54.322495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-564040fb-8343-4dab-8426-a778439de67a tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1512 microversion: 2.1 time: 0.693059 Aug 29 11:05:54.325736 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2842/5645] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:53 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1512 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:55.242185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:55.245041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:55.277534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:55.278388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:55.279147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:55.280312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:55.281342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:55.282275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:55.348431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:55.349651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:55.360484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:55.366919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:55.368233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:55.369159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:55.369812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:55.374792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:55.386112 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d878bc37-8221-466a-a602-0c22f0f65bfa tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b/action" status: 200 len: 24573 microversion: 2.1 time: 0.149680 Aug 29 11:05:55.394327 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2804/5646] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:05:55 2022] POST /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b/action => generated 24573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:05:55.805866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:55.817959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06567f5f-686a-4219-9ade-1cd3ee194c3f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1512 microversion: 2.1 time: 0.474001 Aug 29 11:05:55.831729 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2843/5647] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:55 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:05:56.170422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da65068a-0d6e-4feb-a315-d2839c2a1923", "name": "network-vif-deleted", "tag": "86058131-772a-4714-a24b-e57f198c09fa"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:05:56.195968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:56.196459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:56.196896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:56.233103 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] Creating event network-vif-deleted:86058131-772a-4714-a24b-e57f198c09fa for instance da65068a-0d6e-4feb-a315-d2839c2a1923 on n-h2-854121-10 Aug 29 11:05:56.246213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-83ba0c6b-1ecd-4f9b-a085-1187b8a86d09 req-085cd546-c51a-42b5-878b-4e43c55e8c4b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079533 Aug 29 11:05:56.252232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2805/5648] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:05:56.849019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:56.853621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:56.882693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:56.883566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:56.884225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:56.892921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:56.893659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:56.894696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:56.957840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:56.961253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:56.962104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:56.963106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lazy-loading 'fault' on Instance uuid da65068a-0d6e-4feb-a315-d2839c2a1923 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:05:57.065170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4461e2c065194f9fb32f0449595bd59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0a4485fcda4b309863384dbd55413b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:05:57.076146 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d316335b-8100-4267-8b37-76233b177cab tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 200 len: 1307 microversion: 2.1 time: 0.236357 Aug 29 11:05:57.091453 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2844/5649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:56 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:05:58.112133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:05:58.118201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] [instance: da65068a-0d6e-4feb-a315-d2839c2a1923] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:05:58.132664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:58.133304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:58.133928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:58.134950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:05:58.135632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:05:58.137184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:05:58.171521 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] HTTP exception thrown: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Request method failure captured: Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 HTTP/1.1 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ12PiS8GXYLNMiPd-M6DO50y3BtSOGhbMWG6oOGOw4czXswNxaR_Mlao5BJLKgYzR6jPnWCi_EU07OkvvAy6BSYjHibv-CpjRQQMZyn45gKPI73VS_VmIcYUYG5KAUlPzo_ziOhCo-y5II4lPpF5S46ggGUk4FcTHzzICusbSNrpyA Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: bd0a4485fcda4b309863384dbd55413b Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerAddressesTestJSON-1831453592 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd0a4485fcda4b309863384dbd55413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd0a4485fcda4b309863384dbd55413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd0a4485fcda4b309863384dbd55413b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd0a4485fcda4b309863384dbd55413b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerAddressesTestJSON-1831453592 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: bd0a4485fcda4b309863384dbd55413b Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1831453592 Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerAddressesTestJSON-1831453592-project Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4461e2c065194f9fb32f0449595bd59e Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerAddressesTestJSON-1831453592-project Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'da65068a-0d6e-4feb-a315-d2839c2a1923'} Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:05:58.174494 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. Aug 29 11:05:58.178655 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:05:58.194296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] Returning 404 to user: Instance da65068a-0d6e-4feb-a315-d2839c2a1923 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:05:58.195799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d795dc54-d4e9-429d-927f-7da6bec9f31f tempest-ServerAddressesTestJSON-1831453592 tempest-ServerAddressesTestJSON-1831453592-project] 10.222.0.47 "GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923" status: 404 len: 111 microversion: 2.1 time: 0.097970 Aug 29 11:05:58.197018 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2806/5650] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:05:58 2022] GET /compute/v2.1/servers/da65068a-0d6e-4feb-a315-d2839c2a1923 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:06:11.325832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:11.326451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:11.328736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=19 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:11.341377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=83 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:11.354744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:11.355249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:11.368175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:11.369278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:11.369861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:11.378069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:11.481792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f4f82e7-7293-4ef7-ae28-44f9416f93e1 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.149297 Aug 29 11:06:11.486048 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2845/5651] 10.222.0.47 () {58 vars in 1293 bytes} [Mon Aug 29 11:06:11 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36/os-server-password => generated 116 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:06:12.055335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-91b84379-6b05-4f9f-b121-dc5d790ec627 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: .version_select at 0x7f66c6d7e820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-262976924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOVZQJ/ZV+Ow8jETRZLsoFYy4dI4/Z9NhX93BZr/0p5LKY9TSmq0tErCyt2+zUvP/x90oDEKyz+DZV33FmlvqlUtvETWHUhOkALaYoJx1vd1Pu+AxJJuhT8aBi685f3+w=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:12.075598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:12.077940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:12.124377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-91b84379-6b05-4f9f-b121-dc5d790ec627 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:06:12.135457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-91b84379-6b05-4f9f-b121-dc5d790ec627 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:06:12.211980 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-91b84379-6b05-4f9f-b121-dc5d790ec627 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.161201 Aug 29 11:06:12.215083 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2807/5652] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:06:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:06:16.501996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-420283046", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "c78a2ef0-dc54-4fe4-b105-25175710412e"}], "key_name": "tempest-TestNetworkBasicOps-262976924", "security_groups": [{"name": "tempest-secgroup-smoke-1791428294"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:17.061273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] validate_networks() for [('c78a2ef0-dc54-4fe4-b105-25175710412e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:06:17.954274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:06:17.954949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:06:17.955352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:06:17.955829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:06:17.956386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:06:17.973009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:17.973516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:17.976597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:17.977306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:17.977854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:17.978306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:18.030337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:06:18.042545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:06:18.059259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:06:18.061885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:06:18.180747 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5ea5e790-a57a-437b-aedf-cadfaf04d1ae tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.683377 Aug 29 11:06:18.192679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2846/5653] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:06:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:06:18.211168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c5d6c3e-c898-46c3-b49a-6dc68facc6da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:18.211803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c5d6c3e-c898-46c3-b49a-6dc68facc6da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:18.352703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c5d6c3e-c898-46c3-b49a-6dc68facc6da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:18.368766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c5d6c3e-c898-46c3-b49a-6dc68facc6da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1247 microversion: 2.1 time: 0.174088 Aug 29 11:06:18.370792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2808/5654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:18 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1247 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:19.394705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:19.398292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:19.411745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:19.451312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:19.451926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:19.460906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:19.461888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:19.468003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:19.701908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:19.715598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35cc3fce-9892-4cd1-b5ec-d7e2b0ac61ab tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1243 microversion: 2.1 time: 0.326880 Aug 29 11:06:19.721505 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2847/5655] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:19 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1243 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:20.748052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:20.748724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:20.770363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:20.771570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:20.773665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:20.775045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:20.776758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:20.777222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:21.011069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:21.021623 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2dd0c76a-4835-4144-a59e-a598c3d68e9e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1305 microversion: 2.1 time: 0.279254 Aug 29 11:06:21.022775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2809/5656] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:20 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:22.052069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:22.053440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:22.073619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:22.092038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:22.092564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:22.093351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:22.093869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:22.100829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:22.298116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:22.307836 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7320c990-940d-4f9f-9499-bd12e458e1ec tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1305 microversion: 2.1 time: 0.262145 Aug 29 11:06:22.315067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2848/5657] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:22 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:23.340858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:23.341580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:23.362219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:23.364279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:23.365364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:23.367152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:23.367643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:23.370819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:23.810812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:23.820338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fce94e6a-b92a-4621-b280-3fbd6bde441a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1305 microversion: 2.1 time: 0.485771 Aug 29 11:06:23.820937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2810/5658] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:23 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1305 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:24.845115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:24.845753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:24.876798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:24.879790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:24.881627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:24.884063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:24.886105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:24.891693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:25.103260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:25.116279 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f32b9ddc-194a-46be-8c3f-9a64886f20a6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1305 microversion: 2.1 time: 0.271756 Aug 29 11:06:25.117785 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2849/5659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:24 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:25.882903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-796392881", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:26.023035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] validate_networks() for [('1f0b6911-7cbb-4865-a7e2-aa21fa6ea1c4', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:06:26.142323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:26.144939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:26.159954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:26.162311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:26.163306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:26.164073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:26.164551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:26.164990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:27.458419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:27.476550 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b4dc3f9-a7e4-48b8-9169-8148379b77fe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 1.337386 Aug 29 11:06:27.478797 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2850/5660] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:26 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:06:27.874674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:06:27.875976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:06:27.876579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:06:27.877105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:06:27.877635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:06:27.895875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:27.896662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:27.897215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:27.898218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:27.902116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:27.903140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:27.946931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Getting quotas for project 8720686d80d74aa799d4bbc682faa6fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:06:27.958092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Getting quotas for user 9c47043df0ff41b1a78ed05c122dded3 and project 8720686d80d74aa799d4bbc682faa6fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:06:27.996425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:06:27.999339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:06:28.091249 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b1dd7d5-172f-4601-80b3-f69fddff968f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.641152 Aug 29 11:06:28.096822 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2811/5661] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:06:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:06:28.108130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b98b9b71-426a-4369-95b5-59fa479d5593 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:28.109091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b98b9b71-426a-4369-95b5-59fa479d5593 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:28.121424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:28.124127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:28.214308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b98b9b71-426a-4369-95b5-59fa479d5593 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:28.239666 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b98b9b71-426a-4369-95b5-59fa479d5593 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1222 microversion: 2.1 time: 0.136243 Aug 29 11:06:28.253067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2851/5662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:28 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:28.503535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:28.504543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:28.520803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:28.523174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:28.524505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:28.527844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:28.528882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:28.529572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:29.262791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:29.264898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:29.283675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:29.284217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:29.286408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:29.288550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:29.289686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:29.292397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:29.298241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:29.306209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-57265e1f-ef5d-4fb3-9ccf-e29c4013a0f4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.804724 Aug 29 11:06:29.309901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2812/5663] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:28 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:29.592949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:29.627495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eed3b9dd-cbde-4a2d-93fc-e77833fbdb82 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1226 microversion: 2.1 time: 0.368981 Aug 29 11:06:29.628886 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2852/5664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:29 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1226 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:30.341174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:30.342118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:30.359561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:30.360841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:30.362420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:30.364992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:30.365905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:30.369161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:30.563579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04438e4b-9a3d-4eb9-a591-d4d2b189d0d4", "tag": "d7e55ae0-eb63-47b7-92aa-4d9b61d0535f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:30.630672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:30.632743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:30.634819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:30.654994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] Creating event network-changed:d7e55ae0-eb63-47b7-92aa-4d9b61d0535f for instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 on n-h2-854121-10 Aug 29 11:06:30.667944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3e8e2d10-d3f1-46e1-9fbf-d87a562def98 req-1e0c7a5e-c222-4175-9575-e25a87215dfd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111796 Aug 29 11:06:30.670474 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2853/5665] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:06:30.678408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:30.679659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:30.705857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:30.706819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:30.707606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:30.708725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:30.709467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:30.710993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:30.853288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:30.884988 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6609a0bf-ab28-4879-9bdc-454d7deab117 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1280 microversion: 2.1 time: 0.212703 Aug 29 11:06:30.889409 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2854/5666] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:30 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:31.104086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:31.121506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee11f6ca-1131-4f67-8806-cfce80f8a5d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.788633 Aug 29 11:06:31.124494 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2813/5667] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:30 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:31.914152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:31.916807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:31.932048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:31.932877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:31.933572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:31.934620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:31.935341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:31.936037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:32.098914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:32.121846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-369eb359-4b74-4a91-8f95-bfe9211e213b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1280 microversion: 2.1 time: 0.214705 Aug 29 11:06:32.122746 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2855/5668] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:31 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:32.146078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:32.146874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:32.164327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:32.165358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:32.166346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:32.167416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:32.168082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:32.169848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:32.590027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:32.603275 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87591d99-dd56-4f7d-94a2-4e9439cce0a0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.460603 Aug 29 11:06:32.616287 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2814/5669] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:32 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:33.143691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:33.145120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:33.164411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:33.166403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:33.167076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:33.169742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:33.170441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:33.172948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:33.407605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:33.419670 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e47f6718-410d-49a8-abc7-22cb91c6f36c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1280 microversion: 2.1 time: 0.280530 Aug 29 11:06:33.420755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2856/5670] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:33 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:33.627961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:33.628722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:33.642515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:33.644217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:33.644937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:33.647363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:33.648606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:33.649981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:33.833516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:33.853091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fb577b3e-2295-4869-a00d-8cddb9064579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.232357 Aug 29 11:06:33.867185 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2815/5671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:33 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:34.441125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:34.441783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:34.457387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:34.458248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:34.458675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:34.459417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:34.459885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:34.460319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:34.746503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:34.759227 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-325534a7-e873-4764-a7bd-49c41fa6e79c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.321851 Aug 29 11:06:34.765621 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2857/5672] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:34 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:34.891947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:34.894128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:34.916049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:34.920292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:34.930798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:34.931668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:34.934902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:34.935622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:35.419334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:35.432413 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd23995d-1df1-45af-86db-6d5d297a8f7c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.557734 Aug 29 11:06:35.434675 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2816/5673] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:34 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:35.790215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:35.795960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:35.840090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:35.840761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:35.841317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:35.842208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:35.845012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:35.845606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:36.106025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:36.117530 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eb452de3-ab4f-475a-ab58-826b2105671b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.335930 Aug 29 11:06:36.127656 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2858/5674] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:35 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:36.327435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:36.348130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:36.354397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:36.358918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:36.379930 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] Creating event network-changed:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:06:36.386845 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-de0c60be-6a09-478f-9264-f3f9cfddd053 req-46b1d1ff-6926-44cd-86cc-45bbedeeb70d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065201 Aug 29 11:06:36.388148 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2817/5675] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:06:36.462182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:36.463232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:36.476393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:36.477329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:36.478042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:36.481059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:36.481818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:36.483239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:37.150190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:37.150996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:37.166642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:37.170997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:37.173824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:37.175802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:37.179865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:37.180788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:37.639857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:37.648830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32e07bfa-1071-4eb4-ad16-e4ebd19a8df6 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 1.190502 Aug 29 11:06:37.662414 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2859/5676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:36 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:37.769397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:37.783462 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2755a01-0b0a-462e-8a3b-5c0027335ce7 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.638213 Aug 29 11:06:37.799756 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2818/5677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:37 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:06:38.193036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04438e4b-9a3d-4eb9-a591-d4d2b189d0d4", "name": "network-vif-plugged", "status": "completed", "tag": "d7e55ae0-eb63-47b7-92aa-4d9b61d0535f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:38.212580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:38.214076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:38.216164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:38.225250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:38.235015 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] Creating event network-vif-plugged:d7e55ae0-eb63-47b7-92aa-4d9b61d0535f for instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 on n-h2-854121-10 Aug 29 11:06:38.241581 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a21a3196-d50d-481d-a215-b47b81f38a58 req-90142ebf-5178-4542-a98a-9babd47d9bf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053728 Aug 29 11:06:38.243771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2860/5678] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:06:38.677966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:38.678621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:38.681889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:38.683561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:38.703352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:38.705608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:38.706112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:38.707046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:38.708485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:38.709006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:38.805877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:38.807404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:38.819301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:38.823564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:38.824215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:38.825410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:38.827448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:38.828611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:39.478620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:39.505062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-52a4bfe8-9999-4593-982c-ff8830e6062c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1373 microversion: 2.1 time: 0.836825 Aug 29 11:06:39.509737 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2819/5679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:38 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1373 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:39.877430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:39.888852 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d782eea8-b66c-4d39-a155-a7864723de31 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 1.088189 Aug 29 11:06:39.889464 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2861/5680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:38 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:06:40.529200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:40.530495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:40.540181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.540842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.541472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:40.542387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.543010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.543605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:40.900435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:40.914404 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-606d29ff-e73c-4aba-9c51-edd0ee37632a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1546 microversion: 2.1 time: 0.389113 Aug 29 11:06:40.914970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:40.915879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2820/5681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:40 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1546 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:40.916813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:40.934549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.935302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.939006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:40.939521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:40.940148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:40.941089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.943720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.946222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:40.952128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.952651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.953902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:40.954769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:40.955374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:40.955950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:41.515949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:41.556719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:41.568192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c95b62fe-d33c-4e6f-a971-636d27bfe401 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1546 microversion: 2.1 time: 0.635602 Aug 29 11:06:41.575879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=87 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:41.585796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7651779c-7b56-460c-9e1e-40ba2b3b3deb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.677737 Aug 29 11:06:41.588654 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2821/5682] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:40 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1546 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:41.601635 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2862/5683] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:40 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:42.628143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:42.629394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:42.632522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:42.648056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:42.651041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:42.653228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:42.654873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:42.657610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:42.662700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:42.686831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=71 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:43.087613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:43.109524 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e0f68a5-0978-4838-bb4d-e376bf808424 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.490532 Aug 29 11:06:43.110642 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2822/5684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:42 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:44.133837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:44.134377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:44.144737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:06:44.162536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:44.164494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:44.170218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:44.175996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:44.182674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:44.183607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:44.653344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "name": "network-vif-plugged", "status": "completed", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:44.698702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:44.699455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:44.699901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:44.762509 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] Creating event network-vif-plugged:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:06:44.788775 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-09428b9b-6085-4b0d-afa2-787cd26d8a80 req-605aa5fd-e061-4256-b909-b01d339c4d72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149958 Aug 29 11:06:44.800042 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2823/5685] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:06:45.036697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:45.064401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a20dfc2f-1393-4441-98ce-c1640096cbba tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.937710 Aug 29 11:06:45.065577 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2863/5686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:44 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:46.100141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:46.104785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:46.126437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:46.127233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:46.127861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:46.128776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:46.129401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:46.130028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:46.572657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:46.594187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2968810-c148-41b0-9720-9c8763fa1aac tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1322 microversion: 2.1 time: 0.497965 Aug 29 11:06:46.600185 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2824/5687] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:46 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:47.621357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:47.622030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:47.642888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:47.650305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:47.652092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:47.652883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:47.662216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:47.663068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:48.037666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:48.052952 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6dd99b12-9d95-4701-82aa-12f522a1303a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1517 microversion: 2.1 time: 0.435016 Aug 29 11:06:48.054036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2864/5688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:47 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1517 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:48.085547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:06:48.090948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:48.100821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:48.101617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:48.102312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:48.104262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:48.105123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:48.106094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:48.161920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lazy-loading 'flavor' on Instance uuid 30c61aa6-121c-42f2-b12c-27f2a1651aaa {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:06:48.307625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbbdadcd-d7f2-4e63-887a-ac9613354e8b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action" status: 200 len: 32 microversion: 2.1 time: 0.233674 Aug 29 11:06:48.314924 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2825/5689] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:06:48 2022] POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:06:48.320121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:48.320745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:48.363777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:48.364380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:48.364889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:48.366345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:48.368384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:48.369082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:48.864102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:48.879726 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5d9f34b-4705-457c-a774-b66d95c93ccb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.563899 Aug 29 11:06:48.881061 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2865/5690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:48 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:06:49.909665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:49.911118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:49.931117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:49.931938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:49.939306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:49.940351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:49.942781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:49.947086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:50.334354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:50.343945 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db12aed1-10a4-4fe1-860e-851292b4ce14 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.440130 Aug 29 11:06:50.358704 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2826/5691] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:49 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:51.367311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:51.367910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:51.383241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:51.384366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:51.384891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:51.386853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:51.387333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:51.389276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:51.729939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:51.743976 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eeafa094-3030-488a-b377-781b944e5542 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.381291 Aug 29 11:06:51.762998 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2866/5692] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:51 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:52.769591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:52.770189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:52.790286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:52.790787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:52.791446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:52.792440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:52.794926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:52.795632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:53.106035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:53.122759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fdc12f41-fd81-4018-a6d4-e53c27016e76 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.351588 Aug 29 11:06:53.123676 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2827/5693] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:52 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:06:54.148284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:54.149054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:54.174787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:54.178728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:54.180355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:54.182604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:54.185254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:54.185986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:54.550804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:54.564716 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d22f6a15-a673-4e56-9a81-d8c01e9b459c tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.423157 Aug 29 11:06:54.566296 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2867/5694] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:54 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:55.591374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:55.593802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:55.609289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:55.618078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:55.622402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:55.623414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:55.627971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:55.628618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:56.229730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:56.245808 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-872f174c-ddf0-44b4-af22-7d22acdd46c0 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.658709 Aug 29 11:06:56.250742 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2828/5695] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:55 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:57.271277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:57.271905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:57.282955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:57.283478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:57.283933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:57.290898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:57.293604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:57.294136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:57.619025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:57.634808 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-925ef9b1-cb11-4100-a85e-f57c2e5c1160 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.367258 Aug 29 11:06:57.636225 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2868/5696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:57 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:06:58.659398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:06:58.661331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:06:58.677597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:58.678741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:58.679386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:58.683271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:06:58.683951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:06:58.685894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:06:58.964309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:06:58.973575 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54e74d53-3ff6-4869-baf4-a0c7635ed94b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.320505 Aug 29 11:06:58.977963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2829/5697] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:06:58 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:00.006120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:00.007521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:00.019637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:00.020578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:00.021273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:00.022341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:00.023827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:00.024510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:00.218770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:00.242160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0125b280-7948-411b-9736-326b0cd61669 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.240103 Aug 29 11:07:00.246705 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2869/5698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:00 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:01.270301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:01.270921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:01.293848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:01.294618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:01.295237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:01.296206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:01.298689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:01.299376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:01.611290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:01.622852 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8d0a88e-e5a1-4cd8-a024-0b3a1628cd4b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.359683 Aug 29 11:07:01.624478 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2830/5699] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:01 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:02.652603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:02.654259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:02.663933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:02.666388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:02.667414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:02.668445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:02.669245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:02.669915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:03.127981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:03.137964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6ad3bf33-2517-4236-920f-7fae653ee0b8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.490751 Aug 29 11:07:03.139181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2870/5700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:02 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:04.161082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:04.161737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:04.186972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:04.187758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:04.189742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:04.190712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:04.193059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:04.193732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:04.480805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:04.489592 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f8054b2d-ac88-45dd-a9b8-5f4c4d51dcf3 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.332803 Aug 29 11:07:04.494338 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2831/5701] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:04 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:05.517388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:05.518155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:05.553121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:05.554384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:05.555585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:05.560897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:05.562820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:05.563533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:06.068042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:06.088753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ecf70112-237f-4447-9495-6a47ae2e1e59 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.576328 Aug 29 11:07:06.095940 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2871/5702] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:05 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:07.116434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:07.117937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:07.125399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:07.126179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:07.126783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:07.127798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:07.128415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:07.129300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:07.455045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:07.464171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f06a93bd-6cdb-4020-be4b-a129f21ee094 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.351651 Aug 29 11:07:07.465069 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2832/5703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:07 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:08.491101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:08.492173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:08.520234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:08.521026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:08.521793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:08.522953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:08.523734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:08.524484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:09.126987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:09.136395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1e9bcc1d-1afe-4513-8275-f2fe1a2e7e3f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.653846 Aug 29 11:07:09.137487 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2872/5704] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:08 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:09.900747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:09.901338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:09.913617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:09.926338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:09.926941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:09.927792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:09.928341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:09.928840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:09.977326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:07:10.139539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6341259b-57de-48dd-94b2-166831f2c4d4 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 204 len: 0 microversion: 2.1 time: 0.241818 Aug 29 11:07:10.145551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2833/5705] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:07:09 2022] DELETE /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:07:10.154151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:10.156390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:10.170947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:10.174209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:10.180594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:10.183008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:10.185789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:10.189557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:10.192465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:10.195634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:10.205290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:10.207394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:10.208451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:10.215202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:10.219575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:10.220215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:10.988401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:10.997050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d140f705-1f37-4dd6-bf24-ee4ad8130a19 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1552 microversion: 2.1 time: 0.849571 Aug 29 11:07:10.997648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2873/5706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:10 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1552 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:11.020829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:11.033944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f16752dd-4bfd-4644-b8ca-b5b4efc497cb tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.871800 Aug 29 11:07:11.036941 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2834/5707] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:10 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:12.020646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:12.022162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:12.043610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:12.048279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:12.048782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:12.049609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:12.055679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:12.056962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:12.057496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:12.058358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:12.077044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:12.081089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:12.083765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:12.087887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:12.088711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:12.090325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:12.537927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:12.544738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:12.550408 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b86a8c89-911c-44bb-9555-6a82906dcf47 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.498352 Aug 29 11:07:12.562231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2835/5708] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:12 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:07:12.621764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:12.640308 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bcb40c81-3816-442f-b676-54bb27d72ac5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1552 microversion: 2.1 time: 0.621776 Aug 29 11:07:12.643847 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2874/5709] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:12 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1552 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:13.159314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04438e4b-9a3d-4eb9-a591-d4d2b189d0d4", "name": "network-vif-deleted", "tag": "d7e55ae0-eb63-47b7-92aa-4d9b61d0535f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:13.181937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:13.187675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.188765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.192589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.237077 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] Creating event network-vif-deleted:d7e55ae0-eb63-47b7-92aa-4d9b61d0535f for instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 on n-h2-854121-10 Aug 29 11:07:13.255484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-252c46c4-0966-4d5b-a2de-9c47d7a2bc43 req-ea5712f9-2763-44ce-b5b0-60192efed254 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102083 Aug 29 11:07:13.257683 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2836/5710] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:13.584380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:13.587253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:13.605375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.606151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.606785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.607916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.611750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.612439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.668234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:13.669297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:13.692042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.694100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.695921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.698904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.699531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.704442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.792168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:13.792676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:13.793126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:13.793591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lazy-loading 'fault' on Instance uuid 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:07:13.922740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:13.936711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5db1cbf-6984-4555-a50a-913e4f0d3caf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 200 len: 1337 microversion: 2.1 time: 0.271842 Aug 29 11:07:13.938969 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2837/5711] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:13 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:07:14.272415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:14.275243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=78 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:14.285293 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2b03174-461b-4344-a7bd-4a3c6a089c0a tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.704922 Aug 29 11:07:14.296867 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2875/5712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:13 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:14.960796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:14.962281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:14.990203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:14.991355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:14.992483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:14.995461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:14.999096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:15.002975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:15.041012 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] HTTP exception thrown: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Request method failure captured: Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 HTTP/1.1 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ00JlxKIEHba5c4rXMc9HSyR7cC2C3l_F87NYKMHoUfoSzoyAns7QJ5W5v-4wGt2yX93qMXAT6kLIIlVxY6R71rYsEFKa7zHz8-xO3NfSD4TEW4F9xUDioAJCLpA39DmSobGIY5G8imoWLIxLPXc7ZJrReuWAUmEaSE-vEas-b21U8 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 9634077e2fa74be9bbf26b5c61923bd2 Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '04438e4b-9a3d-4eb9-a591-d4d2b189d0d4'} Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:15.042762 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Returning 404 to user: Instance 04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:07:15.048816 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df0a9c26-0e9c-478f-a9f9-37b2f50423da tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4" status: 404 len: 111 microversion: 2.1 time: 0.089970 Aug 29 11:07:15.049883 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2838/5713] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:14 2022] GET /compute/v2.1/servers/04438e4b-9a3d-4eb9-a591-d4d2b189d0d4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:07:15.343779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:15.344538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:15.357274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=26 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:15.361594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:15.362453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:15.363109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:15.364047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:15.364940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:15.365741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:15.711134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dce89c02-31ca-4536-8c8c-16f261fb308e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '.version_select at 0x7f66c5cfde50>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:15.764903 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dce89c02-31ca-4536-8c8c-16f261fb308e tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-262976924" status: 202 len: 0 microversion: 2.1 time: 0.057663 Aug 29 11:07:15.766174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2839/5714] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 29 11:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-262976924 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:07:16.071473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:16.093244 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-252b6a61-be0c-4d50-a15e-c6d013e4ac89 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.752122 Aug 29 11:07:16.106305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2876/5715] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:15 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:17.117584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:17.118277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:17.153987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:17.155350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:17.155826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:17.158173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:17.158667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:17.159120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:18.026429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:18.042146 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dbb324a2-ae8c-46be-aad0-c3299e59e329 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1523 microversion: 2.1 time: 0.929416 Aug 29 11:07:18.042822 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2840/5716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:17 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1523 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:19.063600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:19.064271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:19.082220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:19.082780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:19.085638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:19.086625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:19.087144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:19.090167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:19.821642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:19.842643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aaafd6ee-5efb-4f65-b9d9-9f5b160b14aa tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1503 microversion: 2.1 time: 0.777650 Aug 29 11:07:19.846606 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2877/5717] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:19 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:19.872640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c25405c-efed-4963-b79f-61547474fa24 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'create', calling method: .version_select at 0x7f66c5cfd280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-985999525", "description": "tempest-description-1035753389"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:20.480669 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c25405c-efed-4963-b79f-61547474fa24 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.611917 Aug 29 11:07:20.481955 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2841/5718] 10.222.0.47 () {60 vars in 1180 bytes} [Mon Aug 29 11:07:19 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:20.496136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-985999525"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:20.496707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:20.515594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:20.516171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:20.516640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:20.517471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:20.518101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:20.520384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:20.930963 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Adding security group 6cf44442-9d43-48d5-8fbe-e57f88e0f877 to port b5cc42e5-4441-4242-a86c-8126ea97d1e9 Aug 29 11:07:22.231472 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46253b76-576a-49f3-b5ee-4ebc32a51e99 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action" status: 202 len: 0 microversion: 2.1 time: 1.739079 Aug 29 11:07:22.232034 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2878/5719] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:07:20 2022] POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action => generated 0 bytes in 1740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:07:22.242977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-985999525"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:22.243532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:22.261397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:22.261560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:22.264401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:22.265173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:22.268024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:22.268878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:22.270095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:22.284624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:22.285188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:22.288720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:22.323587 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] Creating event network-changed:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:07:22.336773 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e473e66c-6739-411e-978e-eb0a5c1962fc req-6e340fc4-caf5-463a-acc9-80d4e79c31e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079604 Aug 29 11:07:22.341309 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2879/5720] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:22.481162 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.security_group_api [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Removing security group 6cf44442-9d43-48d5-8fbe-e57f88e0f877 from port b5cc42e5-4441-4242-a86c-8126ea97d1e9 Aug 29 11:07:23.047645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd203405-d65e-4141-8a01-30e39da29877 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.810361 Aug 29 11:07:23.053387 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2842/5721] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:07:22 2022] POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:07:23.072469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e9fb7dbe-863a-479b-ae07-fd9f3ccb9655 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'create', calling method: .version_select at 0x7f66cb1a68b0>, body: {"pool": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:23.652879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:23.655447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:23.672651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:23.674051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:23.675811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:23.677671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:23.682118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:23.684300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:23.796243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:07:24.057619 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dc73f68c-3e42-4ad7-85b4-f08ab6a2d94b tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 204 len: 0 microversion: 2.1 time: 0.422360 Aug 29 11:07:24.063945 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2843/5722] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:07:23 2022] DELETE /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:07:24.082411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f490ac73-3579-4a3b-8022-c3df535cb26b", "tag": "bf307c65-3340-40fc-b46c-dad9b99f4ed5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:24.117378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:24.119500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:24.120484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:24.140029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] Creating event network-changed:bf307c65-3340-40fc-b46c-dad9b99f4ed5 for instance f490ac73-3579-4a3b-8022-c3df535cb26b on n-h1-854121-10 Aug 29 11:07:24.150993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fffab8be-c0e4-480e-b1d3-295007adc2df req-0da1d813-2063-4984-adc1-6f9ec2763dfc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084474 Aug 29 11:07:24.152280 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2844/5723] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:24.161461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:24.162507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:24.176483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:24.177614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:24.178509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:24.179983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:24.180843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:24.185102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:24.609339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:24.619991 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-702200a9-620a-4046-af32-dae13482be4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1669 microversion: 2.1 time: 0.465647 Aug 29 11:07:24.624416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2845/5724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:24 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:24.632080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:24.668739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:24.669440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:24.670393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:24.692538 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] Creating event network-changed:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:07:24.703100 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-129d0fc0-9f63-48cc-9441-92c3ff676c8d req-9263eb63-e484-4aee-9faa-0fa4738cb337 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075855 Aug 29 11:07:24.704397 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2846/5725] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:25.646262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:25.647271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:25.665831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:25.666404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:25.666856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:25.667594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:25.668053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:25.668481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:26.395738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:26.409315 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-00cd4033-250b-486e-bcae-a67c8106d39c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1669 microversion: 2.1 time: 0.768205 Aug 29 11:07:26.410352 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2847/5726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:25 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1669 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:27.432260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:27.432944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:27.441256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:27.442166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:27.442871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:27.444088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:27.444897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:27.445557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:27.499695 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e9fb7dbe-863a-479b-ae07-fd9f3ccb9655 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.440544 Aug 29 11:07:27.500318 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2880/5727] 10.222.0.47 () {60 vars in 1170 bytes} [Mon Aug 29 11:07:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:27.515158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.126"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:27.519131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:27.596820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:27.599247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:27.602418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:27.603256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:27.604703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:27.605221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:27.608774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:27.609660 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9430019f-d64e-4040-9228-fcd33116f723 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 200 len: 1602 microversion: 2.1 time: 0.181187 Aug 29 11:07:27.614098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2848/5728] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:27 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 1602 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:07:27.661249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 11:07:27.661969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquired lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 11:07:27.795103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f490ac73-3579-4a3b-8022-c3df535cb26b", "name": "network-vif-deleted", "tag": "bf307c65-3340-40fc-b46c-dad9b99f4ed5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:27.814451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:27.815201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:27.816855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:27.835387 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] Creating event network-vif-deleted:bf307c65-3340-40fc-b46c-dad9b99f4ed5 for instance f490ac73-3579-4a3b-8022-c3df535cb26b on n-h1-854121-10 Aug 29 11:07:27.846112 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-af15d6de-17b0-4b01-85a1-680838218eae req-b6e379d6-a0f0-4b3c-8276-d9f8814aa9f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055968 Aug 29 11:07:27.860103 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2849/5729] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:28.637167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:28.640067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: f490ac73-3579-4a3b-8022-c3df535cb26b] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:28.659360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:28.660239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:28.660938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:28.664902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:28.666021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:28.667037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:28.693460 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] HTTP exception thrown: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Request method failure captured: Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b HTTP/1.1 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ00JlxKIEHba5c4rXMc9HSyR7cC2C3l_F87NYKMHoUfoSzoyAns7QJ5W5v-4wGt2yX93qMXAT6kLIIlVxY6R71rYsEFKa7zHz8-xO3NfSD4TEW4F9xUDioAJCLpA39DmSobGIY5G8imoWLIxLPXc7ZJrReuWAUmEaSE-vEas-b21U8 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 9634077e2fa74be9bbf26b5c61923bd2 Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f490ac73-3579-4a3b-8022-c3df535cb26b'} Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:28.715008 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. Aug 29 11:07:28.720793 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:07:28.725264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Returning 404 to user: Instance f490ac73-3579-4a3b-8022-c3df535cb26b could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:07:28.726965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e447e0e-3e1e-468c-8c96-b7ab7a77f8d1 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b" status: 404 len: 111 microversion: 2.1 time: 0.097138 Aug 29 11:07:28.727937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2850/5730] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:28 2022] GET /compute/v2.1/servers/f490ac73-3579-4a3b-8022-c3df535cb26b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:07:29.710159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4652d04e-3410-49e6-bb35-06b71b98bee7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '.version_select at 0x7f66c5d9c700>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:29.742610 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4652d04e-3410-49e6-bb35-06b71b98bee7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1319027575" status: 202 len: 0 microversion: 2.1 time: 0.037193 Aug 29 11:07:29.751632 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2851/5731] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 11:07:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1319027575 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:07:31.683336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Building network info cache for instance {{(pid=128681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 11:07:31.702827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:31.730279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:31.731430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:31.732238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:31.756088 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] Creating event network-changed:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:07:31.763606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ade2d153-9074-41be-9239-ea4d7a3f3035 req-cd67b5b1-f68f-41c8-87e2-50cb23e9687f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067323 Aug 29 11:07:31.769028 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2852/5732] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:07:34.425825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Updating instance_info_cache with network_info: [{"id": "b5cc42e5-4441-4242-a86c-8126ea97d1e9", "address": "fa:16:3e:8d:af:21", "network": {"id": "1f0b6911-7cbb-4865-a7e2-aa21fa6ea1c4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1313558894-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8720686d80d74aa799d4bbc682faa6fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5cc42e5-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 11:07:34.452145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Releasing lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 11:07:34.453983 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0fd3f7e7-a92f-41df-9993-529cea2690cc tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action" status: 202 len: 0 microversion: 2.1 time: 6.945398 Aug 29 11:07:34.455064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2881/5733] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:07:27 2022] POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action => generated 0 bytes in 6947 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 29 11:07:34.467088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Action: 'action', calling method: .version_select at 0x7f66c9452c10>, body: {"removeFloatingIp": {"address": "172.25.3.126"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:34.923756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:34.934297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:34.936730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:34.940949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:34.942287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:34.943230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:34.944063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:35.785053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 11:07:35.786211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquired lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 11:07:36.621896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-65545032", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "ea600be5-4b4e-4ef2-87ae-78ffb0e25a05"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:36.770178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] validate_networks() for [('ea600be5-4b4e-4ef2-87ae-78ffb0e25a05', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:07:38.777829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Building network info cache for instance {{(pid=128682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 11:07:38.882589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:07:38.883959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:07:38.884886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:07:38.885534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:07:38.886251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:07:38.907292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:38.908228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:38.909794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:38.914416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:38.916028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:38.916784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:38.974566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Getting quotas for project ed50b8a2b057458eb74f57b0acdd94dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:07:38.997212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Getting quotas for user 168eb7850e3e46fd9539db47f27fca14 and project ed50b8a2b057458eb74f57b0acdd94dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:07:39.039989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:07:39.051626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:07:39.158262 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df1e5b7f-2150-456b-b80a-88cfe96272e6 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.547179 Aug 29 11:07:39.161916 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2882/5734] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:07:39.176215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:39.208843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:39.209948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:39.210624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:39.231062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] Creating event network-changed:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:07:39.240637 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5eddc141-933f-4069-aade-9b982a296c5b req-6e23eb65-71ec-490f-b165-ed5b8bf5ac54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075853 Aug 29 11:07:39.241563 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2883/5735] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:39.248152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e359368-c4fc-413c-a177-129c87eef0f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:39.249692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e359368-c4fc-413c-a177-129c87eef0f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:39.410014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e359368-c4fc-413c-a177-129c87eef0f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:39.419447 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e359368-c4fc-413c-a177-129c87eef0f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1212 microversion: 2.1 time: 0.176329 Aug 29 11:07:39.423871 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2884/5736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:39 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1212 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:40.443053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:40.443682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:40.462367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:40.463115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:40.463719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:40.465585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:40.467563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:40.468231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:41.142742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:41.155250 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84c79206-1c54-47bd-b06e-bdf8b6266942 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1208 microversion: 2.1 time: 0.712873 Aug 29 11:07:41.156508 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2885/5737] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:40 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1208 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:41.161748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Updating instance_info_cache with network_info: [{"id": "b5cc42e5-4441-4242-a86c-8126ea97d1e9", "address": "fa:16:3e:8d:af:21", "network": {"id": "1f0b6911-7cbb-4865-a7e2-aa21fa6ea1c4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1313558894-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8720686d80d74aa799d4bbc682faa6fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5cc42e5-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 11:07:41.191636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Releasing lock "refresh_cache-30c61aa6-121c-42f2-b12c-27f2a1651aaa" {{(pid=128682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 11:07:41.192690 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2f36151-623e-457b-9f7f-1b65e98dbfab tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action" status: 202 len: 0 microversion: 2.1 time: 6.732775 Aug 29 11:07:41.193309 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2853/5738] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:07:34 2022] POST /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa/action => generated 0 bytes in 6735 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 11:07:41.202570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a2a0813-6991-4850-86cf-6858af48aa24 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '.version_select at 0x7f66c7385b80>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:42.180510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:42.183629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:42.194679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:42.195363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:42.196015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:42.196939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:42.197846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:42.198894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:42.321817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:42.338649 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6d2fbbe-5a47-4d62-bcb5-8b5b5810436a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1270 microversion: 2.1 time: 0.164599 Aug 29 11:07:42.339995 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2854/5739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:42 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:42.988058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a2a0813-6991-4850-86cf-6858af48aa24 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/0621e4e6-c82b-4676-8a1f-1402c5b9d7b6" status: 202 len: 0 microversion: 2.1 time: 1.789911 Aug 29 11:07:42.991012 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2886/5740] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 11:07:41 2022] DELETE /compute/v2.1/os-floating-ips/0621e4e6-c82b-4676-8a1f-1402c5b9d7b6 => generated 0 bytes in 1794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:07:43.001750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f24c16e1-368c-4a13-8681-3f4a382efea8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '.version_select at 0x7f66c5cb44c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:43.364743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:43.365857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:43.384259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:43.385061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:43.385895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:43.386831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:43.387596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:43.389307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:43.914601 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f24c16e1-368c-4a13-8681-3f4a382efea8 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/6cf44442-9d43-48d5-8fbe-e57f88e0f877" status: 202 len: 0 microversion: 2.1 time: 0.918205 Aug 29 11:07:43.918757 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2855/5741] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 11:07:42 2022] DELETE /compute/v2.1/os-security-groups/6cf44442-9d43-48d5-8fbe-e57f88e0f877 => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:07:43.927340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:43.927586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:43.930273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:43.953187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:43.970600 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-557d1e27-1809-45e3-aa05-56e4f135f6d3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.610297 Aug 29 11:07:43.974380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:43.974552 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2887/5742] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:43 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:43.975250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:43.977209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:43.979559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:43.982625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:43.988154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:44.092246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:44.115698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:07:44.277280 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d6bc0bc-7479-45f9-b61b-e38e9a9202c6 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "DELETE /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 204 len: 0 microversion: 2.1 time: 0.355131 Aug 29 11:07:44.279887 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2856/5743] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:07:43 2022] DELETE /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:07:44.289833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:44.290753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:44.298752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:44.299637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:44.300363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:44.302479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:44.307325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:44.308615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:45.011327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:45.016864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:45.040323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:45.042893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:45.043618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:45.046021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:45.046983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:45.047970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:45.154263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:45.165582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-622d73e8-1ef7-4167-99f9-78a03fef914f tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1509 microversion: 2.1 time: 0.881227 Aug 29 11:07:45.166937 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2888/5744] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:44 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1509 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:45.580295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:45.615861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5874c9a6-d5f5-4c75-a9f2-f9df58270f8a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.619660 Aug 29 11:07:45.617625 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2857/5745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:44 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:46.054335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398b1333-07ce-4f08-b2e5-eed1785d4112", "tag": "d5a44710-f906-4b8b-afe9-25a57cb74e88"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:46.113324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:46.116232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:46.121415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:46.127416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:46.188856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:46.189838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:46.207346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:46.208598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=50,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:46.217876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:46.219121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] Creating event network-changed:d5a44710-f906-4b8b-afe9-25a57cb74e88 for instance 398b1333-07ce-4f08-b2e5-eed1785d4112 on n-h2-854121-10 Aug 29 11:07:46.219495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:46.222950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:46.223426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:46.223869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:46.254343 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3b5998d6-b911-4a88-ae03-a747d6e38218 req-859adee9-7159-4a28-91e3-707eb9d924e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216626 Aug 29 11:07:46.267284 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2889/5746] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:46.646920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:46.647776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:46.696804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:46.698701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:46.701003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:46.702217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:46.703142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:46.706470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:47.258834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:47.269732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b58b12a0-e3f5-48b6-a346-6ca700bfb17b tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1509 microversion: 2.1 time: 1.086577 Aug 29 11:07:47.293308 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2858/5747] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:46 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1509 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:47.407001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:47.415397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0930113-c35b-46a6-adfc-875f4c9f77ff tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.779364 Aug 29 11:07:47.416319 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2890/5748] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:46 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:07:48.002236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c61aa6-121c-42f2-b12c-27f2a1651aaa", "name": "network-vif-deleted", "tag": "b5cc42e5-4441-4242-a86c-8126ea97d1e9"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:48.051247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.052784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.058424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.078614 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] Creating event network-vif-deleted:b5cc42e5-4441-4242-a86c-8126ea97d1e9 for instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa on n-h2-854121-10 Aug 29 11:07:48.091984 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a154ad2c-15a3-46fc-abe7-cf4793a9ce2a req-39d4e9cb-16cf-432f-a510-c5f7156aae38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102014 Aug 29 11:07:48.093568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2859/5749] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:48.303594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:48.304548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:48.322731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.326928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.327843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.333985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.337742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.338995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.414666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.417915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.418627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.424187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lazy-loading 'fault' on Instance uuid 30c61aa6-121c-42f2-b12c-27f2a1651aaa {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:07:48.438968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:48.440374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:48.460833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.461940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.463219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.466027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:48.466900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:48.468592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:48.703976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47043df0ff41b1a78ed05c122dded3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720686d80d74aa799d4bbc682faa6fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:48.718363 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa6b612c-95c2-405a-8d2c-182b831c7045 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 200 len: 1312 microversion: 2.1 time: 0.420971 Aug 29 11:07:48.719156 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2891/5750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:48 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:49.557055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:49.569081 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bfe46efc-c6c4-41b5-ae3e-3577d1fef9ca tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 1.134201 Aug 29 11:07:49.572183 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2860/5751] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:48 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:49.742821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:49.744202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] [instance: 30c61aa6-121c-42f2-b12c-27f2a1651aaa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:49.753306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:49.757018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:07:49.773457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:49.774528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:49.776782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:49.779979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:49.780936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:49.783206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:49.819503 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] HTTP exception thrown: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Request method failure captured: Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa HTTP/1.1 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ2xNMnjhjeUutduZnBu7gkaFpdtvyiKXoVSTFVpdaLwoiRYbbKH69ufkNTrb6ZhjaA8BaDI5FHkhnx0DbtQ2rV5gu8sKJ0X8GsujRnQNoNyDAmZXWyASKoeSCpIZpjheRmOi2bgG869cYam5rSPINJ24LnOxAmh04a3dy0fLT-3S5k Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 8720686d80d74aa799d4bbc682faa6fe Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-466980366 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8720686d80d74aa799d4bbc682faa6fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8720686d80d74aa799d4bbc682faa6fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8720686d80d74aa799d4bbc682faa6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8720686d80d74aa799d4bbc682faa6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-466980366 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 8720686d80d74aa799d4bbc682faa6fe Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-466980366 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerRescueTestJSONUnderV235-466980366-project Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 9c47043df0ff41b1a78ed05c122dded3 Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-466980366-project Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '30c61aa6-121c-42f2-b12c-27f2a1651aaa'} Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:07:49.833411 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. Aug 29 11:07:49.839071 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:07:49.842380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] Returning 404 to user: Instance 30c61aa6-121c-42f2-b12c-27f2a1651aaa could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:07:49.843842 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa72d1d5-cd63-461e-a482-bc53c5745f73 tempest-ServerRescueTestJSONUnderV235-466980366 tempest-ServerRescueTestJSONUnderV235-466980366-project] 10.222.0.47 "GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa" status: 404 len: 111 microversion: 2.1 time: 0.105344 Aug 29 11:07:49.845100 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2892/5752] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:49 2022] GET /compute/v2.1/servers/30c61aa6-121c-42f2-b12c-27f2a1651aaa => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:07:50.596118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:50.598085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:50.612907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:50.614394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:50.615239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:50.616515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:50.617520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:50.618861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:51.046000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:51.066134 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80004853-16b3-4a45-9c24-3dce78cef38f tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.476836 Aug 29 11:07:51.069278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2861/5753] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:50 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:52.096038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:52.101026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:52.121669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:52.123097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:52.123727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:52.126386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:52.127045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:52.128647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:52.810500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:52.826843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0181922-3bee-4971-8525-d99ed661773d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.742200 Aug 29 11:07:52.827451 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2893/5754] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:52 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:53.858120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:53.859368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:53.868433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:53.869843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:53.870555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:53.871442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:53.873465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:53.874155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:54.341812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:54.372677 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a4e7cc48-9761-4fcc-8744-bfcbd9adb328 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.514345 Aug 29 11:07:54.374471 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2862/5755] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:53 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:54.532124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398b1333-07ce-4f08-b2e5-eed1785d4112", "name": "network-vif-plugged", "status": "completed", "tag": "d5a44710-f906-4b8b-afe9-25a57cb74e88"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:54.553649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:54.554387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:54.554892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:54.596113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] Creating event network-vif-plugged:d5a44710-f906-4b8b-afe9-25a57cb74e88 for instance 398b1333-07ce-4f08-b2e5-eed1785d4112 on n-h2-854121-10 Aug 29 11:07:54.611708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5f267f4a-72a5-41f2-ad88-7750eef51578 req-20668576-ad8b-4671-bff3-7267f34ebcdb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082977 Aug 29 11:07:54.613034 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2894/5756] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:07:55.401366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:55.402275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:55.424491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:55.426738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:55.427522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:55.429481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:55.431556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:55.432483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:55.903790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:55.921956 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f03ea4da-0771-48f0-a1fe-5530e3b06768 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1312 microversion: 2.1 time: 0.526209 Aug 29 11:07:55.927923 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2863/5757] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:55 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:56.953448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:56.955137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:56.987499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:56.988941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:56.991259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:56.992342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:56.994773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:56.996123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:57.369543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53857897-d542-4835-a7e5-736136748499 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: .version_select at 0x7f66c5b01940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1849279140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNnzoX1EcNnuQLmxXYlP5ySYs5R9P+FESnWdalB2Hemr8Szf6X24hfg+cJvBy8g30DlUA1Zdqz1TYYoxlNt45WSN6tvD7G4prjSQuIe/X4xWbofr01TAxo6WRvz8qAs2w=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:07:57.416767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-53857897-d542-4835-a7e5-736136748499 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:07:57.446042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-53857897-d542-4835-a7e5-736136748499 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:07:57.455630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:57.495610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f65f4e7-1a24-4988-b969-053ba3602726 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1495 microversion: 2.1 time: 0.549163 Aug 29 11:07:57.506302 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2895/5758] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:56 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1495 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:07:57.533942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53857897-d542-4835-a7e5-736136748499 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.168240 Aug 29 11:07:57.534757 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2864/5759] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:07:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:07:58.316347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:58.316949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:58.332672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:58.334339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:58.336470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:58.339830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:58.341761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:58.342681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:58.422652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:07:58.624061 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2cde8776-975a-4eeb-a2ba-f39b0be6ad90 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "DELETE /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 204 len: 0 microversion: 2.1 time: 0.311650 Aug 29 11:07:58.631144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2896/5760] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:07:58 2022] DELETE /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:07:58.635337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:07:58.636369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:07:58.649501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:58.651784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:58.656445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:58.657487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:07:58.659001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:07:58.661154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:07:59.014568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:07:59.039535 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e1e853f-6614-41cb-ab3c-6e2f896a93f4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1501 microversion: 2.1 time: 0.409810 Aug 29 11:07:59.046560 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2865/5761] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:07:58 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1501 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:08:00.081551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:00.082389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:00.105722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:00.106269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:00.106721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:00.107452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:00.107919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:00.108361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:00.871228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:00.888512 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52a262fe-6ff7-45aa-9e87-b59f57fc07b1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1501 microversion: 2.1 time: 0.820589 Aug 29 11:08:00.889566 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2897/5762] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:00 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1501 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:01.790849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-242699153", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "2472437f-a6a0-4dcb-a0ee-9e25f38e9b08"}], "key_name": "tempest-TestNetworkBasicOps-1849279140", "security_groups": [{"name": "tempest-secgroup-smoke-1886087987"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:01.907315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398b1333-07ce-4f08-b2e5-eed1785d4112", "name": "network-vif-deleted", "tag": "d5a44710-f906-4b8b-afe9-25a57cb74e88"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:01.920305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:01.921059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:01.921718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:01.937959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] Creating event network-vif-deleted:d5a44710-f906-4b8b-afe9-25a57cb74e88 for instance 398b1333-07ce-4f08-b2e5-eed1785d4112 on n-h2-854121-10 Aug 29 11:08:01.945175 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2bf796e8-16b3-4cbb-88cc-54263b543a27 req-51a21ea8-d1a2-41ad-8d21-1569db2095ac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044593 Aug 29 11:08:01.946582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2898/5763] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:08:01.955718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:01.957939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:01.975672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:01.976407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:01.977914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:01.978843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:01.982838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:01.983498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:02.073040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] validate_networks() for [('2472437f-a6a0-4dcb-a0ee-9e25f38e9b08', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:08:02.141049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:02.150711 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bc33132-3641-4862-84b3-8fd4cce90bf4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 200 len: 1297 microversion: 2.1 time: 0.201895 Aug 29 11:08:02.153320 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2899/5764] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:01 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:02.995429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:08:02.997523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:08:02.998285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:08:02.999122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:08:02.999787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:08:03.022575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:03.023073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:03.023522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:03.024269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:03.024735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:03.025174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:03.064436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:08:03.070517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Getting quotas for user 9634077e2fa74be9bbf26b5c61923bd2 and project 28d926a445c74ceda7e1aa06e091fdd7. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:08:03.085266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:08:03.087825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:08:03.144885 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-187b4e8b-0c43-4048-95c5-41373cb31a87 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.358594 Aug 29 11:08:03.146156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2866/5765] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:08:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:08:03.158225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e4f0f048-22d5-4d6f-9fe4-767341374952 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:03.166509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e4f0f048-22d5-4d6f-9fe4-767341374952 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:03.176315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:03.192392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: 398b1333-07ce-4f08-b2e5-eed1785d4112] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:03.207102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:03.208286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:03.211487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:03.213464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:03.214851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:03.217582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:03.250021 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] HTTP exception thrown: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Request method failure captured: Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 HTTP/1.1 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ316ZPQbHEu0dcGYMUcoZkPcskMz0_9Q8kdA2XHhpBR0rwdYmoT-Etg8_J2k5abDLM6Ska2EVuhU4-KC5_gmgz02amozgjbaTJm6UCkPqo-0i5dSx2HELDDuCKiQzEHdP26-DKU__S2i95HJQbJgKwd0aXDZekflR47t31zSY2aQWg Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: ed50b8a2b057458eb74f57b0acdd94dc Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: ed50b8a2b057458eb74f57b0acdd94dc Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-VolumesActionsTest-1012073249-project Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 168eb7850e3e46fd9539db47f27fca14 Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-VolumesActionsTest-1012073249-project Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '398b1333-07ce-4f08-b2e5-eed1785d4112'} Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:08:03.254428 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. Aug 29 11:08:03.260100 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:08:03.264427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Returning 404 to user: Instance 398b1333-07ce-4f08-b2e5-eed1785d4112 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:08:03.265913 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1cd58b6e-d72b-44e0-8d48-d0be75c231d1 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112" status: 404 len: 111 microversion: 2.1 time: 0.094326 Aug 29 11:08:03.286619 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2867/5766] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:03 2022] GET /compute/v2.1/servers/398b1333-07ce-4f08-b2e5-eed1785d4112 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:08:03.481909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e4f0f048-22d5-4d6f-9fe4-767341374952 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:03.489510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-162300340", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "ea600be5-4b4e-4ef2-87ae-78ffb0e25a05"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:03.494121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e4f0f048-22d5-4d6f-9fe4-767341374952 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1248 microversion: 2.1 time: 0.341075 Aug 29 11:08:03.505312 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2900/5767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:03 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1248 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:03.598615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] validate_networks() for [('ea600be5-4b4e-4ef2-87ae-78ffb0e25a05', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:08:04.519011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:04.519815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:04.537180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:04.539805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:04.541542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:04.543860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:04.546956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:04.547701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:04.816590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:04.828835 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f875dde-b180-40d1-8907-30716a4e1143 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1300 microversion: 2.1 time: 0.316262 Aug 29 11:08:04.839795 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2901/5768] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:04 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:04.981876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:08:04.982613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:08:04.982882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:08:04.983505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:08:04.984084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:08:05.007784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:05.010858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:05.012292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:05.013978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:05.022226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:05.025104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:05.060744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Getting quotas for project ed50b8a2b057458eb74f57b0acdd94dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:08:05.071014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Getting quotas for user 168eb7850e3e46fd9539db47f27fca14 and project ed50b8a2b057458eb74f57b0acdd94dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:08:05.109521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:08:05.136527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:08:05.305873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-932bf8c6-4b4e-469b-bf1e-721e516fe486 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815185 Aug 29 11:08:05.308071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2868/5769] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:08:05.323340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb0639a4-466d-4d48-81e3-60e3624d0c20 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:05.323973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb0639a4-466d-4d48-81e3-60e3624d0c20 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:05.869287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:05.870071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:05.886417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:05.887325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:05.887989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:05.888897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:05.897538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:05.898228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:06.059717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb0639a4-466d-4d48-81e3-60e3624d0c20 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:06.073928 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb0639a4-466d-4d48-81e3-60e3624d0c20 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1213 microversion: 2.1 time: 0.756228 Aug 29 11:08:06.077654 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2902/5770] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:05 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1213 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:06.255184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:06.269243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-afc6c7d9-83f5-4b86-bf6e-2a9e0c186d67 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1306 microversion: 2.1 time: 0.404225 Aug 29 11:08:06.300641 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2869/5771] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:05 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1306 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:07.097436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:07.100134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:07.123698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:07.124332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:07.124798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:07.130551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:07.133672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:07.133672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:07.295976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:07.297111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:07.317461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:07.317997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:07.318444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:07.319182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:07.319651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:07.320088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:07.424058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:07.436966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40f21ca3-000d-4dd6-a315-163573fd9982 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1265 microversion: 2.1 time: 0.343415 Aug 29 11:08:07.453520 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2903/5772] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:07 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:07.501875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:07.547467 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c9d4c8b-0460-42bd-a7e7-4119f86cdaeb tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1306 microversion: 2.1 time: 0.254785 Aug 29 11:08:07.548800 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2870/5773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:07 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1306 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:08:08.469243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:08.472039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:08.486717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:08.487227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:08.487676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:08.494838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:08.500086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:08.500844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:08.571472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:08.572672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:08.583320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:08.584510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:08.585227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:08.586189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:08.587689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:08.588688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:08.691150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:08.705118 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6350a9c5-807e-4b12-a8da-1cf85dc52b9d tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1271 microversion: 2.1 time: 0.247200 Aug 29 11:08:08.714145 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2904/5774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:08 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:09.208123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:09.229688 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cc9debb0-0386-4d3f-bb2a-1f834fc2059d tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.664368 Aug 29 11:08:09.232247 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2871/5775] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:08 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:09.740107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:09.740838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:09.750581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:09.751231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:09.752390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:09.753262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:09.753863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:09.754396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:10.125647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:10.155386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d9c2cf51-7f06-473f-85f2-6f62ddbb0994 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1271 microversion: 2.1 time: 0.419627 Aug 29 11:08:10.157133 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2905/5776] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:09 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1271 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:10.252851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:10.253469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:10.271971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:10.272728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:10.273393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:10.274875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:10.275864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:10.276796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:10.863653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:10.879015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-85096e81-f73e-4b80-88a3-5e6f01c152dd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.627236 Aug 29 11:08:10.880744 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2872/5777] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:10 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:11.179486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:11.180312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:11.193078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:11.193579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:11.194056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:11.195635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:11.196113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:11.196562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:11.636433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32fe356-53af-4624-80e5-0ec6ff6c4bd6", "tag": "5a247b69-d186-472a-98d8-275678b57243"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:11.651474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:11.651662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:11.652151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:11.653181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:11.677896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5144ff5-20f6-42fe-9fdf-51e071db54e9 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.503685 Aug 29 11:08:11.679494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] Creating event network-changed:5a247b69-d186-472a-98d8-275678b57243 for instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 on n-h2-854121-10 Aug 29 11:08:11.681042 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2906/5778] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:11 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:11.700398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3ff2e675-74b1-42cc-93dd-70b16a3e84bc req-f2649fee-d76e-4ff1-a506-e46f8fbcab3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067202 Aug 29 11:08:11.701891 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2873/5779] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:08:11.934833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:11.938578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:11.966588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:11.968697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:11.970895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:11.974578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:11.975716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:11.976757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:12.387555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:12.396280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f3fdaf7-b651-4215-9b20-b91df6824e4c tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.497456 Aug 29 11:08:12.396894 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2907/5780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:11 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:12.704423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:12.705480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:12.725493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:12.726093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:12.727496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:12.728468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:12.729247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:12.729962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:12.994787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:13.009301 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-438ba0ae-3d55-49e7-b70a-99b9a8d0099a tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.309550 Aug 29 11:08:13.010120 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2874/5781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:12 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:13.419275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:13.420538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:13.429289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:13.430109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:13.431433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:13.432423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:13.433141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:13.434847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:13.463671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:13.730131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db4b70d8-7fc7-43e7-8ab8-5961a97f14d4", "tag": "b0f34fb8-79b0-4456-ac33-403aec2063a5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:13.743172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:13.754344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:13.754833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:13.755273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:13.758788 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eeb2183e-cdd5-4065-93d1-6c10ea9998d0 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.343386 Aug 29 11:08:13.759454 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2908/5782] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:13 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:13.770363 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] Creating event network-changed:b0f34fb8-79b0-4456-ac33-403aec2063a5 for instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 on n-h1-854121-10 Aug 29 11:08:13.779302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9b87ab11-6e77-4285-90f6-039a28de7d88 req-9fcdb9ba-8056-4057-b0e0-15751d0dac22 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053763 Aug 29 11:08:13.780188 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2875/5783] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:08:14.031412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:14.031981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:14.038613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:14.039386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:14.040108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:14.041101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:14.042243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:14.042946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:14.436046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:14.446378 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-470fb09e-809f-4a6d-a0a2-35003efdd1e3 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.419503 Aug 29 11:08:14.454843 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2909/5784] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:14 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:14.786372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:14.787836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:14.797076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:14.800351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:14.801755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:14.802529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:14.804101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:14.805096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:14.806006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:14.841952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:15.040529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:15.101117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:15.464531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:15.478910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:15.480823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:15.503285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7d1677a-54be-4ffb-8bb5-164bdd905dfd tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.719372 Aug 29 11:08:15.507408 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2876/5785] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:14 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:15.516209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:15.516994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:15.518574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:15.521830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:15.522781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:15.523461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:15.785527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:15.796842 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c6644883-8d40-4391-ae6f-851d4caa8dcc tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.324913 Aug 29 11:08:15.798191 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2910/5786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:15 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:08:16.541770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:16.545505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:16.584394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:16.585336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:16.585838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:16.588107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:16.590217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:16.591382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:16.816640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:16.824333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:16.825002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:16.827081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:16.841901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:16.842588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:16.843183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:16.844641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:16.845605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:16.846667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:17.036180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:17.051352 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-080ffab5-f246-432e-8671-9f5a1d4154cf tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.523782 Aug 29 11:08:17.053245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2877/5787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:16 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:17.505573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:17.519089 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8acb2a1a-07a2-4008-88e4-4b9ae2f78769 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.703365 Aug 29 11:08:17.520257 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2911/5788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:16 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:18.074702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:18.075564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:18.086733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:18.087450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:18.088398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:18.089305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:18.090002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:18.090612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:18.320431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:18.330333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-efbfb052-8c34-4413-9785-ad191a1f5b39 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.260408 Aug 29 11:08:18.331714 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2878/5789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:18 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:18.541713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:18.543671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:18.559206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:18.560137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:18.561012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:18.561987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:18.562738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:18.563426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:18.634110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32fe356-53af-4624-80e5-0ec6ff6c4bd6", "name": "network-vif-plugged", "status": "completed", "tag": "5a247b69-d186-472a-98d8-275678b57243"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:18.655791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:18.656286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:18.656728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:18.680479 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] Creating event network-vif-plugged:5a247b69-d186-472a-98d8-275678b57243 for instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 on n-h2-854121-10 Aug 29 11:08:18.710868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c0e24af1-63cb-4c76-b801-43bc2b5b5628 req-3004470c-c79d-45b2-a3fc-7197c29a92a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080397 Aug 29 11:08:18.712231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2879/5790] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:08:18.921460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:18.934265 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d1cf194-dfd9-448e-83b3-7744576ab284 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.397436 Aug 29 11:08:18.939229 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2912/5791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:18 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:19.354474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:19.356576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:19.368240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:19.374210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:19.374963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:19.376359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:19.377588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:19.379483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:19.666784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:19.679918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e18f960e-9a3c-4ae1-bae5-00b50435c421 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1374 microversion: 2.1 time: 0.331393 Aug 29 11:08:19.680668 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2880/5792] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:19 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1374 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:19.960609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:19.961554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:19.984185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:19.984986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:19.986307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:19.987318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:19.990388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:19.991132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:20.239956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:20.253168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-65a5b510-375d-4bc2-b854-e62cc6de5a65 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.294619 Aug 29 11:08:20.254993 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2913/5793] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:19 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:20.702665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:20.703285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:20.717387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:20.718277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:20.720343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:20.721276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:20.725541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:20.726214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:20.743549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4b70d8-7fc7-43e7-8ab8-5961a97f14d4", "name": "network-vif-plugged", "status": "completed", "tag": "b0f34fb8-79b0-4456-ac33-403aec2063a5"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:20.763877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:20.764763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:20.765387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:20.796940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] Creating event network-vif-plugged:b0f34fb8-79b0-4456-ac33-403aec2063a5 for instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 on n-h1-854121-10 Aug 29 11:08:20.815193 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-37e26e29-5812-44dd-99a1-3ca7e018d535 req-d17157f8-03e3-4629-b074-7c239a6ee8f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073484 Aug 29 11:08:20.816547 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2914/5794] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:08:21.201548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:21.216914 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1323377d-059b-4c34-abb5-3e1b0759b789 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1546 microversion: 2.1 time: 0.518961 Aug 29 11:08:21.218446 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2881/5795] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:20 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1546 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:21.242353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:21.243816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:21.251411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:21.252388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:21.253096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:21.254114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:21.254803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:21.255459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:21.275835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:21.276745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:21.287774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:21.288627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:21.290825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:21.291833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:21.295080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:21.295847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:21.700267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:21.718000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a859c98d-e0d1-4d67-a32f-87467bb7451a tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1546 microversion: 2.1 time: 0.482349 Aug 29 11:08:21.718724 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2915/5796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:21 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1546 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:21.859851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:21.909822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2ef87bc-8584-443e-aa15-9547f12a6800 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1313 microversion: 2.1 time: 0.637035 Aug 29 11:08:21.932143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2882/5797] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:21 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:22.934452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:22.935801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:22.951662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:22.952504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:22.953145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:22.954121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:22.966530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:22.967002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:24.207246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:24.259344 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40c9b8b5-6fa6-486a-bb13-f46a94aa61c8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1497 microversion: 2.1 time: 1.328445 Aug 29 11:08:24.260438 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2916/5798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:22 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1497 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:25.084776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:25.086486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:25.106001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:25.106982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:25.107648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:25.108568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:25.109351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:25.110025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:25.173382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:08:25.346833 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97ddcdd7-4bcf-49ef-8d92-f5764ff97141 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "DELETE /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 204 len: 0 microversion: 2.1 time: 0.264899 Aug 29 11:08:25.349329 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2883/5799] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:08:25 2022] DELETE /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:08:25.357360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:25.358014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:25.367389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:25.367889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:25.368334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:25.369057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:25.369517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:25.369970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:25.718851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:25.732828 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23afbd89-6079-4ae9-b0b0-18940723ebf0 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1503 microversion: 2.1 time: 0.377181 Aug 29 11:08:25.734260 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2917/5800] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:25 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:08:26.779275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:26.781175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:26.821018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:26.822827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:26.824190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:26.825293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:26.829783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:26.831589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:27.544302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:27.553885 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-382607e4-4067-4097-8d8e-1fc69dc15839 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1503 microversion: 2.1 time: 0.795321 Aug 29 11:08:27.554745 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2884/5801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:26 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1503 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:28.332792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32fe356-53af-4624-80e5-0ec6ff6c4bd6", "tag": "5a247b69-d186-472a-98d8-275678b57243"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:28.358050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:28.359057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:28.359759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:28.379566 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] Creating event network-changed:5a247b69-d186-472a-98d8-275678b57243 for instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 on n-h2-854121-10 Aug 29 11:08:28.392119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-46c5070b-27bd-4445-83b7-8bb4cdb644b5 req-d0a6d123-2873-41ab-bb54-050547984d7b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063123 Aug 29 11:08:28.393067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2918/5802] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:08:28.579406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:28.580216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:28.605581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:28.606853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:28.607487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:28.613543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:28.614470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:28.615036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:28.935967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168eb7850e3e46fd9539db47f27fca14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed50b8a2b057458eb74f57b0acdd94dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:28.946302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-153504b0-eb6f-4911-9006-f1a14afe41f8 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 200 len: 1461 microversion: 2.1 time: 0.374126 Aug 29 11:08:28.952278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2885/5803] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:28 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 1461 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:29.981802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:29.983648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] [instance: db4b70d8-7fc7-43e7-8ab8-5961a97f14d4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:29.999171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:30.000065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:30.000850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:30.002578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:30.003333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:30.004616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:30.032284 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] HTTP exception thrown: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Request method failure captured: Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 HTTP/1.1 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ316ZPQbHEu0dcGYMUcoZkPcskMz0_9Q8kdA2XHhpBR0rwdYmoT-Etg8_J2k5abDLM6Ska2EVuhU4-KC5_gmgz02amozgjbaTJm6UCkPqo-0i5dSx2HELDDuCKiQzEHdP26-DKU__S2i95HJQbJgKwd0aXDZekflR47t31zSY2aQWg Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: ed50b8a2b057458eb74f57b0acdd94dc Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ed50b8a2b057458eb74f57b0acdd94dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: ed50b8a2b057458eb74f57b0acdd94dc Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesActionsTest-1012073249 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesActionsTest-1012073249-project Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 168eb7850e3e46fd9539db47f27fca14 Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesActionsTest-1012073249-project Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'db4b70d8-7fc7-43e7-8ab8-5961a97f14d4'} Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:08:30.034033 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] Returning 404 to user: Instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1dd2561c-e8de-49c1-b9ee-f110ded3cda4 tempest-VolumesActionsTest-1012073249 tempest-VolumesActionsTest-1012073249-project] 10.222.0.47 "GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4" status: 404 len: 111 microversion: 2.1 time: 0.061710 Aug 29 11:08:30.044193 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2919/5804] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:29 2022] GET /compute/v2.1/servers/db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:08:30.444892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db4b70d8-7fc7-43e7-8ab8-5961a97f14d4", "name": "network-vif-deleted", "tag": "b0f34fb8-79b0-4456-ac33-403aec2063a5"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:30.472352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:30.472847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:30.473290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:30.511720 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] Creating event network-vif-deleted:b0f34fb8-79b0-4456-ac33-403aec2063a5 for instance db4b70d8-7fc7-43e7-8ab8-5961a97f14d4 on n-h1-854121-10 Aug 29 11:08:30.517508 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8a3b827e-dcd6-4957-bf30-d2eb870cda49 req-5118c6aa-f9a1-46ac-ba9b-5e066c47e0f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076405 Aug 29 11:08:30.519752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2886/5805] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:08:44.958932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:44.962285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:44.982984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=17 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:44.986357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=57 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:44.991097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:44.991897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:45.024311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:45.029359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:45.030265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:45.033637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:45.162575 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3c39b57-960d-4c0f-ad70-94a25fd9da08 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6/action" status: 200 len: 24579 microversion: 2.1 time: 0.212215 Aug 29 11:08:45.163530 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2920/5806] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:08:44 2022] POST /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6/action => generated 24579 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:08:51.858916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:51.863652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:51.882762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:51.888243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:51.934817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:51.935522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:51.935994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:51.936767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:51.937235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:51.937672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:52.237207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8545ffa1-6d05-4ccd-a7b8-a3cb40830d00 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "POST /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6/action" status: 200 len: 32643 microversion: 2.1 time: 0.385494 Aug 29 11:08:52.238785 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2887/5807] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:08:51 2022] POST /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6/action => generated 32643 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:08:57.218732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:57.219337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:57.235310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:57.236116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:08:57.237691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:57.244930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:57.245108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32fe356-53af-4624-80e5-0ec6ff6c4bd6", "tag": "5a247b69-d186-472a-98d8-275678b57243"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:08:57.245625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:57.246328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:57.246743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:57.247197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:57.277504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:57.278038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:57.278473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:57.315594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:08:57.357375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] Creating event network-changed:5a247b69-d186-472a-98d8-275678b57243 for instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 on n-h2-854121-10 Aug 29 11:08:57.378408 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-de7e2861-a328-4639-9c88-f1e500b9fe09 req-b88a5001-2e42-4e27-a5fa-ffecb6e8235c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131809 Aug 29 11:08:57.379301 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2888/5808] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:08:57.493395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87ab97e5-542a-4388-bfd4-f0e53737a579 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 204 len: 0 microversion: 2.1 time: 0.281297 Aug 29 11:08:57.494188 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2921/5809] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:08:57 2022] DELETE /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:08:57.504727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:57.505999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:57.525336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:57.526460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:57.529367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:57.532454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:57.533322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:57.534050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:57.855279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:57.868477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-530952d9-60fc-49f9-8766-9291c06c1012 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1671 microversion: 2.1 time: 0.369467 Aug 29 11:08:57.871483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2889/5810] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:57 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:08:58.897929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:08:58.898891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:08:58.919652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:58.920279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:58.920803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:58.926093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:08:58.928071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:08:58.928631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:08:59.502440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:08:59.518849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4cc036f-b042-4344-9156-aa7bf4d4eeb2 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1671 microversion: 2.1 time: 0.627419 Aug 29 11:08:59.533173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2922/5811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:08:58 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1671 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:00.541522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:00.542145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:00.560690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:00.561956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:00.562954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:00.564056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:00.564775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:00.566182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:00.830760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:00.859661 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1241bdb7-135d-411e-a90e-9f5de47cd9c5 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1552 microversion: 2.1 time: 0.322869 Aug 29 11:09:00.865542 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2890/5812] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:00 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1552 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:00.961509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1622808054", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:01.061580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:09:01.704272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:09:01.704740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:09:01.705244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:09:01.705728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:09:01.706356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:09:01.723459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:01.725858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:01.726544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:01.730907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:01.733081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:01.733961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:01.768507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Getting quotas for project a737dfc249e24857a22364b6ac717be5. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:09:01.776934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Getting quotas for user a0e8c10acb8e4c4db0c0e4019502d68d and project a737dfc249e24857a22364b6ac717be5. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:09:01.819361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:09:01.823262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:09:01.889468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:01.890971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:01.908941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:01.909944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:01.913603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:01.918046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:01.921689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:01.927095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:01.946579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9acc6f1d-cae0-4b57-9815-ac85d3ee75b6 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988531 Aug 29 11:09:01.947339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2923/5813] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:09:01.968536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4c950ec9-9774-4b16-8ab2-3b0b1dce6cb3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:01.970836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4c950ec9-9774-4b16-8ab2-3b0b1dce6cb3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:02.232186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4c950ec9-9774-4b16-8ab2-3b0b1dce6cb3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:02.249375 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4c950ec9-9774-4b16-8ab2-3b0b1dce6cb3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1215 microversion: 2.1 time: 0.285720 Aug 29 11:09:02.267691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2924/5814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:01 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:02.461628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:02.482989 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fddfd9a4-36d9-46f1-a5bb-8f5f77e687a9 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1552 microversion: 2.1 time: 0.601818 Aug 29 11:09:02.484174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2891/5815] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:01 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1552 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:03.053356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32fe356-53af-4624-80e5-0ec6ff6c4bd6", "name": "network-vif-deleted", "tag": "5a247b69-d186-472a-98d8-275678b57243"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:03.085128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.085609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.101205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.143530 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] Creating event network-vif-deleted:5a247b69-d186-472a-98d8-275678b57243 for instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 on n-h2-854121-10 Aug 29 11:09:03.169692 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f4d2f3c5-8b96-4986-b51a-510b77bbabbb req-cda30d8a-5aa4-46d3-b48c-86ead9ba5f71 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124527 Aug 29 11:09:03.170691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2925/5816] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:09:03.272404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:03.273714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:03.284615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.289128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.303642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.304716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.305188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.305607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.512516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:03.515579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:03.543052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.543971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.551228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.553511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.558506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.559850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.675935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:03.683951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:03.684686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:03.685481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lazy-loading 'fault' on Instance uuid c32fe356-53af-4624-80e5-0ec6ff6c4bd6 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:09:03.815243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9634077e2fa74be9bbf26b5c61923bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d926a445c74ceda7e1aa06e091fdd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:03.828558 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-05851423-0ad3-47b5-9833-3cab18b67cfe tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 200 len: 1338 microversion: 2.1 time: 0.327012 Aug 29 11:09:03.832430 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2926/5817] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:03 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:04.057857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:04.067824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8d42e5aa-6679-4d91-ba7a-dd264e244196 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1219 microversion: 2.1 time: 0.799610 Aug 29 11:09:04.073922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2892/5818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:03 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1219 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:04.851272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:04.851941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] [instance: c32fe356-53af-4624-80e5-0ec6ff6c4bd6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:04.871389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:04.871995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:04.872459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:04.873223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:04.874176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:04.874176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:04.933957 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] HTTP exception thrown: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Request method failure captured: Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 HTTP/1.1 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ00JlxKIEHba5c4rXMc9HSyR7cC2C3l_F87NYKMHoUfoSzoyAns7QJ5W5v-4wGt2yX93qMXAT6kLIIlVxY6R71rYsEFKa7zHz8-xO3NfSD4TEW4F9xUDioAJCLpA39DmSobGIY5G8imoWLIxLPXc7ZJrReuWAUmEaSE-vEas-b21U8 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/28d926a445c74ceda7e1aa06e091fdd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 28d926a445c74ceda7e1aa06e091fdd7 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestNetworkBasicOps-2009507529 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 9634077e2fa74be9bbf26b5c61923bd2 Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestNetworkBasicOps-2009507529-project Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'c32fe356-53af-4624-80e5-0ec6ff6c4bd6'} Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:09:04.935690 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Returning 404 to user: Instance c32fe356-53af-4624-80e5-0ec6ff6c4bd6 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:09:04.941121 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-312476d4-fc4f-493c-8901-094b1518b0d7 tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6" status: 404 len: 111 microversion: 2.1 time: 0.090555 Aug 29 11:09:04.954901 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2927/5819] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:04 2022] GET /compute/v2.1/servers/c32fe356-53af-4624-80e5-0ec6ff6c4bd6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:09:05.099678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:05.100460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:05.111382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:05.119878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:05.120645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:05.121599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:05.122344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:05.123054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:05.344099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:05.352933 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f7257451-939a-4b1e-ad41-0339c630c634 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1273 microversion: 2.1 time: 0.257908 Aug 29 11:09:05.386448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2893/5820] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:05 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:09:05.875004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25462cd3-1478-41f6-b1be-c3def28607db tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] Calling method '.version_select at 0x7f66c5b20310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:05.955806 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25462cd3-1478-41f6-b1be-c3def28607db tempest-TestNetworkBasicOps-2009507529 tempest-TestNetworkBasicOps-2009507529-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1849279140" status: 202 len: 0 microversion: 2.1 time: 0.085979 Aug 29 11:09:05.959350 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2928/5821] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 11:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1849279140 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:09:06.391455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:06.392761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:06.406765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:06.411137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:06.416360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:06.417453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:06.418212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:06.420472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:07.192758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:07.205605 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02f6b5a6-3c39-484d-8b59-492c29f1e9a9 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1273 microversion: 2.1 time: 0.817969 Aug 29 11:09:07.207513 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2894/5822] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:06 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1273 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:08.240364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:08.241207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:08.269328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:08.304323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:08.308926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:08.312765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:08.316736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:08.318064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:08.643180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:08.653083 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c6afaf0d-61ca-446f-ad24-fa41dead5180 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1273 microversion: 2.1 time: 0.427971 Aug 29 11:09:08.658882 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2929/5823] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:08 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1273 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:09.681216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:09.681917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:09.706933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:09.707470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:09.707939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:09.708705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:09.709195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:09.709648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:10.340090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:10.351046 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b99e7fd4-8d1f-4be4-928f-51030ca298b2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.673454 Aug 29 11:09:10.371023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2895/5824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:09 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:11.377363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:11.378182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:11.404666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:11.416786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:11.428194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:11.429186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:11.433465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:11.438414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:11.758640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:12.079455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:12.096293 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67edddc3-5674-4803-a76d-f45d88e0ede2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.724575 Aug 29 11:09:12.099597 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2930/5825] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:11 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:13.125054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:13.125718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:13.142871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:13.159941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:13.161954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:13.161954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:13.162389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:13.162844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:13.315181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2ea94f-7a61-4535-9c36-1b5180437586", "tag": "156131e5-0f17-4eaf-a3a3-b531af222074"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:13.352734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:13.391561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:13.392732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:13.393541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:13.457240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] Creating event network-changed:156131e5-0f17-4eaf-a3a3-b531af222074 for instance 7f2ea94f-7a61-4535-9c36-1b5180437586 on n-h2-854121-10 Aug 29 11:09:13.471559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8a5932c1-aa9a-42c9-9c89-e0f42c1d6b07 req-f11db559-e0f9-4a0f-b4ac-6ae474693d68 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160975 Aug 29 11:09:13.474910 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2931/5826] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:09:14.183612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:14.197180 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3ea0e602-1464-4906-a6af-62430e353007 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 1.077601 Aug 29 11:09:14.205519 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2896/5827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:13 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:15.238456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:15.239456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:15.252163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:15.252949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:15.253787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:15.255248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:15.255896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:15.258526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:17.007425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:17.030944 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e80ea14c-f24a-4c7a-8acd-bdcd7237fdda tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 1.801665 Aug 29 11:09:17.032158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2932/5828] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:15 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:18.056604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:18.057452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:18.074038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:18.076714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:18.077737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:18.080664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:18.082728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:18.084257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:18.764855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:18.805220 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ac6eed51-1696-482b-8fd8-7258cf7e2c5e tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.751046 Aug 29 11:09:18.820012 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2897/5829] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:18 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:19.827473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:19.828108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:19.846680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:19.847207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:19.847669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:19.855592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:19.856190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:19.862313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:20.583443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:20.600902 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c0dd5b2-eb1d-473a-b870-0417d18ad3ff tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.775126 Aug 29 11:09:20.615179 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2933/5830] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:19 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:21.625394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:21.626232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:21.644167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:21.644680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:21.646639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:21.651572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:21.651572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:21.651572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:22.021756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:22.039196 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f95e884-7802-4f3c-84fc-afa766afecd3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.415596 Aug 29 11:09:22.044991 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2898/5831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:21 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:23.076171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:23.076888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:23.094909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:23.095426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:23.095859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:23.096602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:23.097073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:23.097517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:23.737797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:23.753322 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08f807a6-65f4-45e2-8053-28021710a54d tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.694387 Aug 29 11:09:23.756339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2934/5832] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:23 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:24.798610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:24.803406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:24.819869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=25 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:24.825365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:24.825925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:24.826387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:24.827126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:24.827600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:24.828040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:24.836455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=67 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:25.435357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:25.455928 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28f62c60-a291-498f-80ed-bc726d647675 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 0.674249 Aug 29 11:09:25.473726 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2899/5833] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:24 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:09:26.296154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2ea94f-7a61-4535-9c36-1b5180437586", "name": "network-vif-plugged", "status": "completed", "tag": "156131e5-0f17-4eaf-a3a3-b531af222074"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:26.319602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:26.320262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:26.322534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:26.352238 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] Creating event network-vif-plugged:156131e5-0f17-4eaf-a3a3-b531af222074 for instance 7f2ea94f-7a61-4535-9c36-1b5180437586 on n-h2-854121-10 Aug 29 11:09:26.362172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-eb1300f5-fc93-41e4-b38f-40c9b7d7763b req-b4546369-5d2b-4483-aff4-b6d423200620 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071820 Aug 29 11:09:26.363323 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2935/5834] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:09:26.485210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:26.485936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:26.498740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:26.499552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:26.500798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:26.502523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:26.505343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:26.505838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:27.527816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:27.554587 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-089f3065-1888-4317-a7d7-993984b4835b tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1315 microversion: 2.1 time: 1.072573 Aug 29 11:09:27.558446 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2900/5835] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:26 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:28.581016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:28.582577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:28.586578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:28.597071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:28.597576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:28.610279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:28.611322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:28.612114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:28.612822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:28.618957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:29.183413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:29.194986 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c93cae90-9949-43c7-8ec3-8f0ac62878fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1465 microversion: 2.1 time: 0.619052 Aug 29 11:09:29.197055 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2936/5836] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:28 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1465 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:29.250229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:29.250820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:29.262429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:29.265559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:29.266119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:29.266885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:29.267369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:29.267810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:29.343570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:09:29.503794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa8a3d51-5245-4056-b99e-31afd816c8a3 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 204 len: 0 microversion: 2.1 time: 0.255839 Aug 29 11:09:29.505165 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2901/5837] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:09:29 2022] DELETE /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:09:29.527785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:29.531306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:29.546415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:29.547985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:29.548969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:29.550347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:29.551592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:29.552367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:30.033139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:30.083143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02a6fb8e-1289-4872-998a-42ed9708b15f tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1471 microversion: 2.1 time: 0.570771 Aug 29 11:09:30.094706 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2937/5838] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:29 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:31.114751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:31.115460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:31.130825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:31.134540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:31.135508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:31.137929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:31.142176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:31.143093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:31.600117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:31.619307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-40192f69-7ac2-45bc-818c-014fdaee39fd tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1471 microversion: 2.1 time: 0.508812 Aug 29 11:09:31.632988 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2902/5839] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:31 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:32.647242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:32.648474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:32.680215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:32.681748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:32.690148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:32.690148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:32.690148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:32.690148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:32.844983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e8c10acb8e4c4db0c0e4019502d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a737dfc249e24857a22364b6ac717be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:32.867054 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a16f3376-39d7-455c-8745-ee1e07763fed tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 200 len: 1429 microversion: 2.1 time: 0.224602 Aug 29 11:09:32.869814 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2938/5840] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:32 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 1429 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:09:32.885336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2ea94f-7a61-4535-9c36-1b5180437586", "name": "network-vif-deleted", "tag": "156131e5-0f17-4eaf-a3a3-b531af222074"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:32.925915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:32.927549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:32.928080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:32.976290 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] Creating event network-vif-deleted:156131e5-0f17-4eaf-a3a3-b531af222074 for instance 7f2ea94f-7a61-4535-9c36-1b5180437586 on n-h2-854121-10 Aug 29 11:09:32.989554 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f82a2d41-280b-4622-8511-bba92f1f399e req-f20a70fa-0932-4502-bc34-3608e3997bb5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108475 Aug 29 11:09:32.992232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2903/5841] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:09:33.902949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:33.904421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] [instance: 7f2ea94f-7a61-4535-9c36-1b5180437586] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:33.931021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:33.932150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:33.932603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:33.938643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:33.950600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:33.951221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:34.000901 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] HTTP exception thrown: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Request method failure captured: Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 HTTP/1.1 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ5JZ2uVEH8U75XEZq4EMXp1aPVbV1PXoiDAOSLb0PCpBe6j66qhbdghYBErSSNvP65VePyW0CmV4EWSXBbgLmL5BFFcTDqav02Ylz-JZB-yaIuzbM699nZ_Z45z3LexpUFl4jbhO2sEoRIa1K9hMobu__2-DvnNbHib133rQjNHejo Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: a737dfc249e24857a22364b6ac717be5 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesNegativeTest-1028530698 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a737dfc249e24857a22364b6ac717be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a737dfc249e24857a22364b6ac717be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a737dfc249e24857a22364b6ac717be5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a737dfc249e24857a22364b6ac717be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesNegativeTest-1028530698 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: a737dfc249e24857a22364b6ac717be5 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesNegativeTest-1028530698 Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesNegativeTest-1028530698-project Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a0e8c10acb8e4c4db0c0e4019502d68d Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesNegativeTest-1028530698-project Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '7f2ea94f-7a61-4535-9c36-1b5180437586'} Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:09:34.016492 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. Aug 29 11:09:34.022710 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:09:34.035303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] Returning 404 to user: Instance 7f2ea94f-7a61-4535-9c36-1b5180437586 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:09:34.036328 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17489399-33cb-43c2-95f5-3825fe7571c2 tempest-VolumesNegativeTest-1028530698 tempest-VolumesNegativeTest-1028530698-project] 10.222.0.47 "GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586" status: 404 len: 111 microversion: 2.1 time: 0.139983 Aug 29 11:09:34.039436 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2939/5842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:33 2022] GET /compute/v2.1/servers/7f2ea94f-7a61-4535-9c36-1b5180437586 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:09:36.389224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1bd374fc-2e8d-4670-bfa0-94a09c1aebd4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Action: 'create', calling method: .version_select at 0x7f66c5db1e50>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-476660865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwRGa3sQIJUNZaa7H1kxcAnP+YEUwf+UvBq3ri/8I9BwwiVGn8krR2bNZbwoK9oYqXC+ZCyZnmJrKTBys3ADACOfV5X1RpQTDR5yUSCj1DWX7o1eymirRYfRUJZ83t4bw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:36.437676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1bd374fc-2e8d-4670-bfa0-94a09c1aebd4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for project 93ed2149431d441abee00685ad11a241. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:09:36.445144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1bd374fc-2e8d-4670-bfa0-94a09c1aebd4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for user b1df8db1d67745edbce5d6c5b3b3bf88 and project 93ed2149431d441abee00685ad11a241. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:09:36.490149 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1bd374fc-2e8d-4670-bfa0-94a09c1aebd4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.318715 Aug 29 11:09:36.491810 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2904/5843] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:09:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:09:53.147433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1491968585-access_point-1735969368", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "af0d35fe-baff-4549-98ec-be84c8da09b3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-476660865", "security_groups": [{"name": "tempest-secgroup_access--406661971"}, {"name": "tempest-secgroup_general--606955794"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:53.164564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=7 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:53.166119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=19 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:53.526413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] validate_networks() for [('af0d35fe-baff-4549-98ec-be84c8da09b3', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:09:54.309312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:09:54.310091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:09:54.310380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:09:54.310657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:09:54.311843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:09:54.332100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:54.336855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:54.337322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:54.338131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:54.338595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:54.342808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:54.387090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for project 93ed2149431d441abee00685ad11a241. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:09:54.399123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for user b1df8db1d67745edbce5d6c5b3b3bf88 and project 93ed2149431d441abee00685ad11a241. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:09:54.439220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:09:54.441492 n-d-854121-10 devstack@n-api.service[128681]: WARNING nova.utils [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1491968585-access_point-1735969368 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1491968585-ac Aug 29 11:09:54.442309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:09:54.568602 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fe2fce88-41a5-4fc2-971a-1989b6cae107 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.422632 Aug 29 11:09:54.569424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2940/5844] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:09:53 2022] POST /compute/v2.1/servers => generated 456 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:09:54.578678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:54.580062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:54.581007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:09:54.585599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c742f46-57e2-4ad0-8266-7c201cc8c7b4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:54.586698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c742f46-57e2-4ad0-8266-7c201cc8c7b4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:54.716050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c742f46-57e2-4ad0-8266-7c201cc8c7b4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:54.739056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c742f46-57e2-4ad0-8266-7c201cc8c7b4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1294 microversion: 2.1 time: 0.162086 Aug 29 11:09:54.739650 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2905/5845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:54 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:09:55.778383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:55.780779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:55.796564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:55.797721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:55.798705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:55.801224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:55.802330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:55.803283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:56.064863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:56.100285 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d4d0d3ec-86fe-47e9-8008-040bd2709918 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1290 microversion: 2.1 time: 0.327963 Aug 29 11:09:56.103536 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2941/5846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:55 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1290 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:57.126232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:57.135198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:57.149448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:57.150083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:57.150981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:57.152642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:57.153083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:57.153534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:57.351917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:57.365834 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-91eb63cf-1a36-41a9-82b2-6a0672e9c936 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1352 microversion: 2.1 time: 0.242152 Aug 29 11:09:57.366479 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2906/5847] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:57 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:58.389318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:58.390235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:58.407033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:58.407776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:58.408816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:58.411154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:58.418985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:58.419935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:58.921895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:09:58.939647 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-334d8c54-8fc4-4593-8375-10a37822b6b8 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.554883 Aug 29 11:09:58.944434 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2942/5848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:58 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:09:59.826777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4484af-1408-497b-9d7c-862cf879a603", "tag": "7da8ccc2-65ef-44a4-9a10-7f8e37fd5111"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:09:59.856634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:59.857403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:59.857520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:59.888547 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] Creating event network-changed:7da8ccc2-65ef-44a4-9a10-7f8e37fd5111 for instance 4d4484af-1408-497b-9d7c-862cf879a603 on n-h2-854121-10 Aug 29 11:09:59.897734 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-dcd7e46f-b5ec-4f08-8b8c-a6519b457fd3 req-ca8422ec-c188-4322-b442-67fdfdd24758 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074615 Aug 29 11:09:59.902231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2907/5849] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:09:59.964166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:09:59.965457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:09:59.975872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:59.977569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:59.978383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:09:59.979691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:09:59.984733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:09:59.985461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:00.262211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:00.270789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f234884-6b60-4097-813c-917e92419810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.312365 Aug 29 11:10:00.287657 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2943/5850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:09:59 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:01.298165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:01.299362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:01.326742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:01.338280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:01.339059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:01.340052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:01.340698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:01.341778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:01.815874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:01.827348 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ced9326f-e8fe-47e4-92f1-4e260462f790 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.535621 Aug 29 11:10:01.834610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2908/5851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:01 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:02.858763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:02.859502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:02.872742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:02.873249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:02.873692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:02.876545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:02.877030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:02.878097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:03.103838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:03.113926 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4812150-a3ef-4361-aff9-6b90d5a35884 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.262726 Aug 29 11:10:03.115051 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2944/5852] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:02 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:04.141583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:04.142978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:04.154608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:04.156014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:04.156941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:04.158087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:04.158905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:04.159558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:04.455907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:04.466220 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d2cb287-ecf9-4e34-ab62-241a1c373c65 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.332066 Aug 29 11:10:04.484803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2909/5853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:04 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:05.234901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4484af-1408-497b-9d7c-862cf879a603", "name": "network-vif-plugged", "status": "completed", "tag": "7da8ccc2-65ef-44a4-9a10-7f8e37fd5111"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:05.250955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:05.253171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:05.269769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:05.270376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:05.270968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:05.303450 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] Creating event network-vif-plugged:7da8ccc2-65ef-44a4-9a10-7f8e37fd5111 for instance 4d4484af-1408-497b-9d7c-862cf879a603 on n-h2-854121-10 Aug 29 11:10:05.312339 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ebb2b7dd-58b4-40d1-8e80-73cae8de62d2 req-a549cab1-701a-4275-9b28-1465f87a6475 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083332 Aug 29 11:10:05.317033 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2945/5854] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:05.495592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:05.502023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:05.508541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:05.521061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:05.522283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:05.527826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:05.529573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:05.531089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:05.532076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:05.764771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:05.779820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bcd4a30-6623-4362-936f-f669a709de6d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1470 microversion: 2.1 time: 0.291247 Aug 29 11:10:05.785626 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2910/5855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:05 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:06.802955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:06.804555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:06.816595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:06.817087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:06.817546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:06.821350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:06.821863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:06.822378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:07.147200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:07.160030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-847fc550-9fbf-4e48-bcef-cf6f8310c341 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1642 microversion: 2.1 time: 0.362439 Aug 29 11:10:07.166144 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2946/5856] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:06 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1642 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:07.196358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:07.196788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:07.207754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:07.210210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:07.211736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:07.213041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:07.213514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:07.216153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:07.543328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:07.552815 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e784df4-eda3-4ed4-a0e5-af24ec3f05bb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1642 microversion: 2.1 time: 0.362454 Aug 29 11:10:07.558586 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2911/5857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:07 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1642 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:07.579379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:07.580231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:07.588683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:07.595199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:07.597429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:07.601383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:07.602442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:07.604203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:08.107221 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec89e34a-566a-4413-8250-dd23a8b885f4 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1795 microversion: 2.1 time: 0.531567 Aug 29 11:10:08.118188 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2947/5858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:07 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1795 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:11.401796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4484af-1408-497b-9d7c-862cf879a603", "tag": "7da8ccc2-65ef-44a4-9a10-7f8e37fd5111"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:11.439736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:11.440237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:11.440675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:11.469646 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] Creating event network-changed:7da8ccc2-65ef-44a4-9a10-7f8e37fd5111 for instance 4d4484af-1408-497b-9d7c-862cf879a603 on n-h2-854121-10 Aug 29 11:10:11.490101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-36643be4-cb55-4e7a-ba79-266abbf97493 req-bef4a18f-b8db-480b-bd52-d3eabf9fa58c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092955 Aug 29 11:10:11.496470 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2912/5859] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:15.428323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:15.430146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:15.445151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:15.449372 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:15.450416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:15.452487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:15.453195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:15.454275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:15.529192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:10:15.696700 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4bad6836-6349-4f04-a4da-7d72a352fab3 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 204 len: 0 microversion: 2.1 time: 0.740476 Aug 29 11:10:15.699182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2948/5860] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:10:14 2022] DELETE /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:10:15.712220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:15.713537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:15.722250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:15.722894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:15.723464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:15.724508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:15.725014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:15.726127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:16.133117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:16.143805 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf1640e7-7d24-43c3-a8ab-dd3bb7d61234 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1733 microversion: 2.1 time: 0.440366 Aug 29 11:10:16.144724 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2913/5861] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:15 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1733 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:17.169574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:17.170483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:17.177625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:17.178437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:17.179400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:17.180399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:17.181114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:17.181804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:17.485383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:17.497194 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-729bcf37-69f8-4f1a-9c7b-2b0f0bd735cc tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1733 microversion: 2.1 time: 0.331892 Aug 29 11:10:17.498452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2949/5862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:17 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1733 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:18.523322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:18.524905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:18.534369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:18.535214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:18.537355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:18.539571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:18.540325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:18.541065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:18.909014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:18.920174 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-245cf45d-c1df-480c-963c-cd63e7aa7cbb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1733 microversion: 2.1 time: 0.403917 Aug 29 11:10:18.920771 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2914/5863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:18 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1733 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:19.334160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f885c335-1663-4f6d-a7e2-09b61c6aef36", "name": "network-vif-deleted", "tag": "862e538f-162a-4344-84aa-35ed619aba43"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:19.372806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:19.373648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:19.375103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:19.399392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] Creating event network-vif-deleted:862e538f-162a-4344-84aa-35ed619aba43 for instance f885c335-1663-4f6d-a7e2-09b61c6aef36 on n-h1-854121-10 Aug 29 11:10:19.409017 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-edbe0859-7eef-4761-b250-5e50af8c32e7 req-e587791d-dec8-464e-9497-ffa2bc4f6a58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079770 Aug 29 11:10:19.410217 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2950/5864] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:19.943439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:19.943967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:19.952901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:19.964045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:19.966821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:19.967729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:19.968366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:19.968936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:20.078015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:20.078516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:20.086583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:20.087260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lazy-loading 'fault' on Instance uuid f885c335-1663-4f6d-a7e2-09b61c6aef36 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:10:20.166345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758ff8fafb5b4dae86f5e5fdfd3e4ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324addf743cd4496aee6b8c87fe58c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:20.177543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c29af633-8da9-484d-b04a-90df63de3fc6 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 200 len: 1389 microversion: 2.1 time: 0.234542 Aug 29 11:10:20.178739 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2915/5865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:19 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 1389 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:21.218124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:21.220259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:21.229846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:21.230365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:21.230866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:21.231603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:21.232691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:21.233143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:21.263775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] HTTP exception thrown: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Request method failure captured: Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 HTTP/1.1 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ1C16GiYjXkOIYz2uUkM5RwbokvuOmJEq0gtFj7zGZHmXw3HI8ta8Hh2N14HFZxgKjuUpvMW6ZWyUpR9LUMF6JQdNcdw94lfeCUhSzlZKVksSckP4Hw-kia_pPMVGWqlt7Ev_29n6YUTln3dqFi1agz2Ix4OM-vILWwgH5fyTF7peU Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestServerBasicOps-704295711 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 758ff8fafb5b4dae86f5e5fdfd3e4ab2 Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f885c335-1663-4f6d-a7e2-09b61c6aef36'} Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:21.265833 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Returning 404 to user: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db9aac5a-c2dd-4f79-904f-45ea9442a4fa tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 404 len: 111 microversion: 2.1 time: 0.067794 Aug 29 11:10:21.268792 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2951/5866] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:21 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:10:22.039898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:22.040445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:22.086256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:22.086965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:22.087550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:22.088408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:22.089149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:22.089872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:22.138310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] HTTP exception thrown: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Request method failure captured: Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 HTTP/1.1 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ1C16GiYjXkOIYz2uUkM5RwbokvuOmJEq0gtFj7zGZHmXw3HI8ta8Hh2N14HFZxgKjuUpvMW6ZWyUpR9LUMF6JQdNcdw94lfeCUhSzlZKVksSckP4Hw-kia_pPMVGWqlt7Ev_29n6YUTln3dqFi1agz2Ix4OM-vILWwgH5fyTF7peU Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 758ff8fafb5b4dae86f5e5fdfd3e4ab2 Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f885c335-1663-4f6d-a7e2-09b61c6aef36'} Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:10:22.140187 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.143175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.146258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Returning 404 to user: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:10:22.148726 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-979750f9-2ed6-4ac9-ae8e-01ae32002285 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 404 len: 111 microversion: 2.1 time: 0.120240 Aug 29 11:10:22.149936 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2952/5867] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:10:22 2022] DELETE /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:10:22.159787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:22.162618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] [instance: f885c335-1663-4f6d-a7e2-09b61c6aef36] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:22.186214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:22.187015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:22.187586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:22.192760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:22.202042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:22.203168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:22.234284 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] HTTP exception thrown: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Request method failure captured: Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 HTTP/1.1 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ1C16GiYjXkOIYz2uUkM5RwbokvuOmJEq0gtFj7zGZHmXw3HI8ta8Hh2N14HFZxgKjuUpvMW6ZWyUpR9LUMF6JQdNcdw94lfeCUhSzlZKVksSckP4Hw-kia_pPMVGWqlt7Ev_29n6YUTln3dqFi1agz2Ix4OM-vILWwgH5fyTF7peU Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/324addf743cd4496aee6b8c87fe58c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 324addf743cd4496aee6b8c87fe58c17 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestServerBasicOps-704295711 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 758ff8fafb5b4dae86f5e5fdfd3e4ab2 Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestServerBasicOps-704295711-project Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f885c335-1663-4f6d-a7e2-09b61c6aef36'} Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:22.236752 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. Aug 29 11:10:22.239751 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:22.243939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Returning 404 to user: Instance f885c335-1663-4f6d-a7e2-09b61c6aef36 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:10:22.247169 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-affab74f-8a45-4c9f-b3a5-850b0112f2b2 tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36" status: 404 len: 111 microversion: 2.1 time: 0.093177 Aug 29 11:10:22.247768 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2953/5868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:22 2022] GET /compute/v2.1/servers/f885c335-1663-4f6d-a7e2-09b61c6aef36 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:10:22.298752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-215954632", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "1bee26de-4478-45bb-a7ab-70558795f461"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:22.381065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] validate_networks() for [('1bee26de-4478-45bb-a7ab-70558795f461', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:10:22.577783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6794a6da-57b8-4cda-92c4-b10ac18de1bb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] Calling method '.version_select at 0x7f66c6c0e4c0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:22.610823 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6794a6da-57b8-4cda-92c4-b10ac18de1bb tempest-TestServerBasicOps-704295711 tempest-TestServerBasicOps-704295711-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1847755968" status: 202 len: 0 microversion: 2.1 time: 0.036880 Aug 29 11:10:22.611617 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2954/5869] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 29 11:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1847755968 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:10:23.273655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:10:23.274387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:10:23.275167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:10:23.275907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:10:23.276542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:10:23.287073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:23.288363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:23.289168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:23.290158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:23.290932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:23.291655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:23.334331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Getting quotas for project 2418d9b4856f477e978ff1ce18b3f7f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:10:23.346313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Getting quotas for user 77591bdb863f47e1b5a58b57d32c4ca8 and project 2418d9b4856f477e978ff1ce18b3f7f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:10:23.368164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:10:23.371164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:10:23.431294 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [fbb0b732-432d-45e9-941a-43e94fa7cb1b] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:10:24.448536 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [fbb0b732-432d-45e9-941a-43e94fa7cb1b] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 51582. Aug 29 11:10:24.454615 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9791143d-6e8f-401f-ba3d-5212344ca080 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513891 Aug 29 11:10:24.455680 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2916/5870] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:10:24.469819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94707e13-1591-4511-8300-45f670eadb6e tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:24.471279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-94707e13-1591-4511-8300-45f670eadb6e tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:24.484259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:24.719522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94707e13-1591-4511-8300-45f670eadb6e tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:24.733992 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94707e13-1591-4511-8300-45f670eadb6e tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1213 microversion: 2.1 time: 0.269566 Aug 29 11:10:24.735280 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2955/5871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:24 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:25.758459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:25.762704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:25.777364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:25.779008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:25.779518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:25.779970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:25.782196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:25.782196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:25.782196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:25.796312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=57 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:25.956999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:25.972215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c22733a-9d45-4101-b094-3a26dd618bd3 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1209 microversion: 2.1 time: 0.217897 Aug 29 11:10:25.976050 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2917/5872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:25 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:27.004545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:27.005421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:27.021174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:27.021962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:27.022586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:27.025624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:27.026628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:27.027284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:27.031887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:27.180912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:27.197105 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21ce4e18-38a6-40b0-8893-7e9275f1f558 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1271 microversion: 2.1 time: 0.202066 Aug 29 11:10:27.197917 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2956/5873] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:26 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:28.222560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:28.223837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:28.242175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:28.242845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:28.243547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:28.244513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:28.245192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:28.245882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:28.383157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:28.397795 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-528e24c4-b8a3-42c0-80cd-4fd81671369d tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1271 microversion: 2.1 time: 0.178948 Aug 29 11:10:28.398783 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2918/5874] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:28 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:29.426343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:29.427651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:29.445313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:29.448261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:29.450184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:29.452150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:29.452659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:29.455348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:29.799245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:29.814194 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acef6f70-6dee-4c7f-ab2b-872792696bbd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.397434 Aug 29 11:10:29.815369 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2957/5875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:29 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:30.513476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7785707-5d25-4887-ba6e-51a141f9b503", "tag": "fc90ee62-8a61-4206-b765-3deb189f2aaf"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:30.528914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:30.530015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:30.530797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:30.546136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] Creating event network-changed:fc90ee62-8a61-4206-b765-3deb189f2aaf for instance d7785707-5d25-4887-ba6e-51a141f9b503 on n-h1-854121-10 Aug 29 11:10:30.555099 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-82996c36-3850-4723-b596-6e1d9ad8d3c1 req-059eefb3-4338-4937-9597-410801eefea1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045876 Aug 29 11:10:30.556042 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2919/5876] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:30.836269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:30.837957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:30.846367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:30.847261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:30.848068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:30.849021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:30.849730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:30.851083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:31.239124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:31.249900 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a3928645-1a62-41ca-90bf-09ea44fef3f2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.417319 Aug 29 11:10:31.252368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2958/5877] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:30 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:10:32.276847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:32.278640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:32.307692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:32.308889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:32.338380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:32.342631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:32.343493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:32.344377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:32.786113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:32.795504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6515498-8514-43b2-8fdd-3f1b5c5314b7 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.524645 Aug 29 11:10:32.796097 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2920/5878] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:32 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:33.821036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:33.821743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:33.836881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:33.837476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:33.843295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:33.851600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:33.854570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:33.858367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:34.307226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:34.326673 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3158e465-4940-4375-b059-a71ad80ea8ec tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.506508 Aug 29 11:10:34.327934 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2959/5879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:33 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:35.355447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:35.356261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:35.371776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:35.372849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:35.375300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:35.376305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:35.376958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:35.378097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:35.378807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:35.379771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:35.779480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7785707-5d25-4887-ba6e-51a141f9b503", "name": "network-vif-plugged", "status": "completed", "tag": "fc90ee62-8a61-4206-b765-3deb189f2aaf"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:35.798477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:35.809905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:35.812461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:35.814202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:35.832492 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] Creating event network-vif-plugged:fc90ee62-8a61-4206-b765-3deb189f2aaf for instance d7785707-5d25-4887-ba6e-51a141f9b503 on n-h1-854121-10 Aug 29 11:10:35.854625 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4d0800d7-94e8-44ba-8c83-814b242e6182 req-3c1af4c3-02bd-4915-91b4-52081b84b3ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078141 Aug 29 11:10:35.857391 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2960/5880] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:10:36.008317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:36.020502 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5db41bd-dfc2-409d-8c48-531a1c9eb3a2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.671467 Aug 29 11:10:36.021454 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2921/5881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:35 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:10:37.048922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:37.050172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:37.073535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:37.074185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:37.074879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:37.075804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:37.076521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:37.077376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:37.481305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:37.500856 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90145eb5-d17f-4283-9bdf-275ad9673df1 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1313 microversion: 2.1 time: 0.452874 Aug 29 11:10:37.516150 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2961/5882] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:37 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:38.524204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:38.525685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:38.536153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:38.538094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:38.539705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:38.542653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:38.543982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:38.546510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:38.820878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:38.832599 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1bc3cbd7-2dd4-4622-9f50-e15a93a7a2ab tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1497 microversion: 2.1 time: 0.313161 Aug 29 11:10:38.842587 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2922/5883] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:38 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:43.316544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:43.317109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:43.325596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:43.326141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:43.326736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:43.327456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:43.328094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:43.328840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:43.363725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:10:43.480661 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b0ed511-e4e4-4c69-acda-dc784b107a55 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 204 len: 0 microversion: 2.1 time: 0.167314 Aug 29 11:10:43.482315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2962/5884] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:10:43 2022] DELETE /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:10:43.492160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:43.492845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:43.500126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:43.501073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:43.501520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:43.502907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:43.503532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:43.504105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:43.737877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:43.747552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed6028e3-6124-40b2-8025-aa6a681782bd tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1503 microversion: 2.1 time: 0.260829 Aug 29 11:10:43.763318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2923/5885] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:43 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:44.772386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:44.773934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:44.790283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:44.792210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:44.793589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:44.794734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:44.795488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:44.796497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:45.504534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77591bdb863f47e1b5a58b57d32c4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2418d9b4856f477e978ff1ce18b3f7f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:45.529166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a771304-7ca9-4688-af79-8714af9c8e85 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 200 len: 1461 microversion: 2.1 time: 0.756842 Aug 29 11:10:45.539276 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2963/5886] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:44 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 1461 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:46.011900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7785707-5d25-4887-ba6e-51a141f9b503", "name": "network-vif-deleted", "tag": "fc90ee62-8a61-4206-b765-3deb189f2aaf"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:46.037995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:46.038616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:46.039991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:46.067744 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] Creating event network-vif-deleted:fc90ee62-8a61-4206-b765-3deb189f2aaf for instance d7785707-5d25-4887-ba6e-51a141f9b503 on n-h1-854121-10 Aug 29 11:10:46.083531 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e405883f-2f01-46a3-bdaa-dda8fefd1471 req-aeac2a2c-e4e4-4b80-8d98-a06d1198d5ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.461975 Aug 29 11:10:46.087078 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2924/5887] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:46.556467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:46.557057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] [instance: d7785707-5d25-4887-ba6e-51a141f9b503] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:46.572884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:46.573445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:46.574116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:46.574890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:46.575393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:46.575855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:46.616442 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] HTTP exception thrown: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Request method failure captured: Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 HTTP/1.1 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ6apItFqTwYENFg1hD20Dj8x6ETfVPAdMNYmMpbqJtduJK-phRBbEQOnzjTMo0QSqVzBmpVem_IzCXZmEl-HsQTM9yH-ASmOpQHz0UhIDix5_kx8o7rmzGvA7OSPY0FhnH5M-9lCtGX7YnLIdQrXQI1RML6lOnFW9QW8DL-_e-Ee5U Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 2418d9b4856f477e978ff1ce18b3f7f9 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesActionsTest-454929073 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2418d9b4856f477e978ff1ce18b3f7f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2418d9b4856f477e978ff1ce18b3f7f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2418d9b4856f477e978ff1ce18b3f7f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2418d9b4856f477e978ff1ce18b3f7f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesActionsTest-454929073 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 2418d9b4856f477e978ff1ce18b3f7f9 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesActionsTest-454929073 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesActionsTest-454929073-project Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 77591bdb863f47e1b5a58b57d32c4ca8 Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesActionsTest-454929073-project Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd7785707-5d25-4887-ba6e-51a141f9b503'} Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:10:46.618230 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. Aug 29 11:10:46.621938 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:10:46.626544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] Returning 404 to user: Instance d7785707-5d25-4887-ba6e-51a141f9b503 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:10:46.633058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-093d90a1-d579-4728-87bb-c33be70daaf2 tempest-VolumesActionsTest-454929073 tempest-VolumesActionsTest-454929073-project] 10.222.0.47 "GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503" status: 404 len: 111 microversion: 2.1 time: 0.083287 Aug 29 11:10:46.637346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2964/5888] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:46 2022] GET /compute/v2.1/servers/d7785707-5d25-4887-ba6e-51a141f9b503 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:10:50.928830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1095719893", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "bdf095e1-0e9b-4d7b-a88c-1595b664b0b1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-476660865", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4d4484af-1408-497b-9d7c-862cf879a603"]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:51.049181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] validate_networks() for [('bdf095e1-0e9b-4d7b-a88c-1595b664b0b1', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:10:52.003024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:10:52.004536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:10:52.005178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:10:52.005811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:10:52.006409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:10:52.023915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:52.024992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:52.025454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:52.026372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:52.026835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:52.027455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:52.050933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for project 93ed2149431d441abee00685ad11a241. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:10:52.058261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Getting quotas for user b1df8db1d67745edbce5d6c5b3b3bf88 and project 93ed2149431d441abee00685ad11a241. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:10:52.111716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:10:52.120856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:10:52.260208 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dcb70d96-3992-49a1-9a5e-10a22d912f1c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.336181 Aug 29 11:10:52.267340 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2925/5889] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:10:50 2022] POST /compute/v2.1/servers => generated 361 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:10:52.275269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b84bb719-0426-444d-9d76-f8bbfe400307 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:52.276056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b84bb719-0426-444d-9d76-f8bbfe400307 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:52.808254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b84bb719-0426-444d-9d76-f8bbfe400307 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:52.820489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b84bb719-0426-444d-9d76-f8bbfe400307 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1241 microversion: 2.1 time: 0.552074 Aug 29 11:10:52.826795 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2965/5890] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:52 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1241 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:53.850352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:53.856270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:53.874111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:53.874899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:53.875584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:53.876554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:53.877271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:53.891635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:54.075838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:54.087744 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a6ec05e-4169-4e34-9b5d-670e7e174193 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1293 microversion: 2.1 time: 0.243531 Aug 29 11:10:54.088722 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2926/5891] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:53 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:55.111402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:55.112661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:55.116906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:55.158526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:55.160190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:55.162590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:55.164426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:55.166143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:55.168685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:55.331245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:55.341964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eda04800-9930-416a-bb20-a74298363aad tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.237258 Aug 29 11:10:55.342893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2966/5892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:55 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:56.366807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:56.368132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:56.372622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:56.394075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:56.395005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:56.397393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:56.398488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:56.401368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:56.404763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:56.438139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=48 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:57.079188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:57.110534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7dd47991-1e42-4ffa-a028-406a15e54810 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.748054 Aug 29 11:10:57.115246 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2927/5893] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:56 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:57.740656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129d978d-d658-4f51-91c2-cfbe784fcea4", "tag": "8277a1e7-32e4-480a-885a-be8a9ec9cd2f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:10:57.764994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:57.765925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:57.766897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:57.806725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:10:57.837315 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] Creating event network-changed:8277a1e7-32e4-480a-885a-be8a9ec9cd2f for instance 129d978d-d658-4f51-91c2-cfbe784fcea4 on n-h1-854121-10 Aug 29 11:10:57.850185 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4983a19c-e0d5-49c3-9572-44bf47d3cbe9 req-952d9e9c-1cd3-4af3-bfe3-74e7fec253d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114143 Aug 29 11:10:57.858980 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2967/5894] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:10:58.136472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:58.137224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:58.152586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:58.153633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:58.154747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:58.156212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:58.157681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:58.157828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:58.302995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:58.323262 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dfcd203a-2ec9-42bc-b0fa-6325f210368e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.190728 Aug 29 11:10:58.324419 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2928/5895] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:58 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:10:59.367398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:10:59.368707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:10:59.379636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:59.381179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:59.381827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:59.383062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:10:59.383686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:10:59.384290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:10:59.517454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:10:59.528033 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dba954c3-1c00-43b9-9f46-b10dbdf33211 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.167051 Aug 29 11:10:59.529401 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2968/5896] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:10:59 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:00.567715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:00.570126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:00.582643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:00.584691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:00.586701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:00.589458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:00.592065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:00.593279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:00.836215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:00.843938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5020f8fd-4079-405a-a1ac-3b6fd18d416c tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.285038 Aug 29 11:11:00.844531 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2929/5897] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:00 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:01.867765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:01.868501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:01.888295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:01.888778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:01.889406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:01.890302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:01.890903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:01.891470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:02.113636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:02.123838 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-57762c23-55c3-47c8-b550-a09d15e7bb62 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.262233 Aug 29 11:11:02.128450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2969/5898] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:01 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:11:03.162229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:03.163029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:03.167348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:03.172247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:03.183321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:03.184806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:03.189650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:03.190719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:03.191408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:03.192043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:03.467807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:03.493656 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03fa006c-2b0f-4724-b0d0-1178ac161b46 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.336361 Aug 29 11:11:03.501171 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2930/5899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:03 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:11:03.691292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:04.367172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129d978d-d658-4f51-91c2-cfbe784fcea4", "name": "network-vif-plugged", "status": "completed", "tag": "8277a1e7-32e4-480a-885a-be8a9ec9cd2f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:11:04.390394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:04.391197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:04.391811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:04.425287 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] Creating event network-vif-plugged:8277a1e7-32e4-480a-885a-be8a9ec9cd2f for instance 129d978d-d658-4f51-91c2-cfbe784fcea4 on n-h1-854121-10 Aug 29 11:11:04.440426 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f498b60b-93a0-4e2e-910c-6e61b2015d58 req-59ac1a63-3da9-4229-bf2c-a954fcce702b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.754949 Aug 29 11:11:04.445644 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2970/5900] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:11:04.550298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:04.551682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:04.571424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:04.576208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:04.578356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:04.579448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:04.581058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:04.582628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:04.770993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:04.789434 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bcc2ca15-84a4-4753-8675-096aab4b44ab tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1299 microversion: 2.1 time: 0.244593 Aug 29 11:11:04.807213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2931/5901] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:04 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:05.828062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:05.829160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:05.845583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:05.846316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:05.846886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:05.847691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:05.848632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:05.854466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.029329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:06.047210 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2663330b-a258-4f13-8a12-addb0a18687a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1472 microversion: 2.1 time: 0.225410 Aug 29 11:11:06.049443 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2971/5902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:05 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:06.089656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:06.092354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:06.106438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.107855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.109151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.110738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.111570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.112488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.251297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:06.269602 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7efdd32b-6aea-4aae-a736-9da6a886921e tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1472 microversion: 2.1 time: 0.188483 Aug 29 11:11:06.271200 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2932/5903] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:06 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:06.291002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:06.292168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:06.299409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.300050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.300632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.302359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.302979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.303757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.434405 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ae4ecb0-6b1a-4830-bb01-9f6740edaf68 tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1625 microversion: 2.1 time: 0.146956 Aug 29 11:11:06.447111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2972/5904] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:06 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1625 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:11:06.457168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:06.458896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:06.468346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.469389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.470066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.471204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.472701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.473385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.802422 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ed25669-89aa-4bd4-a686-22785f237f1f tempest-TestSecurityGroupsBasicOps-1087057755 tempest-TestSecurityGroupsBasicOps-1087057755-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1914 microversion: 2.1 time: 0.345931 Aug 29 11:11:06.830799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2933/5905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:06 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1914 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:06.894243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:06.896060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:06.910287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.911252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.914013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.915088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:06.915743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:06.917173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:06.998594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:11:07.208889 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0663fa5c-a014-40e3-8f3e-b2feff48738f tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "DELETE /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 204 len: 0 microversion: 2.1 time: 0.316982 Aug 29 11:11:07.211450 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2973/5906] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:11:06 2022] DELETE /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:11:07.225610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:07.226445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:07.236577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:07.237338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:07.238030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:07.238970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:07.239609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:07.240347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:07.336729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:07.347742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be49b27d-c2af-4bde-8a9f-2f05c66e9c00 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1478 microversion: 2.1 time: 0.129019 Aug 29 11:11:07.348633 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2934/5907] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:07 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1478 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:11:08.370392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:08.371193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:08.380345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:08.381124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:08.381818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:08.382765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:08.383436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:08.384062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:08.517880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:08.526823 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c73ac9f7-2002-41cc-8eaf-a0fb65f8c6a4 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1478 microversion: 2.1 time: 0.160805 Aug 29 11:11:08.527419 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2974/5908] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:08 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:09.556624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:09.557839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:09.579194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:09.582877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:09.584601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:09.592137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:09.593031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:09.594261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:09.731548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:09.753676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14fb87bf-d471-4914-9363-3440ed190324 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 200 len: 1478 microversion: 2.1 time: 0.209477 Aug 29 11:11:09.754327 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2935/5909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:09 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:10.054898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129d978d-d658-4f51-91c2-cfbe784fcea4", "name": "network-vif-deleted", "tag": "8277a1e7-32e4-480a-885a-be8a9ec9cd2f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:11:10.079876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:10.081452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:10.082197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:10.103499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] Creating event network-vif-deleted:8277a1e7-32e4-480a-885a-be8a9ec9cd2f for instance 129d978d-d658-4f51-91c2-cfbe784fcea4 on n-h1-854121-10 Aug 29 11:11:10.115964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ea25dbb9-6a5c-4b0f-8d20-c17b86b1d8ff req-e11b2a00-4d4a-48c2-8e49-216295db330d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068540 Aug 29 11:11:10.123345 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2975/5910] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:11:10.779199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:10.779818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 129d978d-d658-4f51-91c2-cfbe784fcea4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:10.815796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:10.819528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:10.820658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:10.827183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:10.829055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:10.830312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:10.888553 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] HTTP exception thrown: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Request method failure captured: Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 HTTP/1.1 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ5tobul7aZJ6lPe8aIqZtgiPv-SSogx0MyFZLKPM8IOMaR-4D3oYJ77skTiDvxn_94HVcleUoZM2TPizpxR2Mao_xC9TDNwEKWcmT_VccGvt2CwZWuNAOf7X-aF1UpqLL0Y1QH8WfNMkWLC1Qeco-p1xB3wnHCmd0R4g713Umyi0TE Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 93ed2149431d441abee00685ad11a241 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93ed2149431d441abee00685ad11a241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93ed2149431d441abee00685ad11a241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93ed2149431d441abee00685ad11a241"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93ed2149431d441abee00685ad11a241"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 93ed2149431d441abee00685ad11a241 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestSecurityGroupsBasicOps-1491968585-project Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b1df8db1d67745edbce5d6c5b3b3bf88 Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1491968585-project Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '129d978d-d658-4f51-91c2-cfbe784fcea4'} Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:11:10.893291 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. Aug 29 11:11:10.898775 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:11:10.900814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Returning 404 to user: Instance 129d978d-d658-4f51-91c2-cfbe784fcea4 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:11:10.903034 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d35a4840-de70-4708-8716-9f78e76289cd tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4" status: 404 len: 111 microversion: 2.1 time: 0.128151 Aug 29 11:11:10.904782 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2936/5911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:10 2022] GET /compute/v2.1/servers/129d978d-d658-4f51-91c2-cfbe784fcea4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:11:20.342250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:20.343426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:20.374325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:20.382113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:20.427750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:20.428654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:20.429412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:20.438041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:20.439024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:20.439763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:20.555644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:11:20.809637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=19 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:20.851989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=55 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:11:20.958327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55ad1d8f-48aa-4d9e-a9ce-d8437020830a tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 204 len: 0 microversion: 2.1 time: 0.657444 Aug 29 11:11:20.962493 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2976/5912] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:11:20 2022] DELETE /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:11:20.986497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:20.997016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4484af-1408-497b-9d7c-862cf879a603", "tag": "7da8ccc2-65ef-44a4-9a10-7f8e37fd5111"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:11:21.004309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:21.039720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:21.043475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:21.044719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:21.045877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:21.046317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:21.048437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:21.049101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:21.049760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:21.057400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:21.089642 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] Creating event network-changed:7da8ccc2-65ef-44a4-9a10-7f8e37fd5111 for instance 4d4484af-1408-497b-9d7c-862cf879a603 on n-h2-854121-10 Aug 29 11:11:21.096291 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d7d4a992-3b6e-4313-9562-c7c8e48e4b80 req-b230ca02-1d20-44a3-9208-01219cd756eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.791712 Aug 29 11:11:21.099284 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2937/5913] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:11:21.394494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:21.418728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55f76bf7-06a7-49dc-bdf7-8a9d18b86053 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1767 microversion: 2.1 time: 0.451137 Aug 29 11:11:21.419676 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2977/5914] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:20 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1767 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:22.453636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:22.454724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:22.484959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:22.485457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:22.490391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:22.494977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:22.494977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:22.494977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:23.710251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:23.718278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a9d6900-e7e7-4839-8730-e5cb45219472 tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1767 microversion: 2.1 time: 1.280594 Aug 29 11:11:23.720019 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2938/5915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:22 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1767 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:11:24.101029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4484af-1408-497b-9d7c-862cf879a603", "name": "network-vif-deleted", "tag": "7da8ccc2-65ef-44a4-9a10-7f8e37fd5111"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:11:24.125238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:24.126975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:24.138520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:24.159955 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] Creating event network-vif-deleted:7da8ccc2-65ef-44a4-9a10-7f8e37fd5111 for instance 4d4484af-1408-497b-9d7c-862cf879a603 on n-h2-854121-10 Aug 29 11:11:24.174580 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-36a25411-7f79-4553-bbcb-8c3d8644dd31 req-3b05cc19-44cf-42de-8fec-4bd2079a3706 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078285 Aug 29 11:11:24.175384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2978/5916] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:11:24.743195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:24.743830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:24.754533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:24.755379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:24.758926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:24.760086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:24.760784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:24.761401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:24.824057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:24.824795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:24.825395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:24.826363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lazy-loading 'fault' on Instance uuid 4d4484af-1408-497b-9d7c-862cf879a603 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:11:24.894164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df8db1d67745edbce5d6c5b3b3bf88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ed2149431d441abee00685ad11a241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:11:24.916062 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90a537fd-f6ab-4c91-a342-7ebf3fd1078d tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 200 len: 1384 microversion: 2.1 time: 0.176033 Aug 29 11:11:24.917507 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2939/5917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:24 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 1384 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:11:25.944513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:25.945303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] [instance: 4d4484af-1408-497b-9d7c-862cf879a603] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:11:25.961071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:25.964979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:25.966324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:25.968470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:11:25.969095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:11:25.971036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:11:26.045286 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] HTTP exception thrown: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Request method failure captured: Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 HTTP/1.1 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ5tobul7aZJ6lPe8aIqZtgiPv-SSogx0MyFZLKPM8IOMaR-4D3oYJ77skTiDvxn_94HVcleUoZM2TPizpxR2Mao_xC9TDNwEKWcmT_VccGvt2CwZWuNAOf7X-aF1UpqLL0Y1QH8WfNMkWLC1Qeco-p1xB3wnHCmd0R4g713Umyi0TE Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 93ed2149431d441abee00685ad11a241 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93ed2149431d441abee00685ad11a241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93ed2149431d441abee00685ad11a241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93ed2149431d441abee00685ad11a241"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93ed2149431d441abee00685ad11a241"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 93ed2149431d441abee00685ad11a241 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1491968585 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestSecurityGroupsBasicOps-1491968585-project Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b1df8db1d67745edbce5d6c5b3b3bf88 Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1491968585-project Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '4d4484af-1408-497b-9d7c-862cf879a603'} Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:11:26.049190 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. Aug 29 11:11:26.054824 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:11:26.062971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Returning 404 to user: Instance 4d4484af-1408-497b-9d7c-862cf879a603 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:11:26.064191 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0dad9f37-be89-423a-a846-d841de3149eb tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603" status: 404 len: 111 microversion: 2.1 time: 0.125142 Aug 29 11:11:26.071815 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2979/5918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:11:25 2022] GET /compute/v2.1/servers/4d4484af-1408-497b-9d7c-862cf879a603 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:11:33.904711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b127ae49-6b9a-4d91-a77a-5ed4ea23129b tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] Calling method '.version_select at 0x7f66c7570820>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:11:33.963631 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b127ae49-6b9a-4d91-a77a-5ed4ea23129b tempest-TestSecurityGroupsBasicOps-1491968585 tempest-TestSecurityGroupsBasicOps-1491968585-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-476660865" status: 202 len: 0 microversion: 2.1 time: 0.064201 Aug 29 11:11:33.968721 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2940/5919] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-476660865 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:12:25.123181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:12:25.123940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:12:25.341089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7f92f57b-acc6-4452-be86-1ee34df2b7ad tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-958290517", "availability_zone": "foo_zone"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:25.346553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.aggregate [None req-7f92f57b-acc6-4452-be86-1ee34df2b7ad tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Generated uuid db85d6ec-2287-4c3b-9e09-2c32aa81f336 for aggregate {{(pid=128681) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 11:12:25.403566 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7f92f57b-acc6-4452-be86-1ee34df2b7ad tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] [6920e7b3-7a54-41cb-860b-883bfc6bc14c] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:12:26.416623 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [None req-7f92f57b-acc6-4452-be86-1ee34df2b7ad tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] [6920e7b3-7a54-41cb-860b-883bfc6bc14c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54212. Aug 29 11:12:26.425012 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7f92f57b-acc6-4452-be86-1ee34df2b7ad tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.308396 Aug 29 11:12:26.425635 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2980/5920] 10.222.0.47 () {60 vars in 1164 bytes} [Mon Aug 29 11:12:25 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:12:26.440113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f0042b80-29e5-422c-a08f-8925b48da3bc tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:26.446954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:12:26.450146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:12:26.491128 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f0042b80-29e5-422c-a08f-8925b48da3bc tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.056087 Aug 29 11:12:26.493147 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2941/5921] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 11:12:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:12:26.506772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:12:26.512262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:12:26.512794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:12:26.513247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:12:26.514169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:12:26.514834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:12:26.515441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:12:26.578666 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce50ad8b-8a5e-4de8-992e-e1e0d1a8359f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.077315 Aug 29 11:12:26.588013 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2981/5922] 10.222.0.47 () {58 vars in 1176 bytes} [Mon Aug 29 11:12:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:26.597650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32f93da3-3185-4e67-9b7a-d19b16a97fbf tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:12:26.611496 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32f93da3-3185-4e67-9b7a-d19b16a97fbf tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.022144 Aug 29 11:12:26.612534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2942/5923] 10.222.0.47 () {58 vars in 1143 bytes} [Mon Aug 29 11:12:26 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:26.625234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a748633b-80ae-4085-8c40-7b2e8fedb249 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854121-10"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:26.638817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a748633b-80ae-4085-8c40-7b2e8fedb249 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:12:26.640020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a748633b-80ae-4085-8c40-7b2e8fedb249 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:12:26.640482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a748633b-80ae-4085-8c40-7b2e8fedb249 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:12:27.051916 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a748633b-80ae-4085-8c40-7b2e8fedb249 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.430956 Aug 29 11:12:27.053041 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2982/5924] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 11:12:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:27.064964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4fc52927-0ae8-4c09-9948-7a9c4e4b4353 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:12:27.074210 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4fc52927-0ae8-4c09-9948-7a9c4e4b4353 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013959 Aug 29 11:12:27.074888 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2943/5925] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 11:12:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:12:27.090849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ff193ae-6e46-4997-9c40-ef287e76a64d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-777889732", "availability_zone": "foo_zone"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:27.167744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ff193ae-6e46-4997-9c40-ef287e76a64d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.083901 Aug 29 11:12:27.170185 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2983/5926] 10.222.0.47 () {60 vars in 1173 bytes} [Mon Aug 29 11:12:27 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:27.188505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf9cde63-bc8b-4d43-857c-619c6c0e690d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:27.247963 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf9cde63-bc8b-4d43-857c-619c6c0e690d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.068842 Aug 29 11:12:27.250518 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2944/5927] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 11:12:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:27.265726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bc282f45-90bf-42c6-9018-bbc3a97b968d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:12:27.309455 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bc282f45-90bf-42c6-9018-bbc3a97b968d tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.049726 Aug 29 11:12:27.311364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2984/5928] 10.222.0.47 () {58 vars in 1152 bytes} [Mon Aug 29 11:12:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:12:27.326400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ef757c0-f1c2-47f2-8cf1-acc2234692a1 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854121-10"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:12:27.351709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ef757c0-f1c2-47f2-8cf1-acc2234692a1 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:12:27.352441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ef757c0-f1c2-47f2-8cf1-acc2234692a1 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:12:27.353107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ef757c0-f1c2-47f2-8cf1-acc2234692a1 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:12:27.897622 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ef757c0-f1c2-47f2-8cf1-acc2234692a1 tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.577303 Aug 29 11:12:27.899758 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2945/5929] 10.222.0.47 () {60 vars in 1194 bytes} [Mon Aug 29 11:12:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:12:27.913143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cd627b4f-f22b-42ad-b2ba-1fd31e172e1f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:12:27.959148 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cd627b4f-f22b-42ad-b2ba-1fd31e172e1f tempest-TestAggregatesBasicOps-1822365590 tempest-TestAggregatesBasicOps-1822365590-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.050403 Aug 29 11:12:27.959752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2985/5930] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 29 11:12:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 11:13:13.973385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:13.974186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:13.979308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-804420267", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:13:14.035687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] validate_networks() for None {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:13:14.233631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:13:14.234102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:13:14.235224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:13:14.235721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:13:14.236177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:13:14.245200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:14.245690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:14.246175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:14.246899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:14.247362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:14.247793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:14.268393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Getting quotas for project 5821bfc19be940369fd55e73587d5f19. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:13:14.275459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Getting quotas for user 22d0baa6e5724589a3b29098eb68e646 and project 5821bfc19be940369fd55e73587d5f19. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:13:14.290110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:13:14.292431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:13:14.337189 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f8d93022-960d-436a-aebe-48e51891caf8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.365550 Aug 29 11:13:14.337916 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2946/5931] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:13:14.347481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:14.348380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:14.349040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:14.356595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a21a5cb7-fbbe-4d15-89f3-57f47cb86934 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:14.357255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a21a5cb7-fbbe-4d15-89f3-57f47cb86934 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:14.418927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a21a5cb7-fbbe-4d15-89f3-57f47cb86934 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:14.427135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a21a5cb7-fbbe-4d15-89f3-57f47cb86934 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1213 microversion: 2.1 time: 0.081841 Aug 29 11:13:14.427915 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2986/5932] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:14 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:13:15.449789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:15.451657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:15.462931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:15.463497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:15.464009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:15.464787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:15.465344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:15.465948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:15.556834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:15.568880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4511c48b-59a4-4cb5-a12b-1bac8f02936b tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1283 microversion: 2.1 time: 0.124562 Aug 29 11:13:15.569600 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2947/5933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:15 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:16.592710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:16.595338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:16.602470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:16.603294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:16.603940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:16.605424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:16.605836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:16.606455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:16.832151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:16.842272 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acd62182-195c-4afe-af0f-8b1a3a737c7f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.253513 Aug 29 11:13:16.843264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2987/5934] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:16 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:17.358994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd8198d-be90-4d64-a60d-cf36405d0696", "tag": "67af752d-100d-4d5b-a64b-f40cb6f01b8c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:13:17.382008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:17.393135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:17.393759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:17.408639 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] Creating event network-changed:67af752d-100d-4d5b-a64b-f40cb6f01b8c for instance 6bd8198d-be90-4d64-a60d-cf36405d0696 on n-h2-854121-10 Aug 29 11:13:17.415388 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b382e209-ecfd-4054-8bb4-1158f7b7076d req-cecd4e2c-ed94-4365-aeb3-617def032bce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061653 Aug 29 11:13:17.416551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2948/5935] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:13:17.865235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:17.865873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:17.873036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:17.873529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:17.874005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:17.874707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:17.875774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:17.876269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:18.027543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:18.035907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c85ed794-4cb0-4315-8f6f-b68cd9d64852 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.174649 Aug 29 11:13:18.036514 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2988/5936] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:17 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:13:19.057850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:19.058556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:19.066382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:19.067134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:19.067772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:19.068690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:19.069152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:19.069581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:19.204570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:19.212558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-253008f4-8011-4810-a5f9-c68ba0642a4f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.159825 Aug 29 11:13:19.213229 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2949/5937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:19 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:20.232534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:20.233292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:20.240878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:20.241458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:20.242356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:20.243131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:20.243732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:20.245020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:20.396841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:20.408708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aedf0f31-c39c-4423-ad63-06628e9c6255 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.180068 Aug 29 11:13:20.414203 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2989/5938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:20 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:21.429231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:21.430050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:21.436924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:21.437413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:21.438450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:21.439231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:21.439694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:21.440391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:21.587885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:21.596991 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-936537b3-ca09-407b-9841-84a0598de56d tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.171655 Aug 29 11:13:21.597872 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2950/5939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:21 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:22.013321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8198d-be90-4d64-a60d-cf36405d0696", "name": "network-vif-plugged", "status": "completed", "tag": "67af752d-100d-4d5b-a64b-f40cb6f01b8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:13:22.034877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:22.035713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:22.036458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:22.050847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] Creating event network-vif-plugged:67af752d-100d-4d5b-a64b-f40cb6f01b8c for instance 6bd8198d-be90-4d64-a60d-cf36405d0696 on n-h2-854121-10 Aug 29 11:13:22.057364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-88eac6db-eae7-486b-b8dc-6710e65032b4 req-e7f9c5d9-e4cb-4716-93a6-c8db882e5158 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050151 Aug 29 11:13:22.058660 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2990/5940] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:13:22.618937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:22.619559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:22.628231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:22.628722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:22.629166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:22.629945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:22.630406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:22.630841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:22.776453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:22.784657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-387134f5-82ac-4ef3-b023-7b78f8ba51e2 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1313 microversion: 2.1 time: 0.169745 Aug 29 11:13:22.793735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2951/5941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:22 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:23.806754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:13:23.807580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:23.815186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:23.815675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:23.816111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:23.816808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:23.817262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:23.817688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:23.951338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:13:23.960481 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-66c16de2-2bad-46d0-884d-7720da2d88d8 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1463 microversion: 2.1 time: 0.157934 Aug 29 11:13:23.961083 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2991/5942] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:13:23 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:13:23.981999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fae0d469-d24f-490c-b5ac-f23660935193", "device": "/dev/sdb"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:13:23.986197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:13:23.993115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:23.993676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:23.994221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:23.995031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:13:23.995560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:13:23.996076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:13:24.255502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:13:24.257484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e609221-0cda-4f2f-bd02-09458b8a36a9 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "POST /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279521 Aug 29 11:13:24.263507 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2952/5943] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:13:23 2022] POST /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:14:15.702136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:15.703033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=14 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:15.703892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=26 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:15.908466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f049ef8e-b0d8-44d8-bcd7-6ebcb866fbb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: .version_select at 0x7f66c6c0e3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1333891131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0fBi85txSL+kafym8Q1cbcw28bj2r6WcylKz6GyfDWMrUqjOUmB4svUuokAeOoTwWmor1gOb+VjCapMFBK3hWYgpVYKzhfjCH7CffXpCnpmP6mwKvTi6d6pgSJ0858NA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:15.924818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f049ef8e-b0d8-44d8-bcd7-6ebcb866fbb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:14:15.930432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f049ef8e-b0d8-44d8-bcd7-6ebcb866fbb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:14:15.957675 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f049ef8e-b0d8-44d8-bcd7-6ebcb866fbb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.260762 Aug 29 11:14:15.958245 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2992/5944] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:14:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:14:22.417613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1728363290", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "c2219166-30e2-4612-ae42-76c5e8ddf6d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1333891131", "security_groups": [{"name": "tempest-secgroup-smoke-1064273170"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:22.436755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:22.438585 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:14:22.439468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:22.440443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:22.740633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] validate_networks() for [('c2219166-30e2-4612-ae42-76c5e8ddf6d2', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:14:23.448130 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 57596. Aug 29 11:14:23.679537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:14:23.680252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:14:23.681155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:14:23.681332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:14:23.681962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:14:23.692927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:23.693650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:23.694139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:23.694886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:23.695347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:23.695971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:23.715378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:14:23.721615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:14:23.735336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:14:23.737814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:14:23.808131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae989dcc-dbd2-4dc4-a02e-e9913cf9ebb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.396232 Aug 29 11:14:23.808938 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2953/5945] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:14:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:14:23.823277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5997959e-49a0-4cc9-a073-b2e24bbae97c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:23.824479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5997959e-49a0-4cc9-a073-b2e24bbae97c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:24.081345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5997959e-49a0-4cc9-a073-b2e24bbae97c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:24.092339 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5997959e-49a0-4cc9-a073-b2e24bbae97c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1267 microversion: 2.1 time: 0.273961 Aug 29 11:14:24.095823 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2993/5946] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:23 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:25.119354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:25.120154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:25.134766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:25.135413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:25.135862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:25.136735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:25.137198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:25.137624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:25.221542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:25.231293 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f7e9f80-cffe-4cad-b921-b97ffe018a44 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1337 microversion: 2.1 time: 0.118489 Aug 29 11:14:25.232957 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2954/5947] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:25 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:26.254829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:26.255463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:26.264578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:26.265315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:26.266136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:26.266924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:26.267425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:26.267864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:26.415184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:26.424742 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-147e5631-b42f-406f-8478-90d340187fdd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.174060 Aug 29 11:14:26.425656 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2994/5948] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:26 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:26.652225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:26.672914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:26.673694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:26.674424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:26.690662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] Creating event network-changed:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h1-854121-10 Aug 29 11:14:26.697391 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d89bc421-d115-413d-b029-e62ed3265f44 req-c7b59c59-7cfc-4bbe-84bd-f73fde218534 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049127 Aug 29 11:14:26.698054 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2955/5949] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:14:27.446554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:27.447204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:27.454615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:27.455164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:27.455604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:27.456304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:27.456764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:27.457191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:27.593049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:27.601080 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69672ed3-7f53-43ef-8d66-8b764db4829a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.158400 Aug 29 11:14:27.601665 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2995/5950] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:27 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:28.624769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:28.625494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:28.631886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:28.632384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:28.632863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:28.633570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:28.634069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:28.634510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:28.770385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:28.778160 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-302560f6-1fb4-4031-9c06-7a6e4974494b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.159614 Aug 29 11:14:28.779715 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2956/5951] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:28 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:29.800786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:29.801451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:29.808750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:29.809272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:29.810357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:29.811194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:29.811670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:29.812365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:29.956633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:29.966572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1ac2999e-ecaf-4050-b005-41643cb71fb5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.169373 Aug 29 11:14:29.967500 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2996/5952] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:29 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:14:30.989401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:30.991232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:31.001320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:31.001904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:31.002397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:31.003240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:31.003756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:31.004232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:31.184926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:31.193831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c5813df-1d57-476f-a3e5-4641b0408465 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.208351 Aug 29 11:14:31.197735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2957/5953] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:30 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:32.216874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:32.217639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:32.225288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:32.225809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:32.226303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:32.226955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:32.227538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:32.228193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:32.392321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:32.394424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "name": "network-vif-plugged", "status": "completed", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:32.400538 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-215db577-ed7a-4cc3-a826-a35fffa5e305 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.188008 Aug 29 11:14:32.411907 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2997/5954] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:32 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:32.431129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:32.431679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:32.432120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:32.444535 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] Creating event network-vif-plugged:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h1-854121-10 Aug 29 11:14:32.450041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9442ebe1-b3a1-4826-a54b-d32cab25a844 req-dcfe5c3b-c5d4-4f92-a5c1-dc63d69fa36a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061049 Aug 29 11:14:32.451238 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2958/5955] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:14:33.142084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:33.142587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:33.148814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:33.149261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:33.149729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:33.150419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:33.150878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:33.151307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:33.234147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lazy-loading 'services' on Instance uuid 6bd8198d-be90-4d64-a60d-cf36405d0696 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:14:33.307351 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d4ef90a-b646-48ea-b5bb-753f1f6a82fc tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696/os-volume_attachments/fae0d469-d24f-490c-b5ac-f23660935193" status: 202 len: 0 microversion: 2.1 time: 0.169519 Aug 29 11:14:33.308066 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2998/5956] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:14:33 2022] DELETE /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696/os-volume_attachments/fae0d469-d24f-490c-b5ac-f23660935193 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:14:33.424179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:33.425893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:33.433209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:33.433979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:33.435150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:33.436099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:33.436569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:33.437103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:33.582912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:33.591581 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b7dc18c-d012-400d-a587-f196f3dc3988 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1393 microversion: 2.1 time: 0.172436 Aug 29 11:14:33.592180 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2959/5957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:33 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:34.609967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:34.616014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:34.616729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:34.624388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:34.624882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:34.625318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:34.626054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:34.626507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:34.626935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:34.764821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:34.773020 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9bf3ee7-1f24-4bda-aacf-e898f4656bb2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1565 microversion: 2.1 time: 0.164002 Aug 29 11:14:34.773609 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 2999/5958] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:34 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:34.793622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:34.795473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:34.797478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:34.798299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:34.805284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:34.805801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:34.806244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:34.806951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:34.807444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:34.807900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:34.949403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:34.957285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e1ec6bb8-cbcb-46f0-bbfc-f1fe5b171012 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1565 microversion: 2.1 time: 0.167574 Aug 29 11:14:34.957881 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2960/5959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:34 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:36.719589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:36.721407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:36.722134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:36.737915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:36.742390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:36.742916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:36.743696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:36.744231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:36.744854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:36.750349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:36.751191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:36.752138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:36.773486 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] Creating event network-changed:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h1-854121-10 Aug 29 11:14:36.779420 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c05355cc-995a-467a-b532-47b515485b27 req-f76df2e3-97f2-46e3-a51e-abec8bd99d81 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068368 Aug 29 11:14:36.780139 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2961/5960] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:14:36.929381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:36.939029 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e0131b3-04c5-4097-b369-4987df9b8f9f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1565 microversion: 2.1 time: 0.229766 Aug 29 11:14:36.940032 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3000/5961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:36 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1565 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:38.704107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:38.704699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:38.711082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:38.711575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:38.712020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:38.712722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:38.713182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:38.713613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:38.741715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:14:38.820221 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3275cf8-c2c0-4347-8811-77f762de6de4 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 204 len: 0 microversion: 2.1 time: 0.121848 Aug 29 11:14:38.821109 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2962/5962] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:14:38 2022] DELETE /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:14:38.830404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:38.831030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:38.837916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:38.838411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:38.838858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:38.839556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:38.840018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:38.840505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:38.977157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:38.985993 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3cf182f-056b-46e8-afee-fdc8c56411f0 tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1469 microversion: 2.1 time: 0.159555 Aug 29 11:14:38.986711 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3001/5963] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:38 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:14:40.008778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:40.009467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:40.017082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:40.017562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:40.018040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:40.018727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:40.019177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:40.019600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:40.156281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:40.164300 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0123ecd8-6457-4d13-a639-e47c5d7316bd tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1469 microversion: 2.1 time: 0.160112 Aug 29 11:14:40.164828 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2963/5964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:40 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:40.733482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8198d-be90-4d64-a60d-cf36405d0696", "name": "network-vif-deleted", "tag": "67af752d-100d-4d5b-a64b-f40cb6f01b8c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:40.744468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:40.744951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:40.745389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:40.757645 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] Creating event network-vif-deleted:67af752d-100d-4d5b-a64b-f40cb6f01b8c for instance 6bd8198d-be90-4d64-a60d-cf36405d0696 on n-h2-854121-10 Aug 29 11:14:40.763459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5a4ed8ea-30f2-4f34-af54-32c90591d555 req-acf8aaaf-8705-4ed1-9a07-cb72f6f6a00b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Aug 29 11:14:40.764159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3002/5965] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:14:41.187147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:41.188121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:41.195115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:41.195610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:41.196056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:41.196791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:41.197253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:41.197887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:41.233910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:41.234401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:41.234847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:41.235302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lazy-loading 'fault' on Instance uuid 6bd8198d-be90-4d64-a60d-cf36405d0696 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:14:41.280305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0baa6e5724589a3b29098eb68e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5821bfc19be940369fd55e73587d5f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:14:41.287559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c027d138-5186-4b90-a386-47a7c20e637e tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 200 len: 1303 microversion: 2.1 time: 0.104889 Aug 29 11:14:41.288141 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2964/5966] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:41 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:14:42.310843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:14:42.311469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] [instance: 6bd8198d-be90-4d64-a60d-cf36405d0696] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:42.318078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:42.318566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:42.319009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:42.319706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:42.320163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:42.320593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:42.334251 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] HTTP exception thrown: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Request method failure captured: Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 HTTP/1.1 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ9IGYt2ms2fi0yz2HO9mElo-Wk0Tn6wOBCLGQGgM8QATM9H97PCWS7AfNLILOvF6XoOU-dWopajkfx6Ris4_pmIIn-w_iC34Io7yPpHKTLT1mI9CxrQwgWTREtXpY32Q0ct0SG2xZfDyR55nUEav5euCDS2wxqauajuzCNGyb98UFw Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 5821bfc19be940369fd55e73587d5f19 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-VolumesBackupsTest-604550905 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5821bfc19be940369fd55e73587d5f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5821bfc19be940369fd55e73587d5f19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5821bfc19be940369fd55e73587d5f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5821bfc19be940369fd55e73587d5f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-VolumesBackupsTest-604550905 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 5821bfc19be940369fd55e73587d5f19 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-VolumesBackupsTest-604550905 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-VolumesBackupsTest-604550905-project Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 22d0baa6e5724589a3b29098eb68e646 Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-VolumesBackupsTest-604550905-project Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6bd8198d-be90-4d64-a60d-cf36405d0696'} Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:14:42.335924 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] Returning 404 to user: Instance 6bd8198d-be90-4d64-a60d-cf36405d0696 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b2781c3-a1bd-4396-a6cb-17e512d3a84f tempest-VolumesBackupsTest-604550905 tempest-VolumesBackupsTest-604550905-project] 10.222.0.47 "GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696" status: 404 len: 111 microversion: 2.1 time: 0.032052 Aug 29 11:14:42.343177 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3003/5967] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:14:42 2022] GET /compute/v2.1/servers/6bd8198d-be90-4d64-a60d-cf36405d0696 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:14:58.230056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:14:58.232933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:14:58.235367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:58.236027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:14:58.243842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:58.244288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:58.244756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:58.245463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:14:58.246102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:14:58.246565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:14:58.300614 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2965a619-7dba-4bf2-a8b4-1b25ad109908 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action" status: 200 len: 24572 microversion: 2.1 time: 0.074443 Aug 29 11:14:58.301433 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2965/5968] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:14:58 2022] POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:15:09.008355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:09.008977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:09.012228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:09.012908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:09.020020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.020548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.020958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.021670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.022159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.022637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.260264 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6bfc4fb-f725-4c24-af97-e0aa37c4becd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1837 microversion: 2.1 time: 0.255688 Aug 29 11:15:09.276428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3004/5969] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:09 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1837 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:09.282515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:09.283211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:09.286103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:09.286747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:09.293172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.293656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.294118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.294830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.295270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.295693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.430953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:09.440106 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90942dd1-bceb-41a0-a36b-d3e87c75c60a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1684 microversion: 2.1 time: 0.161808 Aug 29 11:15:09.440888 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2966/5970] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:09 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:09.539736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:09.542066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:09.548830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.549326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.549813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.550557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.551024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.551462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.608707 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1cfa4452-0b24-4c8b-9d68-75f32ff0d681 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action" status: 200 len: 32644 microversion: 2.1 time: 0.072457 Aug 29 11:15:09.610259 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3005/5971] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:15:09 2022] POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action => generated 32644 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:15:09.791448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:09.792030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:09.799578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.800349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.800983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.801962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:09.802424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:09.802881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:09.846483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '44415838f2d241c3bf5dffa3bf8f80be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e199a6671c8497ca61bc8037f2ef560', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:09.847113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] flavor_id is None. Assuming migration. {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 11:15:09.847565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:15:09.969581 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c248bd91-fd2f-4122-ac52-0fb2d8bf8fd8 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.181548 Aug 29 11:15:09.970969 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2967/5972] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:15:09 2022] POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:15:09.981110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:09.981862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:10.002498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:10.003059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:10.003511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:10.004293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:10.004785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:10.005222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:10.147437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:10.157096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb201903-9864-46ed-a8ba-28759e57297e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1693 microversion: 2.1 time: 0.181745 Aug 29 11:15:10.157839 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3006/5973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:09 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:15:11.179865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:11.180519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:11.189874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:11.190376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:11.190821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:11.191532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:11.191991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:11.192424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:11.335304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:11.345011 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1eb3dc7d-5f27-4f09-84c3-603a0dd06947 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1693 microversion: 2.1 time: 0.169066 Aug 29 11:15:11.345764 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2968/5974] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:11 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:12.367055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:12.367677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:12.375961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:12.376460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:12.376913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:12.377615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:12.378100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:12.378533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:12.522002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:12.530555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-43e5a98a-08e5-4bae-84f7-492a4db9fa52 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.167368 Aug 29 11:15:12.531151 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3007/5975] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:12 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:13.553181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:13.553836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:13.561047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:13.561538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:13.562264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:13.562981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:13.563436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:13.564037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:13.706399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:13.715234 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6688fa1-27db-45a8-9526-1141c6ac1e4e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.165241 Aug 29 11:15:13.715839 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2969/5976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:13 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:14.736747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:14.737406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:14.744342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:14.744841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:14.745438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:14.746124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:14.746755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:14.747193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:14.898288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:14.907173 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a99f8aff-0fa6-4ab4-9100-bddc05b673ee tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.174371 Aug 29 11:15:14.907778 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3008/5977] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:14 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:15.928720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:15.929280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:15.937424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:15.937960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:15.938412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:15.939127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:15.939591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:15.940053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:16.091094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:16.100380 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-83828c70-a33e-42c1-89d4-e374aebe79d4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.175667 Aug 29 11:15:16.100977 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2970/5978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:15 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:17.123429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:17.124083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:17.131041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:17.131526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:17.131959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:17.132654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:17.133107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:17.133531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:17.277948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:17.285948 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-844167fd-5033-4112-99c7-4dd3d5ecfb5a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.166981 Aug 29 11:15:17.286442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3009/5979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:17 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:18.307826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:18.308552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:18.315977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:18.316470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:18.316944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:18.317655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:18.318170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:18.318606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:18.458812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:18.467012 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf0b4476-2dd3-48a5-bacb-7ac87684c20b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.163223 Aug 29 11:15:18.467623 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2971/5980] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:18 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:19.488451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:19.489055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:19.496243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:19.496729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:19.497169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:19.497904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:19.498360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:19.498790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:19.639323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:19.647348 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6b9f7a5-9feb-4074-821d-c71cbf992c70 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.162791 Aug 29 11:15:19.647936 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3010/5981] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:19 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:20.669290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:20.669997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:20.677465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:20.677972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:20.678424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:20.679132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:20.679593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:20.680023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:20.815744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:20.824337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14a5678d-6260-4352-9d52-deb9ae4767e8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.159575 Aug 29 11:15:20.824921 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2972/5982] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:20 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:21.847254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:21.847794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:21.856196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:21.856692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:21.857138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:21.857876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:21.858341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:21.858771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:21.997547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:22.005405 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c447f4ec-e4bd-45be-9df5-c5ecdd8b2304 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.162239 Aug 29 11:15:22.006026 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3011/5983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:21 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:23.027288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:23.027990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:23.035182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:23.035677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:23.036121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:23.036832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:23.037294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:23.037749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:23.178745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:23.187587 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-befc1f5b-d476-4844-aac4-d1c23c0b950a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.164945 Aug 29 11:15:23.188174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2973/5984] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:23 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:24.209306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:24.209982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:24.217657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:24.218175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:24.218618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:24.219328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:24.219793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:24.220228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:24.352678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:24.361188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-320b3ecf-4f0e-4a81-af29-e0c2855da757 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.155813 Aug 29 11:15:24.361801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3012/5985] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:24 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:25.383064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:25.383639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:25.390751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:25.391236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:25.391676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:25.392375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:25.392830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:25.393257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:25.531712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:25.541334 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f06d2d9b-44d9-44b3-835b-cc2c2a4c7799 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.162315 Aug 29 11:15:25.542631 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2974/5986] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:25 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:26.563604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:26.564160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:26.571205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:26.571696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:26.572139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:26.572873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:26.573620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:26.574189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:26.718523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:26.726780 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52f0b09b-f52a-496b-8a88-5d6c320566fe tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.167250 Aug 29 11:15:26.727331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3013/5987] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:26 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:27.749683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:27.750432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:27.757632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:27.758278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:27.758684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:27.759422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:27.759884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:27.760313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:27.910126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:27.920052 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-334b3cbe-f6a5-447a-a806-87b1993f04fa tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1698 microversion: 2.1 time: 0.175436 Aug 29 11:15:27.920718 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2975/5988] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:27 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:28.942963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:28.943761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:28.951701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:28.952437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:28.952870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:28.953601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:28.954117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:28.954542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:29.189152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:29.198744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f73d5fff-4ca2-4ab3-b982-85f951b588fc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1697 microversion: 2.1 time: 0.259750 Aug 29 11:15:29.199428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3014/5989] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:28 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1697 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:15:29.488865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "name": "network-vif-unplugged", "status": "completed", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:29.514718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:29.515316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:29.515777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:29.531256 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Creating event network-vif-unplugged:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h2-854121-10 Aug 29 11:15:29.537629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] Instance cf48b68a-8f95-4946-a17d-e20682b71a4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:15:29.551328 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e68604f1-6165-48bd-be83-4155d2403bf5 req-0ee4bf23-3fbc-46dd-a0dc-6e6e52059928 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064927 Aug 29 11:15:29.551328 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2976/5990] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:15:30.220931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:30.221555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:30.230474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:30.231516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:30.232142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:30.233036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:30.234172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:30.234785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:30.425357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:30.434354 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-455e246a-fc05-4183-83a0-9a10627ae0f9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1697 microversion: 2.1 time: 0.217611 Aug 29 11:15:30.434943 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3015/5991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:30 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1697 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:31.457541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:31.458374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:31.466635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:31.467144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:31.468288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:31.469055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:31.469531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:31.470006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:31.597361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:31.610370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:31.611380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:31.612059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:31.626812 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Creating event network-changed:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h2-854121-10 Aug 29 11:15:31.633222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] Instance cf48b68a-8f95-4946-a17d-e20682b71a4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:15:31.635120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:31.649247 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-197b545b-8eeb-435c-962e-609761b0814b req-9c6296e3-7e7f-450d-bcf4-f480b18415ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055634 Aug 29 11:15:31.649504 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be762f50-e106-43fb-9dfc-a212305478b0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1697 microversion: 2.1 time: 0.195873 Aug 29 11:15:31.650270 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2977/5992] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:31 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:15:31.650696 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3016/5993] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:15:32.671189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:32.671912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:32.679501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:32.680100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:32.680669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:32.681447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:32.682565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:32.683373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:32.829690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:32.837782 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-315cd650-ab36-4464-b3e7-d62f2dc80519 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1695 microversion: 2.1 time: 0.170730 Aug 29 11:15:32.838407 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2978/5994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:32 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:33.861866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:33.862572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:33.869048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:33.870801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:33.871256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:33.871974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:33.872438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:33.872863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:34.019421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:34.028842 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6fe06ecf-a69a-4fa3-97fd-b90d38dfc4a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1692 microversion: 2.1 time: 0.172115 Aug 29 11:15:34.029437 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3017/5995] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:33 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:34.050727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:34.051340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:34.058613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:34.059239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:34.059807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:34.060526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:34.060989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:34.061453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:34.122931 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34a4af4f-f2fb-43fe-929c-d1d7f539acc9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action" status: 204 len: 0 microversion: 2.1 time: 0.076004 Aug 29 11:15:34.123583 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2979/5996] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:15:34 2022] POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:15:34.131930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:34.132781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:34.139288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:34.139724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:34.140384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:34.141204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:34.141621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:34.142018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:34.301150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:34.312350 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-315ea41e-708e-4a22-a960-6b8f7d1a39d7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1692 microversion: 2.1 time: 0.182921 Aug 29 11:15:34.313123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3018/5997] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:34 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:35.336791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:35.338247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:35.345970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:35.346888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:35.347583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:35.348558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:35.349247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:35.350538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:35.356761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:35.509313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:35.518340 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38549774-457e-4820-99b8-aade9166ccc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1692 microversion: 2.1 time: 0.187046 Aug 29 11:15:35.519289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2980/5998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:35 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:36.540536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:15:36.541379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:36.549636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:36.549804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:36.550208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:36.551280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:36.551397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:36.551833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:36.652152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "name": "network-vif-plugged", "status": "completed", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:36.667475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:36.668286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:36.668912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:36.681351 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] Creating event network-vif-plugged:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h2-854121-10 Aug 29 11:15:36.688387 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-31925e05-9b6a-4d4a-ac00-13cddbcc8f20 req-c018073c-6bf2-4d61-92e5-664b884e1dda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Aug 29 11:15:36.689595 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2981/5999] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:15:36.712582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:15:36.721083 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8b0303f-aaba-4ae9-86b1-e18842b1de75 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1684 microversion: 2.1 time: 0.184406 Aug 29 11:15:36.721686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3019/6000] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:15:36 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:15:58.911873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=34 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:58.912655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:15:58.917888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:15:58.920252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:15:58.927942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:58.928435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:58.928878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:58.929599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:15:58.930109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:15:58.930554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:15:58.990988 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8db1229c-ce49-464b-97b6-039f0894d144 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action" status: 200 len: 24577 microversion: 2.1 time: 0.081231 Aug 29 11:15:58.992037 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2982/6001] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:15:58 2022] POST /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a/action => generated 24577 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:16:05.524442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:05.525159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:05.527767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=32 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:05.528431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=92 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:05.534464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:05.534952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:05.535394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:05.536101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:05.536562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:05.537014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:05.667163 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-292233ef-2cb8-4c40-9ca5-4ef9c75f0d9e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1837 microversion: 2.1 time: 0.146675 Aug 29 11:16:05.667749 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3020/6002] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:05 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1837 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:06.639884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:06.640483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:06.642601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:06.648477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:06.649344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:06.650054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:06.650959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:06.651602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:06.652220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:06.656933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:06.657432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:06.657906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:06.677397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] Creating event network-changed:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h2-854121-10 Aug 29 11:16:06.683421 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cbc02ba1-4b65-4849-9cf5-a044af04feac req-963414dc-9aa9-45b1-bc6c-3f2cc5d15f42 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044790 Aug 29 11:16:06.684040 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3021/6003] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:16:06.684733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:16:06.789822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d79bd754-0b4f-4560-b154-6991f573aa31 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 204 len: 0 microversion: 2.1 time: 0.155039 Aug 29 11:16:06.793840 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2983/6004] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:16:06 2022] DELETE /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:16:06.800287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:06.801275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:06.810010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:06.811028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:06.811662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:06.813591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:06.815132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:06.815757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:06.983540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:06.991883 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31006067-5fca-4d4d-b42d-3bd57acf1b65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1690 microversion: 2.1 time: 0.196086 Aug 29 11:16:06.992620 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3022/6005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:06 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:08.015480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:08.016401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:08.025591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:08.026343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:08.026911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:08.027765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:08.028347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:08.028839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:08.286010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:08.301522 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f53e722-c182-4af8-b2dd-2ea83ae27165 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 200 len: 1690 microversion: 2.1 time: 0.291049 Aug 29 11:16:08.302367 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2984/6006] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:08 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:08.699317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf48b68a-8f95-4946-a17d-e20682b71a4a", "name": "network-vif-deleted", "tag": "fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:08.711159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:08.711795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:08.712332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:08.726903 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] Creating event network-vif-deleted:fdb0aa4e-e314-4377-bc26-c2d8eaf9fde0 for instance cf48b68a-8f95-4946-a17d-e20682b71a4a on n-h2-854121-10 Aug 29 11:16:08.733269 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-56af6f79-6ce2-48b4-a2b8-686391f12d02 req-986a3ca2-e61e-4792-9513-b6731edb7d3f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037985 Aug 29 11:16:08.733986 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3023/6007] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:16:09.324845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:09.325504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: cf48b68a-8f95-4946-a17d-e20682b71a4a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:09.332690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:09.333181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:09.333630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:09.334369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:09.334840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:09.335298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:09.350133 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] HTTP exception thrown: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Request method failure captured: Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a HTTP/1.1 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ-HoHXq7rbigtanIBQ4XXYzJALmUJhUS5Wff04_zmjciKb_kHOuaYAxHRyqPnpFPr-I9t60l4N50Qv9Y33uI794SBnMvhk5xFpkWiYOeaHrXuPAy2_8jWt6ijSQOJ6DuftyUCZVQio94h-z_xSxjb2TidZeCsAFnUK8f0LKrN_E_lM Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f1428581a8234024aca68e3df7a5c130 Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'cf48b68a-8f95-4946-a17d-e20682b71a4a'} Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:16:09.351820 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Returning 404 to user: Instance cf48b68a-8f95-4946-a17d-e20682b71a4a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77dc0fe9-c1b0-4103-867c-2d6366e02cc8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a" status: 404 len: 111 microversion: 2.1 time: 0.033279 Aug 29 11:16:09.356868 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2985/6008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:09 2022] GET /compute/v2.1/servers/cf48b68a-8f95-4946-a17d-e20682b71a4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:16:12.757216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-87964f91-54c9-433c-971f-3029009ed0a4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '.version_select at 0x7f66c628ba60>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:12.784027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-87964f91-54c9-433c-971f-3029009ed0a4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1333891131" status: 202 len: 0 microversion: 2.1 time: 0.031855 Aug 29 11:16:12.791533 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3024/6009] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 11:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1333891131 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:16:12.816579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-337a43a1-8929-40a8-9629-ce9b8a9e1b1c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: .version_select at 0x7f66c66865e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-844537987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtui4y3yTKdqV74Swx4WR9EVg2K5uJAJ6mVgCZmKX4MT5w+saod3ZizG3nEyfSgXtUDklpRGPKaAEf87oqMLwAc9ZrWsgF0l4HRHSXbJKbH+42j1Z2wDMyWJyYReq1oEw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:12.836663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-337a43a1-8929-40a8-9629-ce9b8a9e1b1c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:16:12.842819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-337a43a1-8929-40a8-9629-ce9b8a9e1b1c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:16:12.867916 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-337a43a1-8929-40a8-9629-ce9b8a9e1b1c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055539 Aug 29 11:16:12.869306 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2986/6010] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:16:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:16:19.472624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1744234685", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a382ebc8-d40c-47fb-aabc-7ac3a5db3989"}], "key_name": "tempest-TestNetworkAdvancedServerOps-844537987", "security_groups": [{"name": "tempest-secgroup-smoke-204877765"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:19.491012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:19.693156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] validate_networks() for [('a382ebc8-d40c-47fb-aabc-7ac3a5db3989', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:16:20.299467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:16:20.299899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:16:20.300378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:16:20.301387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:16:20.301864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:16:20.312557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:20.313052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:20.313493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:20.314289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:20.314896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:20.315333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:20.348846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:16:20.357038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:16:20.371077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:16:20.374300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:16:20.432831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e26bc401-c7fa-49ef-9754-09ba9ba2b266 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.963718 Aug 29 11:16:20.433934 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3025/6011] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:16:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:16:20.444481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:20.452478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95e16873-52d3-45b1-8b2f-d9aa5ce21a85 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:20.453645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95e16873-52d3-45b1-8b2f-d9aa5ce21a85 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:20.582316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95e16873-52d3-45b1-8b2f-d9aa5ce21a85 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:20.594607 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95e16873-52d3-45b1-8b2f-d9aa5ce21a85 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1266 microversion: 2.1 time: 0.151801 Aug 29 11:16:20.595656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2987/6012] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:20 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:21.623578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:21.624203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:21.636066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:21.636696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:21.637242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:21.638087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:21.638545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:21.639035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:21.728820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:21.738198 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-623ce7de-cc37-4919-a40d-467225b15fb7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1326 microversion: 2.1 time: 0.118388 Aug 29 11:16:21.747168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3026/6013] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:21 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:22.793342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:22.794105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:22.808076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:22.809009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:22.809575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:22.810550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:22.812914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:22.813234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:23.108929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:23.130385 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e67ab81d-ed2e-4391-8fa9-2c420f347c65 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.362208 Aug 29 11:16:23.130998 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2988/6014] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:22 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:23.728261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:23.746599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:23.747353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:23.748153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:23.762517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] Creating event network-changed:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:16:23.768016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-94c9758c-b6c1-4943-aeaf-67d1efb1bd4b req-5f0d1d5e-a03d-4b09-a515-671c2d002107 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136996 Aug 29 11:16:23.768726 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3027/6015] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:16:24.154096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:24.155458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:24.163626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:24.164335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:24.165039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:24.166196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:24.167011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:24.167303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:24.422615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:24.431619 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df797607-c858-4a09-bc42-c49ad0667cca tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.282473 Aug 29 11:16:24.432224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2989/6016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:24 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:25.455346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:25.456048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:25.479066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:25.479577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:25.480241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:25.480990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:25.481456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:25.482164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:25.711611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:25.722100 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-34314aa8-27f9-4f4e-b3be-5cd9630369af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.271812 Aug 29 11:16:25.722801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3028/6017] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:25 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:26.752475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:26.753240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:26.761598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:26.762338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:26.762991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:26.763883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:26.764347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:26.764937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:26.927868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:26.942757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-acd77168-ce4e-4db3-b2db-52ecf8f545a5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.203289 Aug 29 11:16:26.943658 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2990/6018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:26 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:27.963732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:27.964299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:27.971410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:27.971883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:27.972329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:27.973055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:27.973604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:27.974044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:28.119842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:28.128135 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9aa48bc6-04b6-4a1c-ae14-88f3361a680d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.168483 Aug 29 11:16:28.128726 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3029/6019] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:27 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:28.963196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-plugged", "status": "completed", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:28.968309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:28.974854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:28.975326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:28.975776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:28.989410 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] Creating event network-vif-plugged:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:16:28.996175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-79579739-5745-49ac-91c0-9d53b06da9ca req-66c4335a-0f8b-4013-aeb9-c77a4b8b09fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136896 Aug 29 11:16:28.996802 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2991/6020] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:16:29.149729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:29.150367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:29.170038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:29.170598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:29.171048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:29.171781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:29.172243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:29.172676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:29.315419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:29.326827 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4744886-2d16-4e32-82ca-d5ffd182e702 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1391 microversion: 2.1 time: 0.181295 Aug 29 11:16:29.327549 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3030/6021] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:29 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:30.350037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:30.350755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:30.357940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:30.358436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:30.358886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:30.359596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:30.360059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:30.360496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:30.528333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:30.536291 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-006839b3-c53f-4927-84f1-3f9f79db3161 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1564 microversion: 2.1 time: 0.191567 Aug 29 11:16:30.536875 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2992/6022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:30 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:30.559271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:30.559992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:30.563199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:30.563939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:30.569853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:30.570407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:30.571565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:30.572703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:30.573240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:30.573768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:30.711295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:30.735454 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-06433ee2-acb7-43d3-b9ed-c23bafe4255b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1564 microversion: 2.1 time: 0.181256 Aug 29 11:16:30.736071 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3031/6023] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:30 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:32.719471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:16:32.720099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:32.723175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:32.731094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:32.731789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:32.732443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:32.733325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:32.733971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:32.734560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:32.826740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:32.839283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:32.839958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:32.846639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:32.860137 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] Creating event network-changed:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:16:32.866063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8ab16d5e-ba9b-4ad3-8897-65c5d7c8f7a1 req-bed45f05-2ee9-4b76-ac2b-169a9d76c22f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153234 Aug 29 11:16:32.867307 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3032/6024] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:16:32.919389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:16:32.933514 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01c3085d-edf2-41e9-8e62-f432f0b72ccb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1564 microversion: 2.1 time: 0.224173 Aug 29 11:16:32.934789 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2993/6025] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:16:32 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1564 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:16:54.224189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:54.225049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:16:54.230652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:16:54.232995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:16:54.242244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:54.242803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:54.243337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:54.244392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:16:54.244902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:16:54.245349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:16:54.302453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c92ed6a3-5b86-42b5-9cbc-705dbde92598 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action" status: 200 len: 24576 microversion: 2.1 time: 0.080052 Aug 29 11:16:54.303653 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3033/6026] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:16:54 2022] POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action => generated 24576 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:17:05.291827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:05.292561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:05.295856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:05.296588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:05.303216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.303715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.304164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.305749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.306523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.307043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.449606 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-656d2154-6778-48d7-9566-7f5559cf3fe3 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1836 microversion: 2.1 time: 0.162284 Aug 29 11:17:05.450216 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2994/6027] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:05 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1836 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:05.472153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:05.472859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:05.475817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:05.477354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:05.484636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.485129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.485574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.486310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.486771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.487203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.631536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:05.639836 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8549018b-21d0-400d-813c-673720a078ba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1683 microversion: 2.1 time: 0.171928 Aug 29 11:17:05.640424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3034/6028] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:05 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:05.744417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:05.746762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:05.753653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.754173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.754618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.755332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.755796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.756247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.811924 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bbb1c61b-0bea-4911-b483-7ae95557e86b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action" status: 200 len: 32644 microversion: 2.1 time: 0.072416 Aug 29 11:17:05.812509 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2995/6029] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:17:05 2022] POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:17:05.972935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:05.973975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:05.982123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.982634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.983084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:05.983811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:05.984269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:05.984903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:06.087964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '44415838f2d241c3bf5dffa3bf8f80be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e199a6671c8497ca61bc8037f2ef560', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:06.088787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] flavor_id is None. Assuming migration. {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 11:17:06.089370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:17:06.257046 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b57a6696-30d5-4390-b43c-22516eb4688e tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action" status: 202 len: 0 microversion: 2.1 time: 0.287901 Aug 29 11:17:06.258228 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3035/6030] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:17:05 2022] POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:17:06.267891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:06.268726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:06.277552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:06.278078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:06.278527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:06.279241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:06.279717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:06.280228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:06.442061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:06.460341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5f5e41c7-fbc9-479c-b895-bdee0213df48 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1692 microversion: 2.1 time: 0.196288 Aug 29 11:17:06.474249 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2996/6031] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:06 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:07.488749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:07.491237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:07.501954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:07.502535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:07.503116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:07.504177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:07.504868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:07.505446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:07.721475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:07.731372 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6b902cf7-58fd-4b96-9d45-c50b46cea11e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1692 microversion: 2.1 time: 0.247761 Aug 29 11:17:07.732121 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3036/6032] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:07 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1692 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:08.753563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:08.754212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:08.764107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:08.764797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:08.765469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:08.766687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:08.767367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:08.768122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:08.933133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:08.941327 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77979159-6948-43c1-a815-07a74d0477e2 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.191665 Aug 29 11:17:08.941940 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2997/6033] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:08 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:17:09.964219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:09.964833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:09.972969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:09.973472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:09.973954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:09.974677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:09.975152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:09.975593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:10.122076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:10.129918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-891aec92-9fa6-44df-801d-f2d4005cebce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.169891 Aug 29 11:17:10.131142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3037/6034] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:09 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:11.152584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:11.153177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:11.160343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:11.160756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:11.161193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:11.161968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:11.162422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:11.162848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:11.313966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:11.322600 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d215162-219a-4ec9-9a55-25378610ff12 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.174122 Aug 29 11:17:11.323641 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2998/6035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:11 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:12.355102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:12.355835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:12.362952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:12.363440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:12.363892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:12.364599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:12.365052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:12.365489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:12.522473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:12.523961 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7322869d-1da8-4ccb-819c-5879067b5995 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.173237 Aug 29 11:17:12.524686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3038/6036] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:12 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:13.545632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:13.546293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:13.554272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:13.555120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:13.555754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:13.556638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:13.557150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:13.557629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:13.728940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:13.736942 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7d0ff390-c3c9-43d8-9568-e3bc84eea11d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.195271 Aug 29 11:17:13.737512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 2999/6037] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:13 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:14.764605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:14.765423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:14.773420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:14.774181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:14.774625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:14.775348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:14.775806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:14.776236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:14.915541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:14.923976 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7af0d164-3109-4967-9c6c-ef4ddbb13f83 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.166566 Aug 29 11:17:14.926012 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3039/6038] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:14 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:15.948136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:15.948850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:15.956339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:15.956935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:15.957288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:15.958059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:15.958526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:15.958962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:16.096524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:16.105271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a834b3a-be8f-4ac1-9f08-31c1c74f066a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.161088 Aug 29 11:17:16.105873 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3000/6039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:15 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:17.128722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:17.129243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:17.137026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:17.137522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:17.137999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:17.138703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:17.139168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:17.139630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:17.280210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:17.289396 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98e3628a-05a2-427e-8dc3-4b6ebbafd25c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.164644 Aug 29 11:17:17.290050 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3040/6040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:17 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:18.311241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:18.311856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:18.319394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:18.320543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:18.320992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:18.321740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:18.322217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:18.322657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:18.482834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:18.491477 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d143fc8-1da0-4b7a-b9ad-9d8d327cc5e7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.184006 Aug 29 11:17:18.492213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3001/6041] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:18 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:19.513801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:19.514432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:19.521404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:19.521944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:19.522392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:19.524378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:19.524849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:19.525291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:19.667397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:19.677388 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d37a6e47-52ea-4f76-8e8f-939798e915d9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.167515 Aug 29 11:17:19.678160 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3041/6042] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:19 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:20.699501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:20.700119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:20.707209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:20.707698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:20.708145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:20.708850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:20.709309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:20.709767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:20.871381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:20.881859 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-86f27484-d622-4eec-be44-24265ae5c89d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.186188 Aug 29 11:17:20.882910 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3002/6043] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:20 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:21.904528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:21.905147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:21.912306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:21.912796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:21.913399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:21.914247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:21.914708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:21.915132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:22.055839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:22.063801 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ebbe3a58-cf6d-455a-8c96-5789863b92af tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.163096 Aug 29 11:17:22.064362 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3042/6044] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:21 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:17:23.086442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:23.087074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:23.094419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:23.094903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:23.095338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:23.096039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:23.096493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:23.096923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:23.250985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:23.260668 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db35122b-3af6-4be4-a222-78a9b6d51ca6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.178818 Aug 29 11:17:23.261288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3003/6045] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:23 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:24.283491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:24.284154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:24.291969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:24.292448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:24.292885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:24.293590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:24.294072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:24.294500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:24.439187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:24.448764 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a20b89b9-4d29-4073-9d6e-8c3bb9338ae5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1697 microversion: 2.1 time: 0.169339 Aug 29 11:17:24.449457 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3043/6046] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:24 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:25.472141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:25.472771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:25.480776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:25.481262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:25.481882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:25.482592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:25.483048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:25.483617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:25.632692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:25.642374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a85c2bc-992a-4150-9f7c-9790b0ae4ac8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1696 microversion: 2.1 time: 0.174890 Aug 29 11:17:25.658113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:25.658800 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3004/6047] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:25 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:25.674757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:25.675527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:25.676736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:25.690352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Creating event network-vif-unplugged:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h1-854121-10 Aug 29 11:17:25.697620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:17:25.711096 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-610c365a-1557-402c-8e15-b6c3795a34b4 req-a8864726-a310-4e4a-ad50-6a41df5898c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058024 Aug 29 11:17:25.712221 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3044/6048] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:17:26.667520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:26.668136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:26.675172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:26.675662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:26.676107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:26.676817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:26.677282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:26.677749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:26.825192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:26.834415 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-13c3dc76-479c-4f20-9f70-a231d2e64893 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1696 microversion: 2.1 time: 0.171331 Aug 29 11:17:26.835190 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3005/6049] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:26 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:27.738441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:27.748985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:27.749477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:27.749939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:27.762110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Creating event network-changed:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h1-854121-10 Aug 29 11:17:27.768084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:17:27.779142 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fb88e001-9b40-444c-bc3a-d15dd9c7c276 req-4d97e9bb-9d00-4294-91f1-f45f2eb9d6c0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045912 Aug 29 11:17:27.779751 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3045/6050] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:17:27.856560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:27.857197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:27.867843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:27.868340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:27.868784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:27.869511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:27.869995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:27.870436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:28.096648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:28.105571 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ca97f05a-22b4-4827-954c-f8ab66d9ff66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1694 microversion: 2.1 time: 0.253026 Aug 29 11:17:28.106206 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3006/6051] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:27 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:17:29.132691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:29.133403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:29.140164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.140659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.141101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.141923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.142382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.142809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.302392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:29.311917 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e1d6864-0900-450f-93a7-ca5e1e771429 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1691 microversion: 2.1 time: 0.184772 Aug 29 11:17:29.312582 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3046/6052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:29 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:29.334095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:29.334663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:29.342358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.343067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.343519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.344238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.344706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.345142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.469614 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3caa8772-943a-493e-863e-bb4c04e9af3c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action" status: 202 len: 0 microversion: 2.1 time: 0.139277 Aug 29 11:17:29.470771 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3007/6053] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:17:29 2022] POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:17:29.479611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:29.480241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:29.486439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.487177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.487851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.488765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:29.489233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:29.489673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:29.662082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:29.671480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21a3af6a-8931-49a3-9938-b7695f29d030 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.196300 Aug 29 11:17:29.672486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3047/6054] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:29 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:30.696269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:30.696953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:30.704426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:30.704918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:30.705366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:30.706101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:30.706556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:30.706985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:30.846156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:30.855146 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38304630-5e9a-40a9-8fc8-52ecfeb56e7c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.163620 Aug 29 11:17:30.856272 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3008/6055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:30 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:31.352148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-plugged", "status": "completed", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:31.364852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:31.365511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:31.366735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:31.382764 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Creating event network-vif-plugged:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h1-854121-10 Aug 29 11:17:31.389482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:17:31.402190 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7f1204f0-e8fe-45d8-ae6d-431e1824310b req-a7380033-4754-4a8f-b135-460c08174d1b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054738 Aug 29 11:17:31.402806 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3048/6056] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:17:31.877903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:31.878426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:31.886110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:31.886609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:31.887053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:31.887764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:31.888224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:31.888652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:31.891582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:32.078463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:32.094237 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2efe15ca-6857-488a-a283-5ecec21cd163 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.219621 Aug 29 11:17:32.095428 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3009/6057] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:31 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:32.682887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:32.704667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:32.705695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:32.706381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:32.723738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Creating event network-vif-unplugged:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:17:32.732129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:17:32.747300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-347f21a0-12d5-46d5-b7d9-2f5856721f0a req-870ad3b0-cbc8-49d5-886a-c4443ac61087 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072831 Aug 29 11:17:32.749206 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3049/6058] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:17:33.125989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:33.127897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:33.142324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:33.144087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:33.145593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:33.157274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:33.158204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:33.159004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:33.446360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:33.456522 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba43dfac-422f-493e-a3ae-10977d9d189d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.343566 Aug 29 11:17:33.463680 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3010/6059] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:33 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:34.479486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:34.480302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:34.487956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:34.488529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:34.488979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:34.489683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:34.490172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:34.490605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:34.495448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:34.626994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:34.634826 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d585bd4e-c1a8-48f2-8d01-0d10383e2d3e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.160327 Aug 29 11:17:34.635399 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3050/6060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:34 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:34.772083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:34.782618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:34.783094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:34.783524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:34.795594 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Creating event network-changed:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:17:34.800794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:17:34.812336 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e4981735-fc4c-4151-bfd3-4ae51b8aa5ba req-95d5cb5c-6cfb-46de-a9e4-9102c9886e9b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043962 Aug 29 11:17:34.813005 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3011/6061] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:17:35.657964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:35.659487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:35.664027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=37 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:35.668175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:35.668857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:35.669733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:35.670757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:35.684625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:35.685091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:35.968584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:35.985373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97b5e842-7b3b-4e31-8653-09becd1702bc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1690 microversion: 2.1 time: 0.331711 Aug 29 11:17:36.006017 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3051/6062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:35 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1690 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:37.014422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:17:37.015182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:37.017214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=41 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:37.024072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:37.024610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:37.025058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:37.025960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:37.026427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:37.027035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:37.177292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:17:37.200142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-efa4518d-6ce8-4937-8616-e427537bfb39 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1683 microversion: 2.1 time: 0.191080 Aug 29 11:17:37.201086 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3012/6063] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:17:37 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:17:39.296223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-plugged", "status": "completed", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:39.309233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:39.309634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:39.310148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:39.327523 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] Creating event network-vif-plugged:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:17:39.334603 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-46872dda-8afc-41d8-9f43-e8920246d9d5 req-9952910a-ee39-49fb-8e11-e13843996bb5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046621 Aug 29 11:17:39.335258 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3052/6064] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:17:59.428764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:17:59.431912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:17:59.434111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:59.434784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=21 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:17:59.440828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:59.441661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:59.442154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:59.442855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:17:59.443310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:17:59.443738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:17:59.499267 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80b7db53-ab02-44aa-b64d-b37011992244 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action" status: 200 len: 63216 microversion: 2.1 time: 0.074512 Aug 29 11:17:59.501198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3013/6065] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:17:59 2022] POST /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858/action => generated 63216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:18:05.833785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:05.835345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=12 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:05.840119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:05.840926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:05.848906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:05.849459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:05.849969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:05.850762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:05.851270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:05.851843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:06.005789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3c79e8b-c613-4080-9745-ad5be6df82ba tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1836 microversion: 2.1 time: 0.174231 Aug 29 11:18:06.006647 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3053/6066] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:05 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1836 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:06.973841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:06.979411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:06.980403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:06.995653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:06.997344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:06.998038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:06.998797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:06.999130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:07.000124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:07.000663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:07.001413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:07.002686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:07.022373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] Creating event network-changed:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:18:07.032188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4c093283-4395-42a7-87d2-5c69396bef24 req-c07c2679-e7f9-400a-bd9f-d6ca63b62ef5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064380 Aug 29 11:18:07.033802 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3054/6067] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:18:07.070153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:18:07.244484 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a808d49c-570c-4009-93c1-8e14eecbac81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 204 len: 0 microversion: 2.1 time: 0.277939 Aug 29 11:18:07.245787 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3014/6068] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:18:06 2022] DELETE /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:18:07.259910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:07.261205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:07.275130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:07.276389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:07.277196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:07.278989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:07.280053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:07.281376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:07.479308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:07.493340 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1a7dda1-97b7-4e60-96e4-7595ee8c7ccf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1689 microversion: 2.1 time: 0.240461 Aug 29 11:18:07.494723 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3055/6069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:07 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:08.518507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:08.519973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:08.530650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:08.531656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:08.532356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:08.533540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:08.534271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:08.535171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:08.748187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:08.756915 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ddcb7d3-a492-4515-98a8-554a1f98f767 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 200 len: 1689 microversion: 2.1 time: 0.244252 Aug 29 11:18:08.757540 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3015/6070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:08 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:09.037253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bfa72b-a17c-410b-a2ff-a4b2d225b858", "name": "network-vif-deleted", "tag": "d3e442f2-9167-47e3-9699-91a9dc4b3d47"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:09.067325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:09.067809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:09.068273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:09.082375 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] Creating event network-vif-deleted:d3e442f2-9167-47e3-9699-91a9dc4b3d47 for instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 on n-h2-854121-10 Aug 29 11:18:09.092500 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-c43088b5-9935-46b2-9096-1309a915ec83 req-332bb430-abfb-4445-86ad-39e27bd2dba3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058992 Aug 29 11:18:09.093153 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3056/6071] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:18:09.778944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:09.779557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: b6bfa72b-a17c-410b-a2ff-a4b2d225b858] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:09.788128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:09.788617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:09.789063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:09.790575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:09.791062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:09.791545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:09.808460 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] HTTP exception thrown: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Request method failure captured: Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 HTTP/1.1 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ-HoHXq7rbigtanIBQ4XXYzJALmUJhUS5Wff04_zmjciKb_kHOuaYAxHRyqPnpFPr-I9t60l4N50Qv9Y33uI794SBnMvhk5xFpkWiYOeaHrXuPAy2_8jWt6ijSQOJ6DuftyUCZVQio94h-z_xSxjb2TidZeCsAFnUK8f0LKrN_E_lM Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f1428581a8234024aca68e3df7a5c130 Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'b6bfa72b-a17c-410b-a2ff-a4b2d225b858'} Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:18:09.810185 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Returning 404 to user: Instance b6bfa72b-a17c-410b-a2ff-a4b2d225b858 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:18:09.814683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-df85d4e2-bcd5-424c-b305-413701e50e17 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858" status: 404 len: 111 microversion: 2.1 time: 0.036604 Aug 29 11:18:09.815769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3016/6072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:09 2022] GET /compute/v2.1/servers/b6bfa72b-a17c-410b-a2ff-a4b2d225b858 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:18:13.689082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5090226-c9e7-47a9-92d4-62c2baac9eac tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '.version_select at 0x7f66c6e30f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:13.718303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5090226-c9e7-47a9-92d4-62c2baac9eac tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-844537987" status: 202 len: 0 microversion: 2.1 time: 0.034963 Aug 29 11:18:13.718898 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3057/6073] 10.222.0.47 () {58 vars in 1281 bytes} [Mon Aug 29 11:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-844537987 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:18:13.761248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22fb7856-0dcb-4f5b-81da-aa33c08ced02 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: .version_select at 0x7f66c6e74040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2101978734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkp8V8KaGDOe8VdrdWjGINQHFTkS06tvuxRzBcS1lOYzk/b2QbL+SNr92LJ1AnhzJ8VLzggiSQH3mNv9bWwXGVJpciZAWN9BubxpkjbjHIH+IxGPCU9fTglG+2GSjA56Q=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:13.787281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-22fb7856-0dcb-4f5b-81da-aa33c08ced02 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:18:13.793989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-22fb7856-0dcb-4f5b-81da-aa33c08ced02 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:18:13.820338 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22fb7856-0dcb-4f5b-81da-aa33c08ced02 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070906 Aug 29 11:18:13.821455 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3017/6074] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:18:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:18:20.440236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-597984580", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "ba1321b2-d95b-4512-a4c2-b4017b741ea7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2101978734", "security_groups": [{"name": "tempest-secgroup-smoke-1246507667"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:20.453969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:20.606946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] validate_networks() for [('ba1321b2-d95b-4512-a4c2-b4017b741ea7', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:18:21.198610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:18:21.199041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:18:21.199523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:18:21.199941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:18:21.200374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:18:21.217439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:21.218028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:21.219936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:21.220787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:21.221261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:21.221750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:21.274857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:18:21.285588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:18:21.302195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:18:21.304952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:18:21.406913 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3c93fd4-e63c-482a-88c0-04c4a4aea177 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.970476 Aug 29 11:18:21.408281 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3058/6075] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:18:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:18:21.420579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22396f84-1022-4ef7-aff4-bbd0cbbca540 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:21.421340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22396f84-1022-4ef7-aff4-bbd0cbbca540 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:21.429907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:21.529457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22396f84-1022-4ef7-aff4-bbd0cbbca540 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:21.542432 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22396f84-1022-4ef7-aff4-bbd0cbbca540 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1266 microversion: 2.1 time: 0.126767 Aug 29 11:18:21.543383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3018/6076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:21 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:22.563801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:22.564562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:22.574862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:22.575796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:22.576454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:22.577405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:22.578184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:22.579191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:22.658670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:22.669935 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32d0c7b1-acdd-47ab-ba5a-e89bff9c4dba tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1318 microversion: 2.1 time: 0.110733 Aug 29 11:18:22.671296 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3059/6077] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:22 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:23.690944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:23.693507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:23.713544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:23.716248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:23.717687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:23.718709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:23.719352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:23.719949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:24.012643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:24.022051 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8a0892ea-4dad-4ce2-829a-40a59abebded tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.334816 Aug 29 11:18:24.022897 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3019/6078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:23 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:24.619786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:24.631812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:24.632584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:24.632901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:24.655520 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] Creating event network-changed:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h2-854121-10 Aug 29 11:18:24.661107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cb7ad84e-8a62-4234-a91b-fdd0752ed4d9 req-d800d042-69cb-47af-b9ab-3b7d7e0d03f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045170 Aug 29 11:18:24.662096 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3060/6079] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:18:25.042944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:25.043574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:25.052097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:25.052664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:25.053025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:25.053792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:25.054270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:25.054853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:25.205558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:25.218071 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a7b484d-abd9-41ae-9e6c-20177010c78d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.176120 Aug 29 11:18:25.218071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3020/6080] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:25 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:26.239560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:26.240280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:26.247888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:26.248380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:26.248819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:26.252733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:26.252733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:26.252733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:26.426522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:26.436362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d117d3a-e225-4b7a-a2f1-b6d061c50877 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.201814 Aug 29 11:18:26.437747 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3061/6081] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:26 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:18:27.458713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:27.459331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:27.467631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:27.468288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:27.468736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:27.469486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:27.469970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:27.470401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:27.643658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:27.652171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59399445-523d-45e3-8dd3-46dfc59f11cd tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.197430 Aug 29 11:18:27.653325 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3021/6082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:27 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:28.673377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:28.674628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:28.682418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:28.683149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:28.683596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:28.684309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:28.684770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:28.685199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:28.830319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:28.839086 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-254a64f3-f6d3-4f49-829b-d35d457d5e93 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.169510 Aug 29 11:18:28.839691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3062/6083] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:28 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:29.596974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "name": "network-vif-plugged", "status": "completed", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:29.604842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:29.612847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:29.613613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:29.614083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:29.628224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] Creating event network-vif-plugged:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h2-854121-10 Aug 29 11:18:29.635503 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9ec88208-730c-47e0-8f4f-58dbb00eaac1 req-3a213de2-4402-4acd-8470-5fd7fc899b18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042135 Aug 29 11:18:29.636456 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3022/6084] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:18:29.861988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:29.862610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:29.870931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:29.871419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:29.871856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:29.872595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:29.873051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:29.873487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:30.036143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:30.043792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6de4baf-ef29-4e90-80e7-b6dfdc089b55 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1392 microversion: 2.1 time: 0.185927 Aug 29 11:18:30.044737 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3063/6085] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:29 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:31.067384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:31.070166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:31.080376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:31.082748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:31.083785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:31.084740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:31.085962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:31.085962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:31.307864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:31.318563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b12fbf2-86a7-42c2-947d-e1b76bf11534 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1564 microversion: 2.1 time: 0.257128 Aug 29 11:18:31.319774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3023/6086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:31 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:31.346536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:31.347758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:31.350914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:31.351592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:31.360956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:31.361466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:31.361954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:31.362676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:31.363169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:31.363602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:31.552946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:31.563830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19572c66-15c1-450f-b035-c2934adfcf92 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1564 microversion: 2.1 time: 0.219995 Aug 29 11:18:31.564373 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3064/6087] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:31 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1564 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:34.386762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:34.389616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:18:34.390801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:34.398280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:34.409287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:34.409840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:34.410471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:34.411389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:34.412007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:34.412251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:34.412772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:34.412967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:34.413500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:34.430507 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] Creating event network-changed:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h2-854121-10 Aug 29 11:18:34.437317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-eaaaae73-a18d-43b9-b47f-0ca8f42a87c7 req-2807f8e4-d5cb-4ea7-84b0-995a3583755f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Aug 29 11:18:34.438824 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3065/6088] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:18:34.616160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:18:34.625835 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e1bdf3f-454f-42f0-9fe8-0eb5129244d3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1564 microversion: 2.1 time: 0.246844 Aug 29 11:18:34.645923 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3024/6089] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:18:34 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:18:55.028971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:18:55.031761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:18:55.034987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:55.036023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:18:55.043724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:55.044276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:55.044805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:55.045637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:18:55.046257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:18:55.046764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:18:55.109258 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-614fd421-0adc-485e-ac21-e7bc537cd243 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action" status: 200 len: 24563 microversion: 2.1 time: 0.085049 Aug 29 11:18:55.110218 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3066/6090] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:18:55 2022] POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action => generated 24563 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:19:01.552807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:01.553396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:01.555588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:01.556916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:01.558356 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:19:01.558498 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa (ip 10.222.0.47) !!! Aug 29 11:19:01.566071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:01.566556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:01.566993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:01.567690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:01.568144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:01.568571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:01.704025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:01.711859 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f4c04f2-a2a3-4a3c-8a61-ff011b566e63 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1683 microversion: 2.1 time: 0.163113 Aug 29 11:19:01.712510 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3025/6091] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:01 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:01.816813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:01.819320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:01.826816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:01.827309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:01.827753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:01.828455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:01.828917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:01.829349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:01.882367 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-24c50a43-1d44-4e64-8e42-338e211ae43c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action" status: 200 len: 32638 microversion: 2.1 time: 0.069683 Aug 29 11:19:01.883019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3067/6092] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:19:01 2022] POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action => generated 32638 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:19:02.031347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:02.031960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:02.038257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:02.038751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:02.039190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:02.039908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:02.040397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:02.041495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:02.172152 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6206f5e0-4501-4560-bbbc-84554f1b6319 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1836 microversion: 2.1 time: 0.144699 Aug 29 11:19:02.172752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3026/6093] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:02 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1836 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:02.201871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:02.204433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:02.211606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:02.212091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:02.213229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:02.213868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:02.214332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:02.214745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:02.240217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lazy-loading 'flavor' on Instance uuid ea63acd3-ce8b-4114-a9bf-7f651f487cfa {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:19:02.253179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Going to try to live migrate instance to another host {{(pid=128681) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 11:19:03.463178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6b209b3-fa99-4ff1-a5b5-36fbabede0a7 tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action" status: 202 len: 0 microversion: 2.1 time: 1.265645 Aug 29 11:19:03.464085 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3068/6094] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:19:02 2022] POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:19:03.474817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:03.475453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:03.483274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:03.483938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:03.484541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:03.485407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:03.486051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:03.486682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:03.632411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:03.641775 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c2212c83-5568-4cc3-b0e7-b9f075da5314 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.172003 Aug 29 11:19:03.642383 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3027/6095] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:03 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:04.542892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "name": "network-vif-unplugged", "status": "completed", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:04.554845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:04.555342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:04.555790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:04.568102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] Creating event network-vif-unplugged:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h2-854121-10 Aug 29 11:19:04.573492 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7ace1eac-370e-4cdc-ad47-e55bb030d044 req-eaa9e992-6a46-469e-926b-53c96f2f7ad0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034915 Aug 29 11:19:04.574106 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3069/6096] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:04.664551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:04.665301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:04.673496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:04.674139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:04.674661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:04.675453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:04.675986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:04.676537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:04.821272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:04.829590 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebfbf498-8ff1-4641-9e0d-223f9d0d9670 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.168943 Aug 29 11:19:04.830213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3028/6097] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:04 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:05.852835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:05.854584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:05.860787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:05.861277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:05.861755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:05.862451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:05.862908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:05.863336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:05.999234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:06.007005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fa7b4b5-d639-49d5-bb86-48a2f5395a35 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.159525 Aug 29 11:19:06.007575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3070/6098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:05 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:06.611070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:06.622027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:06.622508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:06.622938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:06.633719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] Creating event network-changed:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h2-854121-10 Aug 29 11:19:06.639320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-63ca842f-ed38-40f2-8dd6-3b97c6054fca req-89f76411-c4cd-4896-bd57-3c86323140a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Aug 29 11:19:06.639911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3029/6099] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:07.028546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:07.029166 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:07.036223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:07.036827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:07.037273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:07.038012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:07.038475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:07.038909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:07.178938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:07.187751 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2199e9e3-5f3c-491b-b23c-0805bd377bbf tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.163079 Aug 29 11:19:07.188343 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3071/6100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:07 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:08.214243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:08.214960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:08.221396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:08.221925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:08.222376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:08.223088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:08.223553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:08.223991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:08.362679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:08.370759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bfddf009-0e8f-44f8-8df6-c3dddcac19fb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.164121 Aug 29 11:19:08.372456 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3030/6101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:08 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:09.392551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:09.393176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:09.400388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:09.400876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:09.401315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:09.402060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:09.402513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:09.402938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:09.539000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:09.547232 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0d3b075-74f7-491c-8278-d40597a06f79 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.158494 Aug 29 11:19:09.548057 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3072/6102] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:09 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:10.569210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:10.569865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:10.577332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:10.577853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:10.578298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:10.579009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:10.579470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:10.579904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:10.726741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:10.735399 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9b54a3d-ad1e-4ea6-868f-06d1b9f2e1cc tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1693 microversion: 2.1 time: 0.170348 Aug 29 11:19:10.736004 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3031/6103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:10 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:11.757748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:11.758362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:11.766126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:11.766610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:11.767046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:11.767740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:11.768196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:11.768621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:11.906031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:11.914001 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fa89422c-8eee-4876-89c7-3b9ad185b3f3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1683 microversion: 2.1 time: 0.160218 Aug 29 11:19:11.914574 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3073/6104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:11 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:11.935016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:11.935746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:11.943206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:11.943725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:11.944505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:11.945213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:11.945667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:11.946122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:12.084938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e0c0daac-b194-49e0-9029-2cdff30166cd tempest-TestNetworkAdvancedServerOps-1178874416 tempest-TestNetworkAdvancedServerOps-1178874416-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1836 microversion: 2.1 time: 0.153599 Aug 29 11:19:12.085524 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3032/6105] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:11 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1836 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:12.106795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:12.107328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:12.113593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:12.114118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:12.114650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:12.115280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:12.115740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:12.116165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:12.256723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:12.265246 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-233ae5a3-e393-4be3-a540-985c46d7cfae tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1683 microversion: 2.1 time: 0.162586 Aug 29 11:19:12.265870 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3074/6106] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:12 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:12.362436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:12.364568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:12.371258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:12.371741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:12.372181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:12.372880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:12.373332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:12.373784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:12.424986 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55a2236f-2b75-4c7c-8959-587b53f1406c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action" status: 200 len: 38336 microversion: 2.1 time: 0.066364 Aug 29 11:19:12.425628 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3033/6107] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:19:12 2022] POST /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa/action => generated 38336 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:19:13.782683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:13.783305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:13.786388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:13.790243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:13.791621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:13.792076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:13.792801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:13.793260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:13.794327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:13.798781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:13.799274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:13.799714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:13.812548 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] Creating event network-changed:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h1-854121-10 Aug 29 11:19:13.817629 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-582c7c6c-a326-43c6-8aa8-e748cc9c7524 req-6b9a6a83-5e0a-48b9-9eaf-56df35ec495d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035426 Aug 29 11:19:13.818276 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3034/6108] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:13.824210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:19:13.920310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77f02c1c-451d-4759-b009-3003962058c8 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 204 len: 0 microversion: 2.1 time: 0.140701 Aug 29 11:19:13.921609 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3075/6109] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:19:13 2022] DELETE /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:19:13.930884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:13.932180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:13.939312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:13.939802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:13.940239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:13.940942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:13.941433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:13.941901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:14.091273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:14.099756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e7f5feb-9ae5-40d1-965d-6e5a631350be tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 200 len: 1689 microversion: 2.1 time: 0.173690 Aug 29 11:19:14.100548 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3035/6110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:13 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:14.855557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea63acd3-ce8b-4114-a9bf-7f651f487cfa", "name": "network-vif-deleted", "tag": "ebe43230-abd4-465c-befa-cdf34f41b0ae"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:14.871282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:14.871784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:14.872216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:14.885691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] Creating event network-vif-deleted:ebe43230-abd4-465c-befa-cdf34f41b0ae for instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa on n-h1-854121-10 Aug 29 11:19:14.892098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8bfb4cae-ab11-4b68-8630-216c54617f06 req-8fa62e98-6c41-4a0d-980e-0f578f2d7707 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040907 Aug 29 11:19:14.892701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3076/6111] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:15.122854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:15.123470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: ea63acd3-ce8b-4114-a9bf-7f651f487cfa] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:15.131002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:15.131496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:15.131964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:15.132627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:15.133146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:15.133499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:15.148683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] HTTP exception thrown: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Request method failure captured: Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa HTTP/1.1 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDJ-HoHXq7rbigtanIBQ4XXYzJALmUJhUS5Wff04_zmjciKb_kHOuaYAxHRyqPnpFPr-I9t60l4N50Qv9Y33uI794SBnMvhk5xFpkWiYOeaHrXuPAy2_8jWt6ijSQOJ6DuftyUCZVQio94h-z_xSxjb2TidZeCsAFnUK8f0LKrN_E_lM Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f1428581a8234024aca68e3df7a5c130 Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ea63acd3-ce8b-4114-a9bf-7f651f487cfa'} Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:19:15.151207 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Returning 404 to user: Instance ea63acd3-ce8b-4114-a9bf-7f651f487cfa could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6b5a2999-409e-4a4f-9695-3ea89de6849f tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa" status: 404 len: 111 microversion: 2.1 time: 0.034508 Aug 29 11:19:15.156215 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3036/6112] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:15 2022] GET /compute/v2.1/servers/ea63acd3-ce8b-4114-a9bf-7f651f487cfa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:19:18.383674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5958ab80-12a6-403b-b4cb-cae2f4cdf136 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '.version_select at 0x7f66c5e31310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:18.412981 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5958ab80-12a6-403b-b4cb-cae2f4cdf136 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2101978734" status: 202 len: 0 microversion: 2.1 time: 0.034080 Aug 29 11:19:18.413586 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3077/6113] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 11:19:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2101978734 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:19:18.440242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eab857d2-9fa8-4f9c-9f3d-3bedbfdcaa46 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: .version_select at 0x7f66c6ef9ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1986408054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMz1eFTvRJrSoP4ZV4Mls522igL2bmXXmLhm7VYuKJuvUv/y5utn4BmwM24CPQYDjdd54jLhP53y/uAmOU7js0WHIekTgp74swJ3Yw/8lYibJbEWGUwsB8Ul23E//2F1Qw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:18.458871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eab857d2-9fa8-4f9c-9f3d-3bedbfdcaa46 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:19:18.465744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eab857d2-9fa8-4f9c-9f3d-3bedbfdcaa46 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:19:18.490872 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eab857d2-9fa8-4f9c-9f3d-3bedbfdcaa46 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054552 Aug 29 11:19:18.491477 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3037/6114] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:19:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:24.288821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1879171799", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "732487fb-af08-4f9f-84a7-8e49ba0e9fe0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1986408054", "security_groups": [{"name": "tempest-secgroup-smoke-282897160"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:24.628192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] validate_networks() for [('732487fb-af08-4f9f-84a7-8e49ba0e9fe0', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:19:24.877969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:25.061628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:19:25.062110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:19:25.062594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:19:25.063049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:19:25.063486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:19:25.073556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:25.074099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:25.074553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:25.075302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:25.075918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:25.076363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:25.089331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:25.096675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:19:25.102974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Getting quotas for user f1428581a8234024aca68e3df7a5c130 and project 3c8cea8ed46e4b7ea56f7b2e07f2a4fe. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:19:25.117238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:19:25.120363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:19:25.170735 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-10cec09a-8998-4214-9e12-860f470b708d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.887558 Aug 29 11:19:25.177334 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3078/6115] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:19:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:19:25.182948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9c6d82ab-5f77-4fe4-b204-db4ad4ee4c66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:25.183581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9c6d82ab-5f77-4fe4-b204-db4ad4ee4c66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:25.186489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=58 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:25.370765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9c6d82ab-5f77-4fe4-b204-db4ad4ee4c66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:25.388060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9c6d82ab-5f77-4fe4-b204-db4ad4ee4c66 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1267 microversion: 2.1 time: 0.208802 Aug 29 11:19:25.390181 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3038/6116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:25 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:26.426682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:26.427323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:26.435592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:26.436495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:26.436962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:26.437930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:26.438544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:26.439129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:26.512364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:26.521310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7957754a-3c90-4f0a-a3ca-8f54f8ae4820 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1325 microversion: 2.1 time: 0.103655 Aug 29 11:19:26.521935 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3079/6117] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:26 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:27.544156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:27.545426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:27.553495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:27.554249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:27.555300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:27.556315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:27.558146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:27.566905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:27.741629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:27.750172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c45496fa-79d8-4daa-9ab8-0e57d51d94f4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.210957 Aug 29 11:19:27.750860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3039/6118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:27 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:28.101737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:28.118961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:28.120247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:28.120679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:28.133915 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] Creating event network-changed:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:19:28.139117 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-aaa23285-2105-4003-82a1-9141cda5a6e6 req-b6d910f0-d36e-4d7e-b1c9-425e7106aee0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041464 Aug 29 11:19:28.139749 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3080/6119] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:19:28.772031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:28.772587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:28.779702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:28.780187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:28.780621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:28.781318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:28.781800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:28.782231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:28.922196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:28.929982 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2d97438-0ac2-4e6b-835d-d69e983bbbe4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.162290 Aug 29 11:19:28.930568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3040/6120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:28 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:29.953237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:29.953978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:29.960264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:29.960756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:29.961199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:29.961936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:29.962402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:29.963338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:30.097257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:30.105966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98198825-1ff8-4c17-9bc7-555c41d26da9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.158113 Aug 29 11:19:30.106577 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3081/6121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:29 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:31.127752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:31.128367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:31.136271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:31.136778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:31.137227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:31.138009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:31.138476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:31.138912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:31.273675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:31.282860 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e9fbb1b0-654f-4cc0-9d69-bc8417c25a2e tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.159158 Aug 29 11:19:31.283438 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3041/6122] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:31 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:32.304625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:32.305188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:32.312421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:32.312904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:32.313339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:32.314071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:32.314523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:32.314955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:32.459757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:32.468285 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d3ac2a8-2ee2-4a74-a739-c8b6059d08d6 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.167684 Aug 29 11:19:32.468873 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3082/6123] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:32 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:33.488767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:33.489388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:33.492192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:33.498002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:33.498502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:33.498950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:33.499658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:33.500122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:33.500560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:33.637782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:33.645454 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f1e1b2fa-7a4e-4abd-a997-1e5677a14a88 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.160889 Aug 29 11:19:33.646063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3042/6124] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:33 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:33.946323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "name": "network-vif-plugged", "status": "completed", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:33.957997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:33.958501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:33.958946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:33.970956 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] Creating event network-vif-plugged:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:19:33.976081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9d83a937-0702-465e-8896-373320b04418 req-d38de609-52d8-403c-b3a2-de36242c74d5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Aug 29 11:19:33.977013 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3083/6125] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:19:34.666924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:34.667546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:34.674579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:34.675067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:34.675511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:34.676218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:34.676699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:34.677112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:34.814460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:34.823025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cead3c66-a11e-4704-9d9d-21de254db3d0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1392 microversion: 2.1 time: 0.159540 Aug 29 11:19:34.823613 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3043/6126] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:34 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:19:35.842705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:35.843416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:35.847487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:35.848229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:35.856063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:35.856557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:35.857006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:35.857738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:35.858232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:35.858662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:35.997659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:36.005414 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1cafe3d9-742b-4ab9-8d08-029d758679c4 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1565 microversion: 2.1 time: 0.164625 Aug 29 11:19:36.006031 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3084/6127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:35 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:36.027395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:36.028124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:36.030146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:36.036410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:36.036897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:36.037338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:36.038096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:36.038555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:36.038985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:36.174574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:36.182683 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70b8175a-f80f-43aa-9ac0-6658ae76d007 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1565 microversion: 2.1 time: 0.160123 Aug 29 11:19:36.183280 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3044/6128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:36 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:19:38.580647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:19:38.581266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:19:38.583298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:19:38.588564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:38.589058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:38.589614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:38.590367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:38.590822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:38.591439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:38.594881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:19:38.595480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:19:38.596158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:19:38.608815 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] Creating event network-changed:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:19:38.614254 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3f9d63c8-7c36-4cad-a224-2259fb2aafeb req-4664bafe-d314-4ab4-bc65-f2035842a6ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035239 Aug 29 11:19:38.615284 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3045/6129] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:19:38.735948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:19:38.745197 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4fa7fb0a-480b-46fc-b8b3-446168ed5a81 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1565 microversion: 2.1 time: 0.168545 Aug 29 11:19:38.750809 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3085/6130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:19:38 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:19:59.995862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:19:59.996606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=38 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:00.002317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:00.004563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:00.011599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:00.012086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:00.012527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:00.013229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:00.013918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:00.014432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:00.077644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-407eb81f-1ba5-4ecc-a088-40645a6096c5 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action" status: 200 len: 24569 microversion: 2.1 time: 0.083545 Aug 29 11:20:00.078459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3046/6131] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:19:59 2022] POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action => generated 24569 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:20:06.398437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:06.401182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:06.403570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:06.404236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:06.410177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.410671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.411118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.411824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.412286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.412721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.492278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:20:06.492706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:20:06.493183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:20:06.493596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:20:06.494044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:20:06.553400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:06.559391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.559884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.560325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.561033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.561486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.562013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.588078 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-161971af-1a07-48b0-a2bc-f5e05be9a8b7 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action" status: 202 len: 1139 microversion: 2.1 time: 0.193755 Aug 29 11:20:06.588727 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3086/6132] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:20:06 2022] POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action => generated 1139 bytes in 195 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 11:20:06.607185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:06.612844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:06.617381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.617580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.618059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.618773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:06.619425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:06.619862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:06.766264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:06.774191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95a5c4dd-6339-485f-a5b8-c2bb69511565 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.171547 Aug 29 11:20:06.774779 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3047/6133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:06 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:07.796234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:07.796888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:07.803975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:07.804458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:07.804894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:07.805592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:07.806070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:07.806498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:07.944494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:07.954050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9dc4d76-a25a-4aa7-b412-4709fa05f59d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.161577 Aug 29 11:20:07.954650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3087/6134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:07 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:08.976937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:08.977562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:08.984918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:08.985409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:08.985892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:08.987129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:08.987129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:08.987479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:09.124129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:09.132259 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d80a1d0f-30f3-4020-b8ff-16d23151aabb tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.159370 Aug 29 11:20:09.132835 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3048/6135] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:08 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:10.154522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:10.155128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:10.162504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:10.162986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:10.163424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:10.164119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:10.164571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:10.164990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:10.301153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:10.309042 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9c89d74-acdc-44e6-941f-fec32636c75a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.158438 Aug 29 11:20:10.309626 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3088/6136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:10 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:11.331377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:11.332005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:11.339212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:11.339715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:11.340167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:11.340878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:11.341347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:11.341823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:11.487250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:11.493564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f73ebe7b-0eda-47f7-bb22-ad109c74d9c9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.166556 Aug 29 11:20:11.494182 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3049/6137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:11 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:12.515849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:12.516485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:12.523536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:12.524036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:12.524472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:12.525178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:12.525646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:12.526106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:12.664244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:12.672593 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-630d7917-430c-4c1a-9bf6-fc970c7942ce tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.160744 Aug 29 11:20:12.673171 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3089/6138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:12 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:13.693774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:13.694387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:13.701724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:13.702732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:13.703198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:13.704002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:13.704453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:13.704880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:13.842286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:13.851093 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-20d67209-3e07-46be-ae78-f4dea4dedea0 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.161134 Aug 29 11:20:13.851687 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3050/6139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:13 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:14.872897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:14.873477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:14.881248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:14.881753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:14.882191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:14.882884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:14.883337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:14.883760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:15.035783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:15.045247 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6779d423-cde0-4cd3-9e95-629100182fa1 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.176245 Aug 29 11:20:15.047054 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3090/6140] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:14 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:16.068620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:16.069233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:16.076655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:16.077177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:16.078196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:16.078985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:16.079499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:16.080060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:16.230787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:16.239343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-224e49b1-9f33-499e-8916-30738ca2e45d tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.174516 Aug 29 11:20:16.239852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3051/6141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:16 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:17.261915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:17.262475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:17.270531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:17.271036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:17.271490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:17.272186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:17.272641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:17.273066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:17.412244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:17.420009 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-640a5f6b-cdd8-4b12-94f2-82669c4c1543 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1693 microversion: 2.1 time: 0.162092 Aug 29 11:20:17.420590 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3091/6142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:17 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:18.442539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:18.443156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:18.450852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:18.451333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:18.451784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:18.452528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:18.453607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:18.454090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:18.598250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:18.606041 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c08de861-a78c-4ff5-8ebd-8b3e4d36f434 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1699 microversion: 2.1 time: 0.167437 Aug 29 11:20:18.606635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3052/6143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:18 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:20:19.628645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:19.629294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:19.636487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:19.636972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:19.637413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:19.638290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:19.638755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:19.639185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:19.774680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:19.783128 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b18a2fc-0ea2-46f1-bc58-a284d814874a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1699 microversion: 2.1 time: 0.158530 Aug 29 11:20:19.783709 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3092/6144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:19 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:20.804703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:20.805306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:20.812178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:20.812658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:20.813094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:20.813811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:20.814266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:20.814720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:20.952601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:20.961876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f5b6ec35-4582-4f7c-95be-c08abf9d737c tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1684 microversion: 2.1 time: 0.160964 Aug 29 11:20:20.962463 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3053/6145] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:20 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:22.221658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "name": "network-vif-plugged", "status": "completed", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:22.232802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:22.233289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:22.233735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:22.248908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] Creating event network-vif-plugged:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:20:22.254230 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3d8f2a25-2528-4bb3-9ca1-a4b233893ec0 req-f19948a6-6845-43da-82b1-a4282341f218 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036852 Aug 29 11:20:22.254996 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3093/6146] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:20:45.162643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:45.164908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:45.167649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:45.168310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=46 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:45.176103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:45.176600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:45.177040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:45.177809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:45.178408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:45.178841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:45.233631 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-45bd1455-6a14-49b6-93cb-09bb2ccc45b9 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action" status: 200 len: 24568 microversion: 2.1 time: 0.075694 Aug 29 11:20:45.234343 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3054/6147] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:20:45 2022] POST /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:20:52.567343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=20 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:52.568167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:20:52.571164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:52.574777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:52.575433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:52.583929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:52.584386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:52.584545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:52.584871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:52.585052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:52.585570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:52.585780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:52.586194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:52.586966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:52.600028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] Creating event network-changed:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:20:52.606090 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-536b9e69-7daf-4c50-b9ea-7d19f23f9138 req-1d2bc9c1-4b83-4cb6-9086-8fda0d340b21 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039246 Aug 29 11:20:52.607026 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3055/6148] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:20:52.631804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:20:52.739235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-879dee05-1ecf-4113-a6bf-19e8cc91105a tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 204 len: 0 microversion: 2.1 time: 0.174843 Aug 29 11:20:52.743151 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3094/6149] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:20:52 2022] DELETE /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:20:52.755472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:52.756567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:52.767668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:52.768433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:52.768780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:52.769556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:52.770186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:52.770636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:52.936712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:52.945151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-feadddc1-4368-40ee-9270-ab97e1329fda tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1690 microversion: 2.1 time: 0.199003 Aug 29 11:20:52.945777 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3056/6150] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:52 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:53.971245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:53.972529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:53.980300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:53.980799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:53.981238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:53.982315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:53.982917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:53.983417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:54.171816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1428581a8234024aca68e3df7a5c130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8cea8ed46e4b7ea56f7b2e07f2a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:20:54.184243 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2ebd1a1-d3b9-4042-9196-075ebd402a19 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 200 len: 1690 microversion: 2.1 time: 0.218562 Aug 29 11:20:54.184755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3095/6151] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:53 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:20:54.610472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92b013f-2cfb-4b2a-bd6a-58132d929a2c", "name": "network-vif-deleted", "tag": "140099a1-8113-42b6-b0fa-a8fabfe90236"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:20:54.621321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:54.621756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:54.622205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:54.634374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] Creating event network-vif-deleted:140099a1-8113-42b6-b0fa-a8fabfe90236 for instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c on n-h2-854121-10 Aug 29 11:20:54.639148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2ed7411e-4851-47d7-b332-128a03cf2748 req-9b718621-cb30-4134-af61-faa60d0aad4f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Aug 29 11:20:54.639747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3057/6152] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:20:55.207443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:55.208001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] [instance: a92b013f-2cfb-4b2a-bd6a-58132d929a2c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:20:55.214816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:55.215330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:55.215773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:55.216466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:20:55.216925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:20:55.217360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:20:55.231352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] HTTP exception thrown: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Request method failure captured: Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c HTTP/1.1 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDJ-HoHXq7rbigtanIBQ4XXYzJALmUJhUS5Wff04_zmjciKb_kHOuaYAxHRyqPnpFPr-I9t60l4N50Qv9Y33uI794SBnMvhk5xFpkWiYOeaHrXuPAy2_8jWt6ijSQOJ6DuftyUCZVQio94h-z_xSxjb2TidZeCsAFnUK8f0LKrN_E_lM Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c8cea8ed46e4b7ea56f7b2e07f2a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 3c8cea8ed46e4b7ea56f7b2e07f2a4fe Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1640431621 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f1428581a8234024aca68e3df7a5c130 Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1640431621-project Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'a92b013f-2cfb-4b2a-bd6a-58132d929a2c'} Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:20:55.233021 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Returning 404 to user: Instance a92b013f-2cfb-4b2a-bd6a-58132d929a2c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6919a96d-0c97-473f-b393-bbb16fd074a3 tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c" status: 404 len: 111 microversion: 2.1 time: 0.031319 Aug 29 11:20:55.239490 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3096/6153] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:20:55 2022] GET /compute/v2.1/servers/a92b013f-2cfb-4b2a-bd6a-58132d929a2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:20:58.761320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62418452-c993-4dff-8996-bae79e87dd0b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] Calling method '.version_select at 0x7f66cb0d3c10>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:20:58.788398 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62418452-c993-4dff-8996-bae79e87dd0b tempest-TestNetworkAdvancedServerOps-1640431621 tempest-TestNetworkAdvancedServerOps-1640431621-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1986408054" status: 202 len: 0 microversion: 2.1 time: 0.032745 Aug 29 11:20:58.788985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3058/6154] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 11:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1986408054 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:23:13.038296 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 11:23:13.039479 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 11:23:13.040007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:13.040765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:13.041878 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:23:13.042061 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.47) !!! Aug 29 11:23:13.043011 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:23:13.043161 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.47) !!! Aug 29 11:23:13.047647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37fc629e-04ae-451e-8275-2d8cfd6537bd tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Action: 'create', calling method: .version_select at 0x7f66c5bced30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1680344531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWrPpKgg8klW4Cdt3P8Gp3ANTloEmfMbFsoxma3OLdocmnDOzAgMTQ+nhggCbULR6b49cxS3miYwCQRrvKqG6Ip0ecjh9g+shUNSEdyJDNp4nZY6/JkAcnEGIV66GFAyQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:13.073023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-37fc629e-04ae-451e-8275-2d8cfd6537bd tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Getting quotas for project c32d49935b074d918c65846acf275396. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:23:13.078585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-37fc629e-04ae-451e-8275-2d8cfd6537bd tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Getting quotas for user fc632f2dc8ac48fb8c968647c8cead15 and project c32d49935b074d918c65846acf275396. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:23:13.105870 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37fc629e-04ae-451e-8275-2d8cfd6537bd tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.070453 Aug 29 11:23:13.106482 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3097/6155] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:23:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:23:14.086737 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:23:14.087552 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:23:14.087930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:14.088783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:14.091136 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 11:23:14.091284 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 29 11:23:14.093799 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:23:14.093927 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 29 11:23:14.105642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1751292248", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ea409d0e-44e3-44ba-99ba-dce8e8f1914b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1680344531", "security_groups": [{"name": "tempest-secgroup-smoke-779966975"}], "networks": [{"uuid": "918cbe8d-0f82-4a91-9171-20b8272d6da2"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:14.228185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] validate_networks() for [('918cbe8d-0f82-4a91-9171-20b8272d6da2', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:23:14.814872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:23:14.815303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:23:14.815784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:23:14.816198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:23:14.816618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:23:14.826528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:14.827013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:14.827452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:14.828179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:14.828637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:14.829069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:14.846841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Getting quotas for project c32d49935b074d918c65846acf275396. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:23:14.853208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Getting quotas for user fc632f2dc8ac48fb8c968647c8cead15 and project c32d49935b074d918c65846acf275396. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:23:14.912183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:23:14.914474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea409d0e-44e3-44ba-99ba-dce8e8f1914b',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:23:15.056515 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ace14713-6e1e-4547-8928-b3afcf4635ac tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.971456 Aug 29 11:23:15.057172 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3059/6156] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:23:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:23:15.070009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98b9a91a-9375-42eb-921c-2026a9177fd6 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:15.070641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98b9a91a-9375-42eb-921c-2026a9177fd6 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:15.084707 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 34920. Aug 29 11:23:15.085593 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 34918. Aug 29 11:23:15.133660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98b9a91a-9375-42eb-921c-2026a9177fd6 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:15.141309 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98b9a91a-9375-42eb-921c-2026a9177fd6 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1099 microversion: 2.1 time: 0.077046 Aug 29 11:23:15.141912 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3098/6157] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:15 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1099 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:16.166765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fabfbdae-7c71-4104-8279-7712317dd435 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:16.167421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fabfbdae-7c71-4104-8279-7712317dd435 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:16.183277 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 34930. Aug 29 11:23:16.184073 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 34932. Aug 29 11:23:16.232119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fabfbdae-7c71-4104-8279-7712317dd435 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:16.239843 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fabfbdae-7c71-4104-8279-7712317dd435 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1099 microversion: 2.1 time: 0.079527 Aug 29 11:23:16.240551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3060/6158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:16 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1099 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:17.261222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ca6b2cd-2ab9-455c-bfb6-0d705db1376c tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:17.261821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ca6b2cd-2ab9-455c-bfb6-0d705db1376c tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:17.319169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ca6b2cd-2ab9-455c-bfb6-0d705db1376c tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:17.326424 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ca6b2cd-2ab9-455c-bfb6-0d705db1376c tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1099 microversion: 2.1 time: 0.069314 Aug 29 11:23:17.326992 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3099/6159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:17 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1099 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:18.345969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:18.346582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:18.354312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:18.354807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:18.355254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:18.355962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:18.356423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:18.356854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:18.430819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:18.439909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9ff5ab0c-291a-4269-a192-f9ccd219ba43 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1215 microversion: 2.1 time: 0.097172 Aug 29 11:23:18.440869 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3061/6160] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:18 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:19.462956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:19.463572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:19.471215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:19.471704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:19.472141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:19.472838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:19.473295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:19.473731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:19.676729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:19.685490 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2254c18e-7f22-4c36-8821-d1583fdf08d8 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1282 microversion: 2.1 time: 0.227822 Aug 29 11:23:19.697742 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3100/6161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:19 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:19.917821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:19.928488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:19.928983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:19.929422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:19.941506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] Creating event network-changed:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:23:19.948200 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3e3cf337-c91a-4249-848c-9c009a77b20b req-e22e6f68-59ac-4071-a4d3-308cbb011948 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195858 Aug 29 11:23:19.949834 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3062/6162] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:23:20.707390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:20.708368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:20.716650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:20.717254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:20.718101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:20.718812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:20.719452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:20.720041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:20.860923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:20.869489 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83f54760-12ce-498c-8087-c7a6b5321182 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1282 microversion: 2.1 time: 0.166177 Aug 29 11:23:20.870116 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3101/6163] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:20 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:21.891672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:21.892292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:21.899851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:21.900343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:21.900792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:21.901496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:21.902024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:21.902461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:22.041035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:22.049661 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be4f85a3-f6db-48ee-8d2e-792eb5862b89 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1282 microversion: 2.1 time: 0.162256 Aug 29 11:23:22.050307 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3063/6164] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:21 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:23.073114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:23.073791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:23.081382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:23.081913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:23.082354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:23.083054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:23.084216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:23.084766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:23.231229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:23.241229 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d09346e-a6d2-415d-b091-23d5c34bad4f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1282 microversion: 2.1 time: 0.172207 Aug 29 11:23:23.241664 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3102/6165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:23 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:24.262704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:24.263276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:24.270330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:24.270818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:24.271424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:24.272136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:24.272591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:24.273019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:24.408759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:24.417694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f95cdded-3f28-40a8-aa8c-d22d04060fee tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.158983 Aug 29 11:23:24.418299 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3064/6166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:24 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:25.443922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:25.444536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:25.451704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:25.452190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:25.452629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:25.453328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:25.453819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:25.454312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:25.603501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:25.611262 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e066d804-29ca-4869-9330-110af64a004f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.171755 Aug 29 11:23:25.611833 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3103/6167] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:25 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:26.633126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:26.633792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:26.635797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:26.637738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:26.643738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:26.644222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:26.644661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:26.645354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:26.645929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:26.646478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:26.780834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:26.790119 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd6977f0-8db8-4815-86e8-05d38c8ec20f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.161817 Aug 29 11:23:26.790697 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3065/6168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:26 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:27.810421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:27.811042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:27.813757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:23:27.820097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:27.820590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:27.821028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:27.821770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:27.822236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:27.822663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:27.969804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:27.978911 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dac3a10d-a90e-413c-b6d0-e4ad9ed9aa47 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.172260 Aug 29 11:23:27.979488 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3104/6169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:27 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:29.000529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:29.001149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:29.008137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:29.008795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:29.009046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:29.009771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:29.010227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:29.010659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:29.151595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:29.160663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-514d4d65-2cb2-424b-ae1c-d3e7dc21f903 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.164057 Aug 29 11:23:29.161245 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3066/6170] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:28 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:30.181529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:30.182135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:30.189345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:30.189868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:30.190303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:30.191003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:30.191453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:30.191878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:30.333128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:30.341202 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-52bcca68-1678-4887-865a-758358b6c94d tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.164183 Aug 29 11:23:30.341910 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3105/6171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:30 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:31.362664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:31.363313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:31.370981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:31.371475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:31.371920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:31.372625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:31.373086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:31.373512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:31.533588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:31.541075 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fa2acf0-5273-44e5-94aa-6a346c384eec tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.182320 Aug 29 11:23:31.541715 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3067/6172] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:31 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:32.562725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:32.563325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:32.570371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:32.570855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:32.571294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:32.572032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:32.572493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:32.572918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:32.706089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:32.714318 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-63a12e01-8ad6-4071-8422-fa04457f2a16 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.155444 Aug 29 11:23:32.715123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3106/6173] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:32 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:33.261270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "name": "network-vif-plugged", "status": "completed", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:33.271957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:33.272239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:33.272728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:33.285202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] Creating event network-vif-plugged:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:23:33.290528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e73cdab3-720b-4da7-ba5c-bd40b43bd324 req-2d551068-ca47-4690-8e30-787bced42ded service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103263 Aug 29 11:23:33.291126 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3068/6174] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:23:33.736155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:33.736750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:33.743851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:33.744329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:33.744761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:33.745451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:33.745936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:33.746361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:33.883049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:33.891131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cdcf5b50-ea71-49e6-8ac3-270b9167ffba tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1270 microversion: 2.1 time: 0.158947 Aug 29 11:23:33.891713 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3107/6175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:33 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:34.914681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:34.915380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:34.921625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:34.922141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:34.922583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:34.923277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:34.923733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:34.924160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:35.058015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:35.065805 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-58ae76dd-46ba-4c88-bab4-c2c308bb5561 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1458 microversion: 2.1 time: 0.157810 Aug 29 11:23:35.066380 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3069/6176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:34 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:35.087041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:23:35.087655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:23:35.094599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:35.095087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:35.095527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:35.096224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:35.096681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:35.097110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:35.234326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:23:35.242170 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-02a9fb56-0681-4afc-b166-dacd0e818374 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1458 microversion: 2.1 time: 0.159814 Aug 29 11:23:35.242746 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3108/6177] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:23:35 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:23:36.941589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:36.956973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:36.957489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:36.957960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:36.971140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] Creating event network-changed:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:23:36.982716 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bb3f906e-fe8e-4c70-8251-29d1a66f98e8 req-060a6e87-c870-4bd4-ab5f-cf83e9725b9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Aug 29 11:23:36.983530 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3070/6178] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:23:38.041933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:38.051471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:38.052024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:38.053082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:38.065257 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] Creating event network-changed:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:23:38.069475 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:23:39.077843 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 35006. Aug 29 11:23:39.081670 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b5686d3b-1d2c-472c-8255-4ede08f622c9 req-9417aa38-c481-4a28-b438-566626ae90b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.125782 Aug 29 11:23:39.082757 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3109/6179] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:23:41.100057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:23:41.109641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:23:41.110153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:23:41.110598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:23:41.122015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] Creating event network-changed:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:23:41.127075 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-147dd2cb-14bf-4bcb-9ed0-54c17b3553a9 req-af28074b-1679-4017-b534-ecc980737e1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032061 Aug 29 11:23:41.127716 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3071/6180] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:24:11.940948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:11.942258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:11.943333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:24:11.945569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:11.946543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=56 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:11.954638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:11.954889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:11.955242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:11.955528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=52 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:11.955701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:11.956394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:11.956865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:11.957305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:11.959611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:11.960213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:11.960925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:11.979690 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] Creating event network-changed:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:24:11.982940 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-abb9a626-ca18-47f1-acba-83ae5fcb35bd req-cc7526ff-91fc-4f91-b99a-592a8d83911d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044037 Aug 29 11:24:11.984141 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3072/6181] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:24:11.989923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:24:12.085882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa4ffcbf-89f6-4ecd-93fa-3af57420d573 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 204 len: 0 microversion: 2.1 time: 0.149528 Aug 29 11:24:12.086890 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3110/6182] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:24:11 2022] DELETE /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:24:12.098266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:12.099116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:12.106128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:12.107267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:12.107804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:12.108620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:12.109148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:12.109648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:12.283939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:12.292077 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9046b351-d1c7-4577-83ef-5e176c85551e tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1583 microversion: 2.1 time: 0.198919 Aug 29 11:24:12.292656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3073/6183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:12 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1583 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:13.315987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:13.316818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:13.323702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:13.324188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:13.324625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:13.325958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:13.326696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:13.327123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:13.509441 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:13.517733 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2225c0be-4344-4afc-bf8d-38181a39f7a2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1583 microversion: 2.1 time: 0.205943 Aug 29 11:24:13.518528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3111/6184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:13 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1583 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:13.994793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfad733-cf81-4700-8988-731563a6a34f", "name": "network-vif-deleted", "tag": "fc016f8c-fa69-4478-952e-4e515459f60d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:24:14.008433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:14.008814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:14.009327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:14.021832 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] Creating event network-vif-deleted:fc016f8c-fa69-4478-952e-4e515459f60d for instance 4cfad733-cf81-4700-8988-731563a6a34f on n-h2-854121-10 Aug 29 11:24:14.026582 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f9fc0c09-85ff-4275-a4b6-9e9f221196a3 req-2def4075-392c-4359-b686-5ccc47be5df7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 Aug 29 11:24:14.027386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3074/6185] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:24:14.540209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:14.540760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:14.547750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:14.548242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:14.548682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:14.549391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:14.549930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:14.550315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:14.615789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:14.624432 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8aaa39dc-819a-4406-aa9a-2fa6dbc3cfb7 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1230 microversion: 2.1 time: 0.088167 Aug 29 11:24:14.625024 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3112/6186] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:14 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:15.647933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:15.648641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:15.656409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:15.656912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:15.657359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:15.658120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:15.658581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:15.659025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:15.726197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:15.734589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa6f1356-29d1-4f34-a9aa-bb77f55a037b tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1230 microversion: 2.1 time: 0.091877 Aug 29 11:24:15.735172 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3075/6187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:15 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:16.756333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:16.756891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:16.763137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:16.763687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:16.764074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:16.764780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:16.765241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:16.765672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:16.832667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:16.840592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dcf0f677-1da5-490e-a939-d2a30645c96f tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1230 microversion: 2.1 time: 0.088470 Aug 29 11:24:16.842028 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3113/6188] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:16 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:17.863016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:17.863776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:17.869968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:17.870575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:17.871012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:17.871713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:17.872679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:17.873100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:17.937608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc632f2dc8ac48fb8c968647c8cead15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d49935b074d918c65846acf275396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:17.945624 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e69eaff-4b28-4894-b67f-88ebe18fd9e2 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 200 len: 1230 microversion: 2.1 time: 0.087036 Aug 29 11:24:17.946243 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3076/6189] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:17 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:18.968978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:18.969717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] [instance: 4cfad733-cf81-4700-8988-731563a6a34f] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:18.978378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:18.978863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:18.979299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:18.980283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:18.980999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:18.981482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:18.995069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] HTTP exception thrown: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Request method failure captured: Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f HTTP/1.1 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKEr0owaUszh7-KOBFFgWr-fP15gAMZ98lVM0FNWwwxNsl_MtJbmhQpziKyksJLSnWV06FukMXmUE0hJpdsIsxGA0W2Acd-yigiGB1OA4ndwgMD_jct4xCJbCE4LhV0OUSApz0O_G1TSDTJzKYgWPcNPQf7Kj2nAquGooSvqxwH1tcg Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c32d49935b074d918c65846acf275396 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBackupRestore-1393493463 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c32d49935b074d918c65846acf275396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c32d49935b074d918c65846acf275396"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c32d49935b074d918c65846acf275396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c32d49935b074d918c65846acf275396"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBackupRestore-1393493463 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c32d49935b074d918c65846acf275396 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1393493463 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBackupRestore-1393493463-project Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: fc632f2dc8ac48fb8c968647c8cead15 Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBackupRestore-1393493463-project Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '4cfad733-cf81-4700-8988-731563a6a34f'} Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:24:18.996744 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Returning 404 to user: Instance 4cfad733-cf81-4700-8988-731563a6a34f could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72594396-5388-4ffe-8703-cc80f83933c0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f" status: 404 len: 111 microversion: 2.1 time: 0.035427 Aug 29 11:24:19.002368 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3114/6190] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:18 2022] GET /compute/v2.1/servers/4cfad733-cf81-4700-8988-731563a6a34f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:24:19.167663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-167add35-d4cf-41f5-b540-0a0dbeabe3e0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] Calling method '.version_select at 0x7f66c5d11ca0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:19.202224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-167add35-d4cf-41f5-b540-0a0dbeabe3e0 tempest-TestVolumeBackupRestore-1393493463 tempest-TestVolumeBackupRestore-1393493463-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1680344531" status: 202 len: 0 microversion: 2.1 time: 0.037653 Aug 29 11:24:19.202962 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3077/6191] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 11:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1680344531 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:24:43.956444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-118137569", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c70958f5-9882-4998-942b-b1dd5d173a50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:24:43.973540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:43.974578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:44.244727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:24:44.761112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:24:44.761539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:24:44.762758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:24:44.763326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:24:44.763748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:24:44.773744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:44.774246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:44.774683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:44.775615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:44.776076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:44.776511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:44.796544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:24:44.803115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:24:44.868825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:24:44.871039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c70958f5-9882-4998-942b-b1dd5d173a50',volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:24:45.042515 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8ff900e0-e954-4125-a05f-d6a1b1e8fb47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092927 Aug 29 11:24:45.050035 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3115/6192] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:24:45.053205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=22 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:45.054196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:45.058967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-638ab43a-615e-4c21-980a-d1883387d5c2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:45.060170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-638ab43a-615e-4c21-980a-d1883387d5c2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:45.216972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-638ab43a-615e-4c21-980a-d1883387d5c2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:45.231776 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-638ab43a-615e-4c21-980a-d1883387d5c2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1056 microversion: 2.1 time: 0.179807 Aug 29 11:24:45.232792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3078/6193] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:45 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1056 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:46.253775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:46.254648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:46.262262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:46.263429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:46.264217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:46.264951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:46.265477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:46.265946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:46.369037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:46.378049 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a2da415-562b-4f8f-ab4e-cb7242bc294c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1154 microversion: 2.1 time: 0.128218 Aug 29 11:24:46.378924 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3116/6194] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:46 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1154 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:47.402220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:47.404112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:47.429257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:47.430464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:47.432129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:47.434517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:47.436551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:47.437869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:47.634578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:47.645469 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c29af2bb-64ca-415b-bdf8-0d7417a0fdb7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1214 microversion: 2.1 time: 0.247355 Aug 29 11:24:47.647372 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3079/6195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:47 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:47.958951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4099d9a3-cb70-4983-9773-aff9f2165077", "tag": "e56794e5-9815-44ae-96c7-3ee3d0355c5f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:24:47.970423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:47.971387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:47.971751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:47.988090 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] Creating event network-changed:e56794e5-9815-44ae-96c7-3ee3d0355c5f for instance 4099d9a3-cb70-4983-9773-aff9f2165077 on n-h2-854121-10 Aug 29 11:24:47.997895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ab5d8380-9cb4-4209-8c92-8be339018b8d req-3c762940-1056-461a-8463-e203a14dc628 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042405 Aug 29 11:24:47.999273 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3117/6196] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:24:48.670072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:48.670765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:48.678327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:48.678971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:48.679546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:48.681034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:48.681507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:48.681990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:48.831997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:48.843693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b610b9b5-d6a2-4970-91a9-31a818c628c4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1214 microversion: 2.1 time: 0.178976 Aug 29 11:24:48.844435 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3080/6197] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:48 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:49.866382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:49.867225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:49.875009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:49.875514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:49.876061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:49.876734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:49.877199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:49.877623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:50.034809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:50.043340 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6da0c705-7d09-47e8-b752-be8423b1ebc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1214 microversion: 2.1 time: 0.182026 Aug 29 11:24:50.044108 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3118/6198] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:49 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:51.065507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:51.066580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:51.073723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:51.074234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:51.074676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:51.075446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:51.075933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:51.076544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:51.227075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:51.238113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a2465be-ccd9-46da-82ca-be151b2ff63d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1214 microversion: 2.1 time: 0.176500 Aug 29 11:24:51.238627 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3081/6199] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:51 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:24:52.260379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:52.261011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:52.268137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:52.268621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:52.269057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:52.269773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:52.270230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:52.270657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:52.406289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:52.414910 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb5eeebb-8116-46b8-949a-8efa594fbcb9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.158350 Aug 29 11:24:52.415486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3119/6200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:52 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:53.436821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:53.437433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:53.444386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:53.444877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:53.445304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:53.446023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:53.446477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:53.446903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:53.585202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:53.594539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-14efcc37-0cec-43b3-a2e5-7a9b2e09a821 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.161836 Aug 29 11:24:53.595143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3082/6201] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:53 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:54.615687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:54.616310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:54.624682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:54.625175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:54.625617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:54.626342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:54.626802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:54.627230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:54.763497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:54.771284 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f896756-0df3-469f-a756-2e006b86b889 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.159511 Aug 29 11:24:54.771875 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3120/6202] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:54 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:55.792719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:55.793341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:55.796951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:55.803273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:55.803767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:55.804217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:55.804928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:55.805394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:55.805862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:55.939983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:55.948091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b66295e6-82b2-4908-b6bb-02fbe6168932 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.159280 Aug 29 11:24:55.948682 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3083/6203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:55 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:56.968957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:56.969610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:56.971733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:56.972414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:24:56.978658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:56.979146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:56.979882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:56.980305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:56.982122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:56.982122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:57.120947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:57.130154 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98e86ab3-3194-44e8-8ce1-2a17d750a741 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.165109 Aug 29 11:24:57.130734 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3121/6204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:56 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:58.151874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:58.152491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:58.159983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:58.160475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:58.160920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:58.161624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:58.162118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:58.162555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:58.296262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:58.304074 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-941e8a8a-6ada-48b6-ade5-528a6fd01854 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.156178 Aug 29 11:24:58.304665 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3084/6205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:58 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:24:59.324552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:24:59.325209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:24:59.332741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:59.333228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:59.333668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:59.334396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:24:59.334862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:24:59.335296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:24:59.466752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:24:59.474652 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e73b8c74-2ae5-4581-adf2-65a0b23a5c8a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.154040 Aug 29 11:24:59.475231 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3122/6206] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:24:59 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:00.496538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:00.497889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:00.504607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:00.505096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:00.505537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:00.506268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:00.507017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:00.507457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:00.643395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:00.651307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fb9141e-fcea-47ed-be9e-c65f854185d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.158721 Aug 29 11:25:00.651879 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3085/6207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:00 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:01.653791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4099d9a3-cb70-4983-9773-aff9f2165077", "name": "network-vif-plugged", "status": "completed", "tag": "e56794e5-9815-44ae-96c7-3ee3d0355c5f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:01.665412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:01.666450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:01.666450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:01.672843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:01.673648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:01.679665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] Creating event network-vif-plugged:e56794e5-9815-44ae-96c7-3ee3d0355c5f for instance 4099d9a3-cb70-4983-9773-aff9f2165077 on n-h2-854121-10 Aug 29 11:25:01.680918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:01.681519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:01.682091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:01.682927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:01.683634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:01.684397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:01.685873 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b280c6f9-5e55-4fb7-8dc9-2dba2f874235 req-18636974-e7b2-4cfe-95a4-b5ec75843e6f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Aug 29 11:25:01.686730 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3123/6208] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:25:01.822279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:01.830657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7e79cdd-3586-4f24-bfd0-86b3f2018d67 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1202 microversion: 2.1 time: 0.162629 Aug 29 11:25:01.831244 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3086/6209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:01 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:02.853852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:02.855345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:02.862507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:02.862986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:02.863433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:02.864198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:02.864685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:02.865127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.006663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:03.014984 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c8f883f1-9c0c-48fd-bae2-662cb30b1e75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1388 microversion: 2.1 time: 0.166652 Aug 29 11:25:03.015573 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3124/6210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:02 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1388 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:03.035274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:03.035891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:03.042879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.043365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.044357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.045070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.045616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.046170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.177668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:03.185876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-598e4c7d-f86c-481b-9fa1-3340fae21532 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1388 microversion: 2.1 time: 0.154906 Aug 29 11:25:03.186457 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3087/6211] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:03 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:03.206449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:03.207068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:03.213117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.213604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.214082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.214782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.215270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.216463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.358576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:03.366497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c81bcfda-445e-4300-8366-d58139380480 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1388 microversion: 2.1 time: 0.163978 Aug 29 11:25:03.367078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3125/6212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:03 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:25:03.386741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:03.387173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:03.394756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.395244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.395685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.396378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.396832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.397259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.422616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:25:03.499665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3edcee4f-f662-4918-851e-a9088de1103b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 204 len: 0 microversion: 2.1 time: 0.116679 Aug 29 11:25:03.500581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3088/6213] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:25:03 2022] DELETE /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:25:03.509230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:03.509982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:03.517083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.517578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.518055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.518758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:03.519226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:03.519659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:03.649452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:03.657301 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ecb1aae-24e8-4407-8ab6-9378811d639e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1394 microversion: 2.1 time: 0.151962 Aug 29 11:25:03.657902 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3126/6214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:03 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1394 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:04.679025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:04.679733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:04.688209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:04.688700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:04.689147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:04.689877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:04.690341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:04.690775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:04.819962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:04.828559 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74e15061-46ba-4307-9e27-49e3c7eba46a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1394 microversion: 2.1 time: 0.153908 Aug 29 11:25:04.829143 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3089/6215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:04 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1394 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:05.381345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4099d9a3-cb70-4983-9773-aff9f2165077", "name": "network-vif-deleted", "tag": "e56794e5-9815-44ae-96c7-3ee3d0355c5f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:05.396727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:05.397222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:05.397737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:05.412128 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] Creating event network-vif-deleted:e56794e5-9815-44ae-96c7-3ee3d0355c5f for instance 4099d9a3-cb70-4983-9773-aff9f2165077 on n-h2-854121-10 Aug 29 11:25:05.418766 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6edfd1f5-e67a-4dc2-b6c3-f6001f5c9837 req-10f3571f-8414-489b-951b-713a57342e44 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041413 Aug 29 11:25:05.419771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3127/6216] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:25:05.849498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:05.850213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:05.858154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:05.858645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:05.859085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:05.859797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:05.860256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:05.860687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:05.929499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:05.937724 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74f4e4b1-6e04-4017-9884-6877193a713b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1187 microversion: 2.1 time: 0.092120 Aug 29 11:25:05.938659 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3090/6217] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:05 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:06.959436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:06.960170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:06.967991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:06.968482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:06.968931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:06.969839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:06.970309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:06.970745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:07.041124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:07.049728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b16a24c2-5ddb-436f-a8cf-c2ef9550f4de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1187 microversion: 2.1 time: 0.094466 Aug 29 11:25:07.050348 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3128/6218] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:06 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:25:08.070975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:08.071554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:08.079513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:08.079998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:08.080449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:08.081177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:08.081917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:08.082384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:08.147606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:08.156564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d31d98ed-5777-4345-93f4-f03732ad15d3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1187 microversion: 2.1 time: 0.089578 Aug 29 11:25:08.157156 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3091/6219] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:08 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:09.179504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:09.180127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:09.187855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:09.188349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:09.188793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:09.189531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:09.190015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:09.190452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:09.254165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:09.262198 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5f18e644-df23-48d2-88ff-08610cd4f55e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 200 len: 1187 microversion: 2.1 time: 0.087215 Aug 29 11:25:09.263514 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3129/6220] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:09 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:10.284048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:10.284701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 4099d9a3-cb70-4983-9773-aff9f2165077] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:10.291624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:10.292105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:10.292542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:10.293230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:10.294359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:10.294791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:10.308010 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 HTTP/1.1 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '4099d9a3-cb70-4983-9773-aff9f2165077'} Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:25:10.309733 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 4099d9a3-cb70-4983-9773-aff9f2165077 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5832fd68-3881-4a37-84d9-9bd3db556aab tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077" status: 404 len: 111 microversion: 2.1 time: 0.031060 Aug 29 11:25:10.315304 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3092/6221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:10 2022] GET /compute/v2.1/servers/4099d9a3-cb70-4983-9773-aff9f2165077 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:25:15.269207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761010589", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3b2f91e-e3a3-473c-a94c-0a8b42d5d55c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:15.279798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:15.334444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:25:15.715115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:25:15.716186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:25:15.716784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:25:15.717195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:25:15.717657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:25:15.726515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:15.726997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:15.727429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:15.728151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:15.728606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:15.729028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:15.735452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=75 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:15.747961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:25:15.753437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:25:15.812558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:25:15.814654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3b2f91e-e3a3-473c-a94c-0a8b42d5d55c',volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:25:15.948925 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84198fc4-8259-40ed-ac82-ad708709a145 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683557 Aug 29 11:25:15.950278 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3130/6222] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:25:15.961506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-70cf9404-07b4-47c9-85a5-b9f80fe990b3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:15.962236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-70cf9404-07b4-47c9-85a5-b9f80fe990b3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:15.966441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:16.022585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-70cf9404-07b4-47c9-85a5-b9f80fe990b3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:16.031131 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-70cf9404-07b4-47c9-85a5-b9f80fe990b3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1057 microversion: 2.1 time: 0.073560 Aug 29 11:25:16.031716 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3093/6223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:15 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1057 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:25:17.053181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:17.053900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:17.061165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:17.061810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:17.062253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:17.062953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:17.063410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:17.063836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:17.133814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:17.142253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e563dc2c-a189-428d-93b9-f06d7d978cfc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1173 microversion: 2.1 time: 0.094135 Aug 29 11:25:17.143119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3131/6224] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:17 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1173 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:25:18.164927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:18.165576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:18.173866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:18.174356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:18.174801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:18.175520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:18.176013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:18.176450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:18.182259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:18.288942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e04327-f4a0-44a5-981d-6afe2f14af82", "tag": "3771d24c-9d42-4a81-a886-5fc56e00ddcd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:18.312163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:18.312656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:18.313098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:18.333745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:18.337599 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] Creating event network-changed:3771d24c-9d42-4a81-a886-5fc56e00ddcd for instance 26e04327-f4a0-44a5-981d-6afe2f14af82 on n-h2-854121-10 Aug 29 11:25:18.343487 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-214120cc-bcb4-455c-94ff-a2fd63a8c933 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1215 microversion: 2.1 time: 0.182512 Aug 29 11:25:18.344447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3094/6225] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:18 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:18.345639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-63bd73a7-9970-4da2-911d-1e0eaad27467 req-4ef6c563-87c1-4575-8b56-9c8a562b07ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061403 Aug 29 11:25:18.346658 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3132/6226] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:25:19.364685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:19.365560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:19.373493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:19.374034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:19.374489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:19.375223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:19.375772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:19.376216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:19.514276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:19.522367 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd558272-ceb2-46a2-b86a-d8df2a2b7826 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1215 microversion: 2.1 time: 0.161672 Aug 29 11:25:19.522955 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3095/6227] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:19 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:20.546705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:20.547363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:20.553793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:20.554290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:20.554735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:20.555443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:20.555901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:20.556335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:20.694312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:20.702480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20eaf9ea-1e30-43c2-b396-5043282787d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1215 microversion: 2.1 time: 0.161310 Aug 29 11:25:20.703127 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3133/6228] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:20 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:21.723318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:21.723918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:21.731557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:21.732063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:21.732501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:21.733225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:21.733681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:21.734134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:21.869688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:21.878001 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6fb2d641-f0c2-44f4-bceb-0831bfcbf50a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1215 microversion: 2.1 time: 0.158507 Aug 29 11:25:21.878649 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3096/6229] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:21 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:22.899690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:22.900288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:22.907639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:22.908123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:22.908558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:22.909242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:22.909723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:22.910147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:23.052001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:23.062094 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6562da6a-14ff-4d5c-af96-8228eec5c27a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.166176 Aug 29 11:25:23.062810 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3134/6230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:22 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:24.084152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:24.084780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:24.091922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:24.092405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:24.092848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:24.093540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:24.094022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:24.094453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:24.227708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:24.236209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebb0050e-a474-4ef3-9aa9-3ddab92f03ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.156009 Aug 29 11:25:24.236787 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3097/6231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:24 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:25.256629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:25.257240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:25.264252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:25.264763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:25.265199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:25.265932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:25.266406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:25.266815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:25.397586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:25.405959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-668f5a4a-5f86-4854-8c46-3bdaebd61cd1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.153173 Aug 29 11:25:25.406549 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3135/6232] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:25 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:26.426894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:26.427505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:26.430322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:26.435738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:26.436229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:26.436668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:26.437373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:26.437858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:26.438294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:26.581923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:26.590010 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-26585693-5296-465b-9eba-1663bc6e64ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.166868 Aug 29 11:25:26.591311 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3098/6233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:26 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:27.612180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:27.612821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:27.614863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:27.615549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:25:27.624684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:27.625180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:27.625625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:27.626371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:27.626833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:27.627264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:27.758661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:27.766898 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-480a9b32-eb6c-4c06-a72a-18dadd72b466 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.158508 Aug 29 11:25:27.767493 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3136/6234] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:27 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:28.787593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:28.788134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:28.796195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:28.796677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:28.797120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:28.797846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:28.798306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:28.798737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:28.935514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:28.943500 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7b13122-7b4f-4ed3-ae5b-4bf6d7129f8e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.159994 Aug 29 11:25:28.944071 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3099/6235] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:28 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:29.964558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:29.965123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:29.972040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:29.972528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:29.972970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:29.978654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:29.978654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:29.978654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:30.108905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:30.116802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4329b97d-5e3c-4d58-ae2b-f65c99b93404 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.156214 Aug 29 11:25:30.117390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3137/6236] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:29 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:31.139747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:31.140421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:31.147420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:31.147912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:31.148351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:31.149048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:31.149510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:31.149971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:31.283259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:31.291029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b4d14f7e-5112-473a-b3fa-2debd96d9fb1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.155635 Aug 29 11:25:31.291610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3100/6237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:31 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:31.838678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e04327-f4a0-44a5-981d-6afe2f14af82", "name": "network-vif-plugged", "status": "completed", "tag": "3771d24c-9d42-4a81-a886-5fc56e00ddcd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:31.850496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:31.850984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:31.851420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:31.862843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] Creating event network-vif-plugged:3771d24c-9d42-4a81-a886-5fc56e00ddcd for instance 26e04327-f4a0-44a5-981d-6afe2f14af82 on n-h2-854121-10 Aug 29 11:25:31.867820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3b3dae77-dd65-4418-963a-3c810b345a45 req-28e19730-a3c9-4765-b92b-0285f6f6a46f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Aug 29 11:25:31.868428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3138/6238] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:25:32.313455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:32.314069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:32.321005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:32.321492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:32.321960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:32.322656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:32.323115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:32.323545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:32.452976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:32.460738 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5fb3d0be-4d8e-4b76-ac36-393600908f58 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1203 microversion: 2.1 time: 0.151852 Aug 29 11:25:32.461314 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3101/6239] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:32 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:33.484307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:33.485131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:33.491918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.492407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.492854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.493562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.494056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.494489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.632598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:33.641398 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eaa790a2-df88-4626-96bc-42d01b90a6f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1389 microversion: 2.1 time: 0.162895 Aug 29 11:25:33.642017 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3139/6240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:33 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:33.666726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:33.668074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:33.676852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.677352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.677834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.678555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.679023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.679462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.819066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:33.828253 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7c65533d-d579-4940-ae41-2f23dd41af07 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1389 microversion: 2.1 time: 0.167617 Aug 29 11:25:33.828848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3102/6241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:33 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:33.849247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:33.849906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:33.856146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.857214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.857656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.858393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:33.858855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:33.859319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:33.995833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:34.005376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-32959fa6-da08-405a-be9d-37fd96bbbc31 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1389 microversion: 2.1 time: 0.159926 Aug 29 11:25:34.006034 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3140/6242] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:33 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:34.025760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:34.026180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:34.033379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:34.033920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:34.034388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:34.035091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:34.035552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:34.036017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:34.063064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:25:34.149272 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7a0020e4-4ab7-4d6a-b9ca-994fd8cbfcf0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 204 len: 0 microversion: 2.1 time: 0.127091 Aug 29 11:25:34.149888 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3103/6243] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:25:34 2022] DELETE /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:25:34.161560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:34.162248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:34.169326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:34.169877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:34.170319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:34.171028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:34.171509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:34.171931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:34.307932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:34.317259 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89047fff-7edc-4344-88b4-97dd3c95cd20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1395 microversion: 2.1 time: 0.162410 Aug 29 11:25:34.317874 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3141/6244] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:34 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1395 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:25:35.340912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:35.341567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:35.348534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:35.349028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:35.349476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:35.350247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:35.350713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:35.351145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:35.488387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:35.496408 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b224e68-805f-467a-8c9e-40cec0a9dca2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1395 microversion: 2.1 time: 0.159956 Aug 29 11:25:35.496985 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3104/6245] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:35 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:36.054036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e04327-f4a0-44a5-981d-6afe2f14af82", "name": "network-vif-deleted", "tag": "3771d24c-9d42-4a81-a886-5fc56e00ddcd"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:25:36.070145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:36.070757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:36.071274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:36.096392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] Creating event network-vif-deleted:3771d24c-9d42-4a81-a886-5fc56e00ddcd for instance 26e04327-f4a0-44a5-981d-6afe2f14af82 on n-h2-854121-10 Aug 29 11:25:36.102233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-329cd47f-8e21-4cdc-82aa-cda6adba9bb2 req-14872efa-f112-4722-a83a-ab907b3ef0e7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052574 Aug 29 11:25:36.103166 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3142/6246] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:25:36.517995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:36.518772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:36.525858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:36.526348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:36.526787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:36.527496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:36.527954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:36.528380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:36.594115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:36.602412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa6a61c7-3bcd-4eb8-b720-e31ab381cb3d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1188 microversion: 2.1 time: 0.088447 Aug 29 11:25:36.603002 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3105/6247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:36 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:37.624594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:37.625326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:37.633386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:37.633922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:37.634368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:37.635086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:37.635548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:37.636002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:37.712160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:37.721495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e68af5e8-e7e7-4109-9dc9-7d25de6a595e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1188 microversion: 2.1 time: 0.101315 Aug 29 11:25:37.722162 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3143/6248] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:37 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:38.742939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:38.743584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:38.751536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:38.752033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:38.752475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:38.753257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:38.753755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:38.754189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:38.819778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:38.829350 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4ecb0569-5435-4e35-82cb-4a3cb7e353ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1188 microversion: 2.1 time: 0.090127 Aug 29 11:25:38.829863 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3106/6249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:38 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:39.850252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:39.850800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:39.858525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:39.859198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:39.859645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:39.860360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:39.860823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:39.861254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:39.926554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:25:39.939597 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c6e66d58-98e8-4a92-8f4c-804f3fcb4d2a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 200 len: 1188 microversion: 2.1 time: 0.093355 Aug 29 11:25:39.940220 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3144/6250] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:39 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:25:40.961383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:25:40.962057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 26e04327-f4a0-44a5-981d-6afe2f14af82] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:25:40.969543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:40.970062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:40.970501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:40.971207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:25:40.971657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:25:40.972080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:25:40.989415 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 HTTP/1.1 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '26e04327-f4a0-44a5-981d-6afe2f14af82'} Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:25:40.991198 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 26e04327-f4a0-44a5-981d-6afe2f14af82 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c78d2ebe-85d8-433c-8933-5f49dd60f4c8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82" status: 404 len: 111 microversion: 2.1 time: 0.035223 Aug 29 11:25:40.996664 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3107/6251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:25:40 2022] GET /compute/v2.1/servers/26e04327-f4a0-44a5-981d-6afe2f14af82 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:26:02.275234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-699138371", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6aa43ece-0c35-4d49-84d7-02844ad3fd9f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:26:02.286056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:02.286718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=73 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:02.375171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:26:02.747469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:26:02.747954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:26:02.748430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:26:02.748840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:26:02.749249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:26:02.757987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:02.758465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:02.758893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:02.759608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:02.760057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:02.760476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:02.777871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:26:02.783697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:26:02.796417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:26:02.798490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6aa43ece-0c35-4d49-84d7-02844ad3fd9f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:26:02.870895 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a9403cfd-8b5a-4d69-bfb7-7f8462abddea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599478 Aug 29 11:26:02.871546 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3145/6252] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:26:02.883274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7127c913-27f3-44bb-a9db-46ffab35369a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:02.884042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7127c913-27f3-44bb-a9db-46ffab35369a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:02.886585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:02.887386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:02.947137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7127c913-27f3-44bb-a9db-46ffab35369a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:02.955693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7127c913-27f3-44bb-a9db-46ffab35369a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1056 microversion: 2.1 time: 0.076976 Aug 29 11:26:02.956292 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3108/6253] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:02 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1056 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:03.990194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:03.991264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:04.001086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:04.001575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:04.002236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:04.003174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:04.003631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:04.004209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:04.074999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:04.086043 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f8f15bcd-8438-4bb7-9e23-caf7397b0635 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1126 microversion: 2.1 time: 0.112087 Aug 29 11:26:04.087346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3146/6254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:03 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1126 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:05.107152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:05.108554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:05.117885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:05.118557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:05.119014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:05.119764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:05.120237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:05.120676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:05.286592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:05.296894 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54cf7832-13b3-49ff-b6ee-b621ada01d75 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.192782 Aug 29 11:26:05.297824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3109/6255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:05 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:05.511140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d00b7c-613a-4c34-81cd-880ae80e08a8", "tag": "e35112b5-f837-4747-a35d-cfbf7a8c0760"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:26:05.523803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:05.524443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:05.525076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:05.540813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] Creating event network-changed:e35112b5-f837-4747-a35d-cfbf7a8c0760 for instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 on n-h2-854121-10 Aug 29 11:26:05.545926 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a18828d4-880c-4669-b1a1-ec504f00ef9c req-1bf1563d-6dc3-470c-9f70-3dab7173f8f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038565 Aug 29 11:26:05.546545 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3147/6256] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:26:06.319530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:06.320165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:06.331208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:06.331712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:06.332157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:06.333078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:06.333548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:06.334010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:06.486332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:06.494608 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6e51d67e-6e3e-4ca5-ae22-044136961ca5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.180482 Aug 29 11:26:06.495718 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3110/6257] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:06 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:07.518505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:07.519233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:07.527163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:07.528105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:07.528105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:07.528796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:07.529946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:07.530802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:07.695137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:07.704734 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a2b5fee4-ccb7-43d0-93c9-389d1183e902 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.191486 Aug 29 11:26:07.717282 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3148/6258] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:07 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:08.730366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:08.731471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:08.739634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:08.740076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:08.740661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:08.741205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:08.741927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:08.742360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:08.935130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:08.944176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3980624c-dcc0-4283-95e0-2d18c1edb468 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.218335 Aug 29 11:26:08.945197 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3111/6259] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:08 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:09.974158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:09.974792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:09.983444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:09.983982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:09.984425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:09.985146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:09.985609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:09.986064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:10.134547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:10.145338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68296a9c-6c3b-4857-be8d-7af4d7d7de17 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.174840 Aug 29 11:26:10.145994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3149/6260] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:09 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:26:11.169754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:11.171461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:11.183646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:11.184431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:11.185418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:11.186645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:11.187335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:11.187876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:11.338864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:11.347666 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebcdb7a6-74d2-449c-99fa-e54917288147 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.182087 Aug 29 11:26:11.348443 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3112/6261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:11 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:12.368174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:12.368731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:12.378427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:12.378920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:12.379361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:12.380076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:12.380532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:12.380969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:12.516293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:12.524266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9832da9a-91a1-42b1-8d91-4b0c76d3f770 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.160096 Aug 29 11:26:12.524851 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3150/6262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:12 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:13.547215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:13.547825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:13.550797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:13.557545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:13.558161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:13.558610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:13.559326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:13.559789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:13.560229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:13.714245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:13.723318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c19d440-a69f-44ee-ab47-da3090bb1148 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.180001 Aug 29 11:26:13.736173 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3113/6263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:13 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:14.743516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:14.744117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:14.747344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:14.748577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:14.755031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:14.755603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:14.756047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:14.756749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:14.757203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:14.757629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:14.890784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:14.898554 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d5b02869-3609-4655-8e49-a77049932de6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.159017 Aug 29 11:26:14.899147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3151/6264] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:14 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:15.921288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:15.922208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:15.929390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:15.929919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:15.930414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:15.931091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:15.931553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:15.931989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:16.087054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:16.095257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1c7a4f4e-7b3d-4a68-95a9-783203c4cd15 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.178566 Aug 29 11:26:16.095844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3114/6265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:15 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:17.116199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:17.116746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:17.123914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:17.124271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:17.124711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:17.125403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:17.125884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:17.126309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:17.259276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:17.268347 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c41c5f8b-5e76-420d-8a35-8a04ee52046e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.156142 Aug 29 11:26:17.268929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3152/6266] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:17 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:18.289260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:18.289897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:18.296732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:18.297218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:18.297652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:18.298401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:18.298854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:18.299276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:18.442826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:18.451379 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b682fe7b-265b-4e8e-8426-6618c68d8aa1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1168 microversion: 2.1 time: 0.166274 Aug 29 11:26:18.451991 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3115/6267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:18 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:19.473101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:19.473734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:19.480604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:19.481085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:19.481518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:19.483017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:19.483473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:19.483898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:19.613060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:19.620899 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0658c949-0c3b-41e0-9627-9eaf19fae206 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.151657 Aug 29 11:26:19.621465 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3153/6268] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:19 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:20.642341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:20.642936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:20.649921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:20.650410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:20.650857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:20.651553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:20.652006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:20.652428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:20.788656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:20.797975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-592ad744-2bee-4dcf-a376-37c52ab37572 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.160166 Aug 29 11:26:20.798571 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3116/6269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:20 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:21.819819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:21.820405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:21.827721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:21.828217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:21.828656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:21.829354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:21.829832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:21.830261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:21.970254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:21.986851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0807ff45-012c-4b13-81bb-c8f8f39c9aa5 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.170872 Aug 29 11:26:21.987486 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3154/6270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:21 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:23.008598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:23.009215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:23.017622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:23.018161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:23.018602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:23.019313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:23.019776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:23.020207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:23.155678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:23.163851 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b217846-7d8e-4b3f-ab8c-04c5c1fc805a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.159231 Aug 29 11:26:23.164450 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3117/6271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:23 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:24.185180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:24.185902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:24.193060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:24.193547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:24.194011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:24.194712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:24.195162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:24.195587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:24.329845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:24.337509 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e0c14a8-4e99-4027-8186-e22dd0c02a51 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.156184 Aug 29 11:26:24.338112 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3155/6272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:24 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:25.360349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:25.360913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:25.367988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:25.368467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:25.368903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:25.369593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:25.370078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:25.370504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:25.500293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:25.508107 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-637f7a58-8ed3-4cd1-b9af-f4483d241f48 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.152493 Aug 29 11:26:25.508684 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3118/6273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:25 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:26.529065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:26.529620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:26.536561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:26.537041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:26.537476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:26.538185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:26.538641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:26.539066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:26.681902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:26.690639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dabf54a2-6893-4987-8343-765f202f96be tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.165493 Aug 29 11:26:26.691216 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3156/6274] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:26 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:27.711546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:27.712192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:27.720411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:27.720897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:27.721363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:27.722092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:27.722573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:27.723025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:27.857281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:27.866694 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10ceab55-96b1-415e-b0f8-183c45826d9b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.158692 Aug 29 11:26:27.867719 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3119/6275] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:27 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:28.059657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d00b7c-613a-4c34-81cd-880ae80e08a8", "name": "network-vif-plugged", "status": "completed", "tag": "e35112b5-f837-4747-a35d-cfbf7a8c0760"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:26:28.071515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:28.071874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:28.072314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:28.085159 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] Creating event network-vif-plugged:e35112b5-f837-4747-a35d-cfbf7a8c0760 for instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 on n-h2-854121-10 Aug 29 11:26:28.090220 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2f6aecf6-67ea-4c24-8772-569a035091ac req-394f7a95-db7a-4e0d-96ba-20438d8a03e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034230 Aug 29 11:26:28.090829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3157/6276] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:26:28.889082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:28.889925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:28.896879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:28.897369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:28.897836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:28.898530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:28.898981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:28.899404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:29.036836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:29.044938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e1dfe07-5f25-470d-a776-a250a27406f4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1202 microversion: 2.1 time: 0.160302 Aug 29 11:26:29.045524 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3120/6277] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:28 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:30.068109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:30.068818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:30.075107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.075596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.076693 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.078323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.078790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.079223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.558992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:30.567069 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f3a6ff3-e4d8-48c0-a307-6c4afe7e4238 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1388 microversion: 2.1 time: 0.504127 Aug 29 11:26:30.567653 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3158/6278] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:30 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1388 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:30.588103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:30.588706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:30.596822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.597318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.597797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.598514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.598972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.599402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.728437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:30.736736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-07935020-9d4d-401a-86fe-d029378d9a94 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1388 microversion: 2.1 time: 0.152490 Aug 29 11:26:30.737318 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3121/6279] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:30 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:30.756897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:30.757431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:30.763451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.764586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.765024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.765780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.766243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.766668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.896713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:30.904642 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e049723-4566-4448-bde9-48a40ce88fbe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1388 microversion: 2.1 time: 0.151542 Aug 29 11:26:30.905214 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3159/6280] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:30 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:30.982156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:30.983293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:30.990082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.990572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.991012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:30.991713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:30.992164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:30.992589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:31.019673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:26:31.099498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fd03492-7b20-40dc-899f-52126b57d832 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 204 len: 0 microversion: 2.1 time: 0.121428 Aug 29 11:26:31.100128 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3122/6281] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:26:30 2022] DELETE /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:26:31.108890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:31.109511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:31.116663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:31.117153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:31.117618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:31.118379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:31.118855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:31.119281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:31.251249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:31.259073 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7e49893f-17e1-47df-9c04-3f92fe45d14f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1394 microversion: 2.1 time: 0.154598 Aug 29 11:26:31.259650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3160/6282] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:31 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:32.281395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:32.282035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:32.292565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:32.293057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:32.293507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:32.294255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:32.294714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:32.296264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:32.432069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:32.435649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:32.440785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c37d27ee-1094-4f4e-9be0-06b5e0126d84 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1394 microversion: 2.1 time: 0.164737 Aug 29 11:26:32.441369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3123/6283] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:32 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1394 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:33.044353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d00b7c-613a-4c34-81cd-880ae80e08a8", "name": "network-vif-deleted", "tag": "e35112b5-f837-4747-a35d-cfbf7a8c0760"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:26:33.056413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:33.069533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:33.070809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:33.071810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:33.077940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=85 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:33.090949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] Creating event network-vif-deleted:e35112b5-f837-4747-a35d-cfbf7a8c0760 for instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 on n-h2-854121-10 Aug 29 11:26:33.098711 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4fac9868-43b0-48c1-a1bc-1f412cc5eafd req-7c86466e-d061-4584-8562-df9a062604ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057896 Aug 29 11:26:33.099853 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3161/6284] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:26:33.464233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:33.465805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:33.471853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:26:33.487953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:33.489202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:33.490380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:33.492122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:33.493533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:33.494561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:33.593298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:33.606791 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8d768e2-0972-4fff-9da2-32859a58a5fb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1187 microversion: 2.1 time: 0.148667 Aug 29 11:26:33.609016 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3124/6285] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:33 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:26:34.643081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:34.644443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:34.650292 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:26:34.650614 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 (ip 10.222.0.47) !!! Aug 29 11:26:34.667686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:34.668494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:34.669304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:34.670618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:34.671406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:34.672185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:34.776727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:34.787974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7dda881b-5083-469e-b634-aed1eb974f0d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1187 microversion: 2.1 time: 0.153232 Aug 29 11:26:34.788683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3162/6286] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:34 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:35.813644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:35.814775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:35.820125 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:26:35.820402 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 (ip 10.222.0.47) !!! Aug 29 11:26:35.835053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:35.835939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:35.836719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:35.837991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:35.838808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:35.839581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:35.950041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:35.964882 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-23125be8-7925-4ef3-897c-6e16addfbfaf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1187 microversion: 2.1 time: 0.157460 Aug 29 11:26:35.967686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3125/6287] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:35 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1187 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:26:36.995500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:36.996124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:37.003420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:37.003935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:37.004396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:37.005110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:37.005572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:37.006036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:37.078922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:37.087160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55a03b3b-c99e-45ca-a577-10d7c0b74fb6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1187 microversion: 2.1 time: 0.095512 Aug 29 11:26:37.087769 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3163/6288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:36 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:26:38.111147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:38.112449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:38.120308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:38.121137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:38.121680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:38.122670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:38.123963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:38.124594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:38.160552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:38.160774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:38.161134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:38.161588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid f9d00b7c-613a-4c34-81cd-880ae80e08a8 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:26:38.212341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:26:38.221127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2324f6e1-c771-4614-81bd-9e1290adf520 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 200 len: 1146 microversion: 2.1 time: 0.114899 Aug 29 11:26:38.222039 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3126/6289] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:38 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 1146 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:26:39.242606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:39.243242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:39.251237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:39.251827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:39.252341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:39.253124 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:39.253589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:39.254054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:39.269843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 HTTP/1.1 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f9d00b7c-613a-4c34-81cd-880ae80e08a8'} Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:39.271543 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67712eb8-f933-4979-9a90-39edbe97424c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 404 len: 111 microversion: 2.1 time: 0.034381 Aug 29 11:26:39.281189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3164/6290] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:39 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:26:41.427157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:41.427789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:41.435431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:41.436126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:41.436584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:41.437352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:41.437848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:41.438287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:41.453972 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 HTTP/1.1 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f9d00b7c-613a-4c34-81cd-880ae80e08a8'} Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:26:41.455703 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff557dd7-95ce-4d51-9173-bfdecef7a46b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 404 len: 111 microversion: 2.1 time: 0.034135 Aug 29 11:26:41.465246 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3127/6291] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:26:41 2022] DELETE /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:26:41.472875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:26:41.472875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: f9d00b7c-613a-4c34-81cd-880ae80e08a8] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:26:41.480641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:41.481136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:41.481571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:41.483144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:26:41.483401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:26:41.483839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:26:41.499078 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 HTTP/1.1 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f9d00b7c-613a-4c34-81cd-880ae80e08a8'} Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:26:41.500528 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance f9d00b7c-613a-4c34-81cd-880ae80e08a8 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d2bb40a-193a-4885-8c0b-2244b243894d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8" status: 404 len: 111 microversion: 2.1 time: 0.033622 Aug 29 11:26:41.510067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3165/6292] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:26:41 2022] GET /compute/v2.1/servers/f9d00b7c-613a-4c34-81cd-880ae80e08a8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:27:02.513132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1162443160", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ebc66730-f5fa-4b6a-b06d-9b53add40037", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:02.526451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=9 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:02.527256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=22 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:02.584283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:27:02.991050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:27:02.991350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:27:02.992007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:27:02.992433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:27:02.992886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:27:03.004447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:03.004949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:03.005402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:03.006184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:03.006649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:03.007083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:03.028286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:27:03.034955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:27:03.102840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:27:03.104957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebc66730-f5fa-4b6a-b06d-9b53add40037',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:27:03.249909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d1ae2d46-e8c5-42e3-acea-713b6c5485ff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741482 Aug 29 11:27:03.250501 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3128/6293] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:27:03.262790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f541f7ee-6245-4e5d-ba36-20f4c3ad20e0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:03.263982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f541f7ee-6245-4e5d-ba36-20f4c3ad20e0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:03.266555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=9 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:03.267231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=17 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:03.324220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f541f7ee-6245-4e5d-ba36-20f4c3ad20e0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:03.336757 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f541f7ee-6245-4e5d-ba36-20f4c3ad20e0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1071 microversion: 2.1 time: 0.078276 Aug 29 11:27:03.345552 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3166/6294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:03 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1071 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:04.360230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:04.361653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:04.373619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:04.374629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:04.375478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:04.376850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:04.377867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:04.378726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:04.463522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:04.478977 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a3a6499-457a-4c08-b8e0-a45d430c9b29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1177 microversion: 2.1 time: 0.124362 Aug 29 11:27:04.479966 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3129/6295] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:04 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1177 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:05.508823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:05.510543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:05.519654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:05.520872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:05.521526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:05.522494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:05.523151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:05.523994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:05.729645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:05.742780 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15be5743-a6b3-4407-a055-0b262f2dbac4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1229 microversion: 2.1 time: 0.237849 Aug 29 11:27:05.754709 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3167/6296] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:05 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1229 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:06.073531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9535bc04-9c4f-40f0-a70c-b2523e876b33", "tag": "224f077d-27d4-46e0-9c77-9fba339cb4cc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:06.120873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:06.121745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:06.124761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:06.156270 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] Creating event network-changed:224f077d-27d4-46e0-9c77-9fba339cb4cc for instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 on n-h2-854121-10 Aug 29 11:27:06.164846 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c9581794-b363-4237-bc03-d2baacc35082 req-314e833f-86c5-4273-b6f7-8a524e330e1f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100754 Aug 29 11:27:06.168498 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3130/6297] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:27:06.765350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:06.766677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:06.773997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:06.774496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:06.775156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:06.776075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:06.776710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:06.777313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:06.993014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:07.003655 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb15ebaa-8acc-4f8d-b716-affc313a59ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1229 microversion: 2.1 time: 0.242668 Aug 29 11:27:07.014289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3168/6298] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:06 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1229 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:08.036520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:08.037377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:08.046164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:08.046664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:08.047101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:08.047835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:08.048293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:08.048724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:08.207494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:08.215555 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d962347a-992f-4171-8af4-075755b20742 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1229 microversion: 2.1 time: 0.184042 Aug 29 11:27:08.216179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3131/6299] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:08 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1229 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:09.235660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:09.236287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:09.243633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:09.244123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:09.244563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:09.245266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:09.245783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:09.246225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:09.387156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:09.395741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-85329d31-0672-4212-83aa-84f87d3bc457 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1229 microversion: 2.1 time: 0.163930 Aug 29 11:27:09.396431 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3169/6300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:09 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:10.417981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:10.418609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:10.426007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:10.426496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:10.426940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:10.427643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:10.428100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:10.428526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:10.570787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:10.582104 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fab3ce63-0994-4c18-8e63-2b368b935732 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.167803 Aug 29 11:27:10.582707 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3132/6301] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:10 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:11.604476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:11.605077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:11.612627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:11.613112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:11.613550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:11.614278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:11.614733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:11.615159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:11.752329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:11.760256 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-21a64237-ebc7-4c89-8b3f-6e1cf23f37a6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.159703 Aug 29 11:27:11.760830 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3170/6302] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:11 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:12.781230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:12.781790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:12.788860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:12.789355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:12.789828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:12.790544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:12.791006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:12.791438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:12.927692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:12.936285 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7fbfaea-2ead-43f0-be47-e9513abff87f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.159000 Aug 29 11:27:12.936877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3133/6303] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:12 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:13.957766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:13.958328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:13.961054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:13.967105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:13.967738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:13.968176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:13.968873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:13.969326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:13.969778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:14.124408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:14.132559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac33cd36-0783-4018-a643-e6e3f128bab0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.178696 Aug 29 11:27:14.133173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3171/6304] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:13 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:15.153496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:15.154979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:15.157094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:15.157892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:15.164693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:15.165202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:15.165639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:15.166388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:15.166852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:15.167282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:15.322824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:15.332899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1f37219-86a4-4dff-aeb7-165f327ccb7f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.183256 Aug 29 11:27:15.333494 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3134/6305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:15 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:16.356346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:16.357787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:16.365212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:16.365735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:16.366195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:16.366936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:16.367419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:16.367852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:16.520597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:16.529095 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c09cef48-fa6f-4f5b-8b6b-f9447aa9dbe9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.177184 Aug 29 11:27:16.529969 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3172/6306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:16 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:17.549881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:17.550532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:17.556604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:17.557094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:17.557534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:17.558273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:17.558729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:17.559161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:17.690378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:17.698512 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-92ec8883-633d-453a-918b-4875ec07620f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.153040 Aug 29 11:27:17.699101 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3135/6307] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:17 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:18.301971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9535bc04-9c4f-40f0-a70c-b2523e876b33", "name": "network-vif-plugged", "status": "completed", "tag": "224f077d-27d4-46e0-9c77-9fba339cb4cc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:18.316240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:18.316851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:18.317835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:18.331177 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] Creating event network-vif-plugged:224f077d-27d4-46e0-9c77-9fba339cb4cc for instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 on n-h2-854121-10 Aug 29 11:27:18.337016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-33f13255-34f3-42e4-8c63-9698406f7791 req-b00dad05-cfeb-4875-80fc-a00d38c09886 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038918 Aug 29 11:27:18.337848 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3173/6308] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:27:18.719797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:18.720380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:18.727439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:18.727930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:18.728370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:18.729079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:18.729536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:18.729991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:18.865795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:18.874867 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1d5edd13-d30d-4a34-91af-0cc9fd430e61 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1217 microversion: 2.1 time: 0.159064 Aug 29 11:27:18.875468 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3136/6309] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:18 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:19.895893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:19.896600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:19.904624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:19.905117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:19.905562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:19.906647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:19.907404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:19.907520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:20.048282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:20.057113 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d9c534d-823f-4405-9361-fa4b2e300e9f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1404 microversion: 2.1 time: 0.165314 Aug 29 11:27:20.057748 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3174/6310] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:19 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:20.079261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:20.079894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:20.087346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:20.087831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:20.088271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:20.089019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:20.089475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:20.089938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:20.236945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:20.245731 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16e51873-8b8b-4d33-82df-68bccdef6e19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1404 microversion: 2.1 time: 0.171288 Aug 29 11:27:20.246534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3137/6311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:20 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:20.269319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2076592787"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:20.271766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:20.278442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:20.279246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:20.279745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:20.280593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:20.281110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:20.281914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:20.385551 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Attempting to quiesce instance before volume snapshot. Aug 29 11:27:20.458104 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 29 11:27:20.530491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Creating snapshot from volume ebc66730-f5fa-4b6a-b06d-9b53add40037. {{(pid=128681) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 29 11:27:21.430457 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2c5a5613-625f-4b29-af24-cb32c958802e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33/action" status: 202 len: 0 microversion: 2.1 time: 1.165127 Aug 29 11:27:21.436989 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3175/6312] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:27:20 2022] POST /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33/action => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 11:27:22.595594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1152015538", "imageRef": "8eacc190-2b65-45ea-9076-be4633975713", "flavorRef": "452", "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:22.655140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:27:23.045793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:27:23.046216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:27:23.046964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:27:23.047380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:27:23.047790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:27:23.056686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:23.057167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:23.057603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:23.058364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:23.058818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:23.059242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:23.076730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:27:23.082403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:27:23.095820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:27:23.098460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='87484f0a-b032-4dcc-88e7-1c88c1ef43c5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:27:23.182591 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2575cd8d-0a78-4d70-a9b8-549d61be9bc8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591318 Aug 29 11:27:23.183268 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3138/6313] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:27:23.195814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b7b743d-ad76-41ec-b551-afa0d9440af2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:23.196558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b7b743d-ad76-41ec-b551-afa0d9440af2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:23.255631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b7b743d-ad76-41ec-b551-afa0d9440af2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:23.276313 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b7b743d-ad76-41ec-b551-afa0d9440af2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1230 microversion: 2.1 time: 0.085467 Aug 29 11:27:23.280422 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3176/6314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:23 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:24.300836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:24.302183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:24.311285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:24.311873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:24.312429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:24.313239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:24.313850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:24.314323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:24.393057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:24.405471 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c35030bd-af12-4804-a5bb-40ced42c3490 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1300 microversion: 2.1 time: 0.109953 Aug 29 11:27:24.406790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3139/6315] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:24 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:25.428033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:25.428866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:25.437717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:25.438534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:25.438995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:25.440619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:25.441095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:25.441806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:25.665525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:25.675635 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d895bf3-e237-422e-8ea9-f25e1c233c4c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.251838 Aug 29 11:27:25.676604 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3177/6316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:25 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:25.907849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd76e5c-6937-4567-995d-2915d294ad53", "tag": "42930604-b02e-4348-a3fb-c44e5e8729ad"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:25.926856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:25.927897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:25.928402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:25.942305 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] Creating event network-changed:42930604-b02e-4348-a3fb-c44e5e8729ad for instance afd76e5c-6937-4567-995d-2915d294ad53 on n-h1-854121-10 Aug 29 11:27:25.955911 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7a30d2b2-d9e4-447f-b487-6b1dcbbc2940 req-011b067c-c8e1-4aff-8424-9da2d8aff9d9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052130 Aug 29 11:27:25.957590 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3140/6317] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:27:26.709072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:26.709752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:26.718246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:26.718769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:26.719230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:26.719994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:26.720473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:26.720920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:26.946171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:26.956639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b5afbe4-7aaf-402e-b90b-cbdda958f078 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.251263 Aug 29 11:27:26.958241 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3178/6318] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:26 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:27.987981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:27.990353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:27.999917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:28.000514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:28.003098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:28.005222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:28.005222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:28.005222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:28.203154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:28.215264 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aa1b7f7f-9a5a-44c0-aeaa-142db8765ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.235390 Aug 29 11:27:28.215848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3141/6319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:27 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:29.262279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:29.262842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:29.272199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:29.272707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:29.273159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:29.274302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:29.275099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:29.275873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:29.502071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:29.510698 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e33d564-d6cd-486e-a133-fcce3f4fc144 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.252718 Aug 29 11:27:29.512788 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3179/6320] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:29 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:30.537737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:30.538577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:30.548300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:30.548865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:30.549308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:30.550124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:30.550650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:30.551313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:30.722856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:30.739202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1986c8f7-13ee-4955-913c-5c2072be20c6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.205947 Aug 29 11:27:30.753337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3142/6321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:30 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:31.765245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:31.767086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:31.777122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:31.777994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:31.779321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:31.780376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:31.781152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:31.781877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:31.958422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:31.968073 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f7d5e3e6-a2d4-4749-997c-5edece629346 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.210284 Aug 29 11:27:31.968862 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3180/6322] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:31 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:32.991068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:32.991754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:32.995000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:33.001692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:33.002240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:33.002690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:33.003399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:33.003863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:33.004328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:33.007731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=75 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:33.066001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:33.089660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:33.144901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:33.152891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-963c15c5-224e-489a-b14b-f885cf151d19 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.165660 Aug 29 11:27:33.153527 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3143/6323] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:32 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:34.174835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:34.175467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:34.178334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:34.179021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:34.184159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:34.184569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:34.185090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:34.186098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:34.186587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:34.187026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:34.191449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:27:34.335876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:34.344456 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ba6a4053-7466-4d68-858a-289146199a28 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.174330 Aug 29 11:27:34.345039 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3181/6324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:34 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:35.366112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:35.366777 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:35.374714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:35.375211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:35.375659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:35.376391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:35.376858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:35.377295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:35.522401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:35.531353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3e6366fb-19a1-4743-b5b6-1d44a3df6699 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.169312 Aug 29 11:27:35.532179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3144/6325] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:35 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:36.552808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:36.553467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:36.561418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:36.561957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:36.562416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:36.563145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:36.563617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:36.564060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:36.709762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:36.719988 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bdc4c290-f0fc-4b06-bee3-faa5ce3ef7bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.171188 Aug 29 11:27:36.720575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3182/6326] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:36 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:37.742788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:37.743400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:37.750661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:37.751153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:37.751599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:37.752360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:37.752782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:37.753261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:37.902044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:37.910240 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c18b9895-09f8-47b7-a8b9-fd5a502016bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1342 microversion: 2.1 time: 0.171238 Aug 29 11:27:37.910836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3145/6327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:37 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:38.931401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:38.932013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:38.940271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:38.940778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:38.941224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:38.941969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:38.942479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:38.942904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:39.092084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:39.100188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53aa3ec6-f426-48ea-8aaa-0d571de553bf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1388 microversion: 2.1 time: 0.172695 Aug 29 11:27:39.100778 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3183/6328] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:38 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:40.125743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:40.126365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:40.133767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:40.134259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:40.134695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:40.135399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:40.135847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:40.136271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:40.272411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:40.281883 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-74a841c1-3917-4a03-bee1-ef78f2adcbdf tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.161201 Aug 29 11:27:40.282505 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3146/6329] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:40 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:41.304595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:41.305353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:41.314403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:41.315099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:41.315637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:41.316344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:41.316811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:41.317247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:41.455665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:41.464235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44f57019-bbdf-46f5-809a-49cb45249745 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.163506 Aug 29 11:27:41.465592 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3184/6330] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:41 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:42.487086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:42.487693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:42.494939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:42.495573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:42.496124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:42.496957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:42.497491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:42.498291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:42.650415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:42.659071 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e3c4c707-3ed4-404b-99d0-9197eba6442e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.176120 Aug 29 11:27:42.659651 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3147/6331] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:42 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:43.682405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:43.683079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:43.690789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:43.691295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:43.691777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:43.692621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:43.693094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:43.693543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:43.841688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:43.850894 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7a43cde4-494b-4e13-b36b-00f9982eb1d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.172780 Aug 29 11:27:43.851498 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3185/6332] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:43 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:44.873076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:44.873618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:44.880976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:44.881476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:44.881941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:44.882663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:44.883122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:44.883550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:45.040797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:45.049891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e5157172-6068-4705-b5c0-4a719cbd33f0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.180851 Aug 29 11:27:45.050497 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3148/6333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:44 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:46.074117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:46.075807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:46.086620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:46.087361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:46.087961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:46.088854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:46.089472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:46.090118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:46.308567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:46.318183 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-170252e3-2d7b-4405-8d10-f210768dcfe0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.249104 Aug 29 11:27:46.318784 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3186/6334] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:46 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:47.349458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:47.350312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:47.358704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:47.359402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:47.360005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:47.360900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:47.361421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:47.361942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:47.532350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:47.541781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb07726a-2ca1-4749-925d-a34f4107d324 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.197849 Aug 29 11:27:47.542549 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3149/6335] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:47 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:48.583556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:48.584826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:48.600530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:48.601993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:48.602995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:48.604101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:48.604857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:48.605469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:48.773018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:48.782026 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fdf03ad4-ed96-4ffc-81fa-822379ac3d86 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.206466 Aug 29 11:27:48.782992 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3187/6336] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:48 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:49.805525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:49.806356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:49.815031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:49.815508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:49.816083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:49.816857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:49.817335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:49.817835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:50.023676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:50.038102 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9e07caf0-8b60-4120-9b4f-f2a70a2d89c7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.236869 Aug 29 11:27:50.039101 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3150/6337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:49 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:27:50.354263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd76e5c-6937-4567-995d-2915d294ad53", "name": "network-vif-plugged", "status": "completed", "tag": "42930604-b02e-4348-a3fb-c44e5e8729ad"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:50.383325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:50.384561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:50.385037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:50.407117 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] Creating event network-vif-plugged:42930604-b02e-4348-a3fb-c44e5e8729ad for instance afd76e5c-6937-4567-995d-2915d294ad53 on n-h1-854121-10 Aug 29 11:27:50.414023 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9b42b941-abd3-4459-9b71-a5f2d18e25ca req-7f5bd792-6fe4-460f-9b2e-a647ef7fada7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065566 Aug 29 11:27:50.414661 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3188/6338] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:27:51.064501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:51.065391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:51.074113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:51.074797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:51.075953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:51.076936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:51.077564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:51.078411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:51.234954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:51.243414 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6fa5f96e-4ee9-4d32-a875-7b9d960fd01c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1376 microversion: 2.1 time: 0.184697 Aug 29 11:27:51.243951 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3151/6339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:51 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1376 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:52.268126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:52.268886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:52.275845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.276373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.276837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.277568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.278126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.279264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.420072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:52.428269 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5689ac30-a416-4d01-9e59-d2257844a352 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1562 microversion: 2.1 time: 0.166375 Aug 29 11:27:52.428864 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3189/6340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:52 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:52.452684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:52.453529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:52.460871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.461394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.461881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.462589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.463047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.463477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.609447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:52.617975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b3369d0-5311-4cb6-9c4d-cac1f0fdf231 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1562 microversion: 2.1 time: 0.169807 Aug 29 11:27:52.618624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3152/6341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:52 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:52.700657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:52.701158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:52.707721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.708225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.708680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.709396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.709898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.710346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.740721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:27:52.826352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed9ee0e0-be9a-4e2d-9e70-6a4be530b44a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 204 len: 0 microversion: 2.1 time: 0.128307 Aug 29 11:27:52.827311 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3190/6342] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:27:52 2022] DELETE /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:27:52.836112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:52.836725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:52.843104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.843596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.844033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.844734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:52.845185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:52.845610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:52.993008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:53.001766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-01288838-bab1-47b7-a093-8c795e3bee7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1568 microversion: 2.1 time: 0.169496 Aug 29 11:27:53.002362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3153/6343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:52 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:54.024984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:54.025805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:54.033051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:54.033545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:54.034028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:54.034739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:54.035206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:54.035639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:54.171383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:54.179372 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec98c4f0-9e42-4bbb-889e-9de335a158de tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1568 microversion: 2.1 time: 0.158852 Aug 29 11:27:54.179968 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3191/6344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:54 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:54.780819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd76e5c-6937-4567-995d-2915d294ad53", "name": "network-vif-deleted", "tag": "42930604-b02e-4348-a3fb-c44e5e8729ad"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:27:54.793278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:54.793759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:54.794786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:54.807154 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] Creating event network-vif-deleted:42930604-b02e-4348-a3fb-c44e5e8729ad for instance afd76e5c-6937-4567-995d-2915d294ad53 on n-h1-854121-10 Aug 29 11:27:54.813920 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-98930571-2cf2-4ae7-928b-2e4a5812a569 req-bb99fab5-1eb0-48e6-b2a3-d1b724cdf218 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037661 Aug 29 11:27:54.814609 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3154/6345] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:27:55.203312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:55.203969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:55.211141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:55.211640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:55.212090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:55.212810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:55.213280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:55.213751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:55.283532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:55.291861 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b46603e6-3404-4fbe-8b75-8334685a75ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1361 microversion: 2.1 time: 0.093292 Aug 29 11:27:55.292384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3192/6346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:55 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:56.317800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:56.318434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:56.326632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:56.327122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:56.327630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:56.329026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:56.329467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:56.329963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:56.402919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:56.411848 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ebaee779-b235-4fc4-99c0-2b3ead2146e8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1361 microversion: 2.1 time: 0.101110 Aug 29 11:27:56.412447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3155/6347] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:56 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:57.438542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:57.439941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:57.454147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:57.455036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:57.455856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:57.457242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:57.458130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:57.458941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:57.565661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:57.580888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7642487c-8a92-4e01-a347-785558f7229e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1361 microversion: 2.1 time: 0.150839 Aug 29 11:27:57.582194 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3193/6348] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:57 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:58.611574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:58.613130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:58.625729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:58.626640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:58.627385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:58.628266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:58.628895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:58.629512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:58.709126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:58.719386 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d1083fa-5550-4d7d-bd50-dfd647d76870 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1361 microversion: 2.1 time: 0.114787 Aug 29 11:27:58.720299 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3156/6349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:58 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1361 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:27:59.745073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:27:59.746453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:27:59.755849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:59.756449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:59.757065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:59.758060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:59.758826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:59.759278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:59.806804 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:27:59.807248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:27:59.808032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:27:59.808652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid afd76e5c-6937-4567-995d-2915d294ad53 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:27:59.885578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:27:59.895904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a0541386-e925-4edf-9492-65b42dc1244b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 200 len: 1366 microversion: 2.1 time: 0.156922 Aug 29 11:27:59.896989 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3194/6350] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:27:59 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:00.941219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:00.941844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:00.949936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:00.951384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:00.951909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:00.952710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:00.953512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:00.954076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:00.971412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 HTTP/1.1 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'afd76e5c-6937-4567-995d-2915d294ad53'} Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:00.973870 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c1f61893-5de5-4678-97fa-4e7311d38ca7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 404 len: 111 microversion: 2.1 time: 0.038245 Aug 29 11:28:01.005933 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3157/6351] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:00 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:28:05.374833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:05.375403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:05.378463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:05.384064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:05.384570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:05.385027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:05.385767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:05.386243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:05.386691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:05.391888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:05.421723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:28:05.517779 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-95f46252-9637-4b24-b65c-af260275e4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 204 len: 0 microversion: 2.1 time: 0.146935 Aug 29 11:28:05.518349 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3195/6352] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:28:05 2022] DELETE /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:28:05.532630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:05.533804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:05.538764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=30 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:05.548491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:05.549390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:05.550250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:05.551511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:05.552354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:05.553126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:05.561852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=82 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:05.733454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:05.741751 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff271939-5c67-424b-80ec-35f11e7620e1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1410 microversion: 2.1 time: 0.217845 Aug 29 11:28:05.742437 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3158/6353] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:05 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1410 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:06.766746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:06.768109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:06.777324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:06.777881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:06.779076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:06.780120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:06.780812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:06.781429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:06.931591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:06.940868 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53170705-e0f2-4b04-8f26-b453e7860800 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1410 microversion: 2.1 time: 0.179781 Aug 29 11:28:06.941456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3196/6354] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:06 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1410 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:07.512269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9535bc04-9c4f-40f0-a70c-b2523e876b33", "name": "network-vif-deleted", "tag": "224f077d-27d4-46e0-9c77-9fba339cb4cc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:07.524678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:07.526073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:07.526073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:07.539468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] Creating event network-vif-deleted:224f077d-27d4-46e0-9c77-9fba339cb4cc for instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 on n-h2-854121-10 Aug 29 11:28:07.545207 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d621c1a1-4fb5-4647-bb63-b8081ee7acfb req-a73c25fd-3f09-467e-90a4-cabdac7fb94e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036444 Aug 29 11:28:07.545860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3159/6355] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:28:07.969584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:07.971167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:07.996107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:07.996656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:07.997937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:07.998745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:07.999336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:07.999994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:08.084927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:08.100738 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97601686-bde1-4228-ab06-61a69e5fbcdc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1202 microversion: 2.1 time: 0.136954 Aug 29 11:28:08.101357 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3197/6356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:07 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1202 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:09.128982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:09.130260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:09.142181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:09.143034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:09.143794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:09.144999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:09.145810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:09.146529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:09.255890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:09.265241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a4ea489c-e764-4fa1-911f-4399adfc0e46 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1202 microversion: 2.1 time: 0.145547 Aug 29 11:28:09.266251 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3160/6357] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:09 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1202 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:10.303133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:10.304384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:10.316155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:10.316936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:10.317642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:10.318828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:10.319573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:10.320256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:10.420422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:10.430579 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a20dcb03-44eb-484d-aa57-ca9dc6cfb336 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1202 microversion: 2.1 time: 0.133060 Aug 29 11:28:10.431556 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3198/6358] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:10 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1202 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:11.463498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:11.464360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:11.474825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:11.475552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:11.476059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:11.476997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:11.477538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:11.478416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:11.572384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:11.587585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9d98514a-4933-417a-ad52-675a09022d22 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1202 microversion: 2.1 time: 0.127825 Aug 29 11:28:11.588624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3161/6359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:11 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1202 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:28:12.624570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:12.625381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:12.641917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:12.642970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:12.643564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:12.644450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:12.644990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:12.645565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:12.702973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:12.703934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:12.704536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:12.705592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid 9535bc04-9c4f-40f0-a70c-b2523e876b33 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:28:12.765010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:12.786369 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-507cd8c7-48a9-4db4-8d8e-f15649ad2070 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 200 len: 1207 microversion: 2.1 time: 0.167291 Aug 29 11:28:12.787254 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3199/6360] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:12 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 1207 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:13.812580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:13.813409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:13.820558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:13.821063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:13.821521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:13.822330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:13.822810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:13.823255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:13.844594 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 HTTP/1.1 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9535bc04-9c4f-40f0-a70c-b2523e876b33'} Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:13.847621 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4054135e-4fa3-4eac-9917-b0a5bbcb1f39 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 404 len: 111 microversion: 2.1 time: 0.041693 Aug 29 11:28:13.857053 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3162/6361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:13 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:28:16.039259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:16.040048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:16.042405 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:28:16.042708 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:28:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 (ip 10.222.0.47) !!! Aug 29 11:28:16.051022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.051539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.052001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.052763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.053246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.053692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.070846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 HTTP/1.1 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'afd76e5c-6937-4567-995d-2915d294ad53'} Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:16.072624 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3cf31d69-ec48-410f-a073-20dbbaf7dbfb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 404 len: 111 microversion: 2.1 time: 0.039341 Aug 29 11:28:16.081470 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3200/6362] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:28:16 2022] DELETE /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:28:16.090038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:16.091969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: afd76e5c-6937-4567-995d-2915d294ad53] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:16.107735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.108717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.109633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.111097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.111943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.112765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.142715 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 HTTP/1.1 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'afd76e5c-6937-4567-995d-2915d294ad53'} Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.145747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance afd76e5c-6937-4567-995d-2915d294ad53 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43430e53-dea2-4094-88e6-d6030078d2c3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53" status: 404 len: 111 microversion: 2.1 time: 0.067361 Aug 29 11:28:16.154780 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3163/6363] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:16 2022] GET /compute/v2.1/servers/afd76e5c-6937-4567-995d-2915d294ad53 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:28:16.703837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:16.704359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:16.711273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.711778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.712236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.712988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.713464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.713944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.729476 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 HTTP/1.1 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '9535bc04-9c4f-40f0-a70c-b2523e876b33'} Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:16.731130 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1c9d80f-b784-4801-b796-725b9636b81e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 404 len: 111 microversion: 2.1 time: 0.034087 Aug 29 11:28:16.740059 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3201/6364] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:28:16 2022] DELETE /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:28:16.743439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:16.743955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 9535bc04-9c4f-40f0-a70c-b2523e876b33] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:16.752130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.752781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.753074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.753838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:16.754308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:16.754752 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:16.771190 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 HTTP/1.1 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '9535bc04-9c4f-40f0-a70c-b2523e876b33'} Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:28:16.772753 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 9535bc04-9c4f-40f0-a70c-b2523e876b33 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8dad967c-2705-4a0c-9a12-44c386be2e1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33" status: 404 len: 111 microversion: 2.1 time: 0.035914 Aug 29 11:28:16.780171 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3164/6365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:16 2022] GET /compute/v2.1/servers/9535bc04-9c4f-40f0-a70c-b2523e876b33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:28:16.865225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-591a6c3f-e21e-493f-9f80-f9224f85ad1c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: .version_select at 0x7f66c404f940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2021143868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIadev4THnALkXnx3Ep3LDjfcW5ZdyHDAKhw2Bye5SB+zahr2nzGDpFVx9dQxRwD+k4XprjXSbnxpw5Lkm8qrL7WHIVaOsykE+iBNqgIGa6XKZ0fzkU7VPthUlwvlmwU0A=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:16.884835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-591a6c3f-e21e-493f-9f80-f9224f85ad1c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:28:16.892523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-591a6c3f-e21e-493f-9f80-f9224f85ad1c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:28:16.927233 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-591a6c3f-e21e-493f-9f80-f9224f85ad1c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.066069 Aug 29 11:28:16.927867 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3202/6366] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:28:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:28:35.905740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-643447950", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2021143868", "security_groups": [{"name": "tempest-secgroup-smoke-1214146659"}], "block_device_mapping_v2": [{"uuid": "2bfb29ac-ea21-49ba-85a3-5384c1ca6491", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:35.917196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=13 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:35.917911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=25 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:36.037140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:28:36.884895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:28:36.885325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:28:36.885846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:28:36.886268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:28:36.886691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:28:36.896876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:36.897369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:36.897853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:36.898598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:36.899060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:36.899494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:36.920103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:28:36.926188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:28:37.023258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:28:37.025525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bfb29ac-ea21-49ba-85a3-5384c1ca6491',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:28:37.193944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a63f1442-c106-41fc-b518-281e1c4035ee tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.292867 Aug 29 11:28:37.194636 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3165/6367] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:28:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:28:37.207619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-926a453b-bb8c-4542-88a1-5e78ff37db2b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:37.208846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-926a453b-bb8c-4542-88a1-5e78ff37db2b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:37.214553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:37.215820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:37.218796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:37.295802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-926a453b-bb8c-4542-88a1-5e78ff37db2b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:37.303948 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-926a453b-bb8c-4542-88a1-5e78ff37db2b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1094 microversion: 2.1 time: 0.101857 Aug 29 11:28:37.304545 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3203/6368] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:37 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1094 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:38.326058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:38.327162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:38.338852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:38.340787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:38.341861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:38.343311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:38.343886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:38.344456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:38.476879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:38.492947 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6a9d883b-3cb2-442b-9987-c9328846382a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1200 microversion: 2.1 time: 0.171315 Aug 29 11:28:38.495305 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3166/6369] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:38 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1200 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:39.530727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:39.531904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:39.568524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:39.569595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:39.570512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:39.571843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:39.572694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:39.573520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:39.875877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:39.893937 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1a574d54-339a-4663-a240-84c3b10c779b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1278 microversion: 2.1 time: 0.368432 Aug 29 11:28:39.913136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3204/6370] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:39 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1278 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:40.485064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c5d0c8-4aa1-4fcf-8195-64d6edb3a939", "tag": "9a215496-d419-4e5a-8d62-88001c89f39b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:40.504805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:40.506022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:40.506474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:40.519616 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] Creating event network-changed:9a215496-d419-4e5a-8d62-88001c89f39b for instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 on n-h1-854121-10 Aug 29 11:28:40.525543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e6674056-76d3-4151-8ab9-a9a7109b51ec req-87440962-1b6f-4489-91fd-99cf9beb9e6e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160840 Aug 29 11:28:40.526180 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3167/6371] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:28:40.936363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:40.937924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:40.952217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:40.953505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:40.954644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:40.956114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:40.957107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:40.958217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:41.255482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:41.276525 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-20cda7ac-780e-41b6-93fa-d685f3f925bd tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1278 microversion: 2.1 time: 0.347615 Aug 29 11:28:41.278583 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3205/6372] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:40 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1278 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:42.314764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:42.316079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:42.328050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:42.329152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:42.329929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:42.330846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:42.331321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:42.332055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:42.539754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:42.549392 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-65922155-d551-4b1a-a45e-3be262799eb2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1278 microversion: 2.1 time: 0.243838 Aug 29 11:28:42.550250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3168/6373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:42 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:28:43.572569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:43.573654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:43.581883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:43.582416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:43.582850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:43.583598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:43.584069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:43.584516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:43.768598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:43.778582 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6be801c3-1a18-423b-a6f6-1eabc3a30387 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1278 microversion: 2.1 time: 0.209679 Aug 29 11:28:43.779885 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3206/6374] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:43 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:44.811388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:44.812551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:44.824152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:44.825548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:44.826402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:44.827783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:44.828913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:44.829754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:45.048973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:45.058973 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42ba4a46-e5a7-4c3f-bddb-11cb310421ed tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.252666 Aug 29 11:28:45.059848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3169/6375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:44 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:46.090395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:46.091514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:46.097873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:46.098508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:46.099083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:46.099937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:46.100514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:46.101061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:46.256028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:46.265446 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03099272-de8d-42a9-b5ec-31896df49d8d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.179876 Aug 29 11:28:46.266070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3207/6376] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:46 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:47.299963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:47.300592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:47.302852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:47.303737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:47.310584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:47.311088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:47.311528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:47.312246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:47.312705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:47.313170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:47.494098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:47.503104 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42fabd43-d100-49ab-aef0-3c02d1dc680b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.207027 Aug 29 11:28:47.503726 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3170/6377] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:47 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:28:48.663087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:48.664271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:48.669008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:28:48.678786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:48.679679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:48.680483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:48.681773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:48.682631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:48.683437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:48.860440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:48.874775 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-901d8d63-00b8-4ddb-a827-95e478da841b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.218768 Aug 29 11:28:48.875893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3208/6378] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:48 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:49.897855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:49.898758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:49.908367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:49.908869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:49.909314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:49.910069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:49.910536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:49.911359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:50.102507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:50.111663 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-450202e2-50f8-441a-8c42-8afb9d105506 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.218594 Aug 29 11:28:50.112285 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3171/6379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:49 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:51.135695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:51.136513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:51.146223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:51.146936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:51.147581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:51.148534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:51.149300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:51.149984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:51.315035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:51.323826 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c56665a-6543-437e-8994-e5c22f24b587 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.192544 Aug 29 11:28:51.325021 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3209/6380] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:51 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:52.354739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:52.355331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:52.362603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:52.363095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:52.363528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:52.364228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:52.364676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:52.365123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:52.530513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:52.539071 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ebb7b92-b783-4f97-8852-414fbc2b13b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.197167 Aug 29 11:28:52.539676 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3172/6381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:52 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:53.560361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:53.561003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:53.568792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:53.569321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:53.569811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:53.570579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:53.571042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:53.571489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:53.727721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:53.736051 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-653e12c5-fc45-400c-9ff0-0dfe8b05baf2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.179857 Aug 29 11:28:53.736657 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3210/6382] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:53 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:54.761195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:54.763036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:54.770152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c5d0c8-4aa1-4fcf-8195-64d6edb3a939", "name": "network-vif-plugged", "status": "completed", "tag": "9a215496-d419-4e5a-8d62-88001c89f39b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:54.776564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:54.777476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:54.778266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:54.779467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:54.780264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:54.781021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:54.788350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:54.789185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:54.789964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:54.811475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] Creating event network-vif-plugged:9a215496-d419-4e5a-8d62-88001c89f39b for instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 on n-h1-854121-10 Aug 29 11:28:54.820349 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-33a1bab9-5bdd-416a-9872-d9d558fa15fd req-43ed7325-9f8b-4419-9ef2-874650133b20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139731 Aug 29 11:28:54.821790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3173/6383] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:28:55.051078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:55.060415 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0def08d5-bff4-44d7-8379-0a1c3e72e90d tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1266 microversion: 2.1 time: 0.306179 Aug 29 11:28:55.061036 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3211/6384] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:54 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:28:56.088699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:56.090061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:56.103856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:56.104921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:56.105929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:56.107664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:56.108500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:56.109260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:56.287917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:56.296960 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb3dc6b5-abb7-4c0b-a444-5e8477d53d97 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1452 microversion: 2.1 time: 0.217340 Aug 29 11:28:56.297552 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3174/6385] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:56 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:28:56.317975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:28:56.318850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:28:56.326308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:56.326822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:56.327278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:56.328036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:56.329131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:56.329578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:56.508100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:28:56.518131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c25dc85-74c4-4cf3-8d73-d1245e324b7b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1452 microversion: 2.1 time: 0.204048 Aug 29 11:28:56.518733 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3212/6386] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:28:56 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:28:59.064432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c5d0c8-4aa1-4fcf-8195-64d6edb3a939", "tag": "9a215496-d419-4e5a-8d62-88001c89f39b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:28:59.074839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:28:59.075571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:28:59.076020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:28:59.088908 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] Creating event network-changed:9a215496-d419-4e5a-8d62-88001c89f39b for instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 on n-h1-854121-10 Aug 29 11:28:59.095576 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8c9844fb-f7f5-4383-891f-759b7b645c50 req-eba06073-0ce4-4351-ac9d-6ea248a716c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106716 Aug 29 11:28:59.096452 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3175/6387] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:30:56.858867 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 11:30:56.859681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=22 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:30:56.860425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=54 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:30:56.861476 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:30:56.861620 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 (ip 10.222.0.47) !!! Aug 29 11:30:56.863638 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 11:30:56.863775 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 (ip 10.222.0.47) !!! Aug 29 11:30:56.930472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:30:56.931022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:30:56.938540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:56.939048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:56.939506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:56.940222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:56.940700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:56.941177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:56.967671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:30:57.052851 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f986e35b-caf8-4da2-bd68-19d2531cf5d7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 204 len: 0 microversion: 2.1 time: 0.196053 Aug 29 11:30:57.053472 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3213/6388] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:30:56 2022] DELETE /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:30:57.060470 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:30:57.061281 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:30:57.061898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:30:57.062789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=50 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:30:57.064213 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:30:57.064349 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 (ip 10.222.0.47) !!! Aug 29 11:30:57.070999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:30:57.071707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:30:57.082021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:57.082518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:57.082964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:57.083676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:57.084135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:57.084568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:57.277788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:30:57.285733 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd733afc-bd7b-4c24-a475-4f74b43ba220 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1576 microversion: 2.1 time: 0.227188 Aug 29 11:30:57.286312 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3176/6389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:30:57 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:30:58.307846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:30:58.308491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:30:58.318851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:58.319360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:58.319815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:58.320542 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:58.321018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:58.321463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:58.328842 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 36834. Aug 29 11:30:58.513129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:30:58.521342 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41818472-6b5a-498c-996f-5d2327d08b47 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1576 microversion: 2.1 time: 0.218130 Aug 29 11:30:58.521953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3214/6390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:30:58 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:30:59.543438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:30:59.543993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:30:59.559798 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 36842. Aug 29 11:30:59.568031 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 36840. Aug 29 11:30:59.570869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:59.571365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:59.571809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:59.573232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:59.573877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:59.574245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:59.673983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:30:59.682939 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4d9a8b0e-8ba8-4af4-8d54-b8c4040d61b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1508 microversion: 2.1 time: 0.142807 Aug 29 11:30:59.683629 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3177/6391] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:30:59 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:30:59.789073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c5d0c8-4aa1-4fcf-8195-64d6edb3a939", "name": "network-vif-deleted", "tag": "9a215496-d419-4e5a-8d62-88001c89f39b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:30:59.805564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:30:59.806092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:30:59.806555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:30:59.819585 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] Creating event network-vif-deleted:9a215496-d419-4e5a-8d62-88001c89f39b for instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 on n-h1-854121-10 Aug 29 11:30:59.825977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e58b213b-bfa4-4083-abe0-41754e36932a req-5408378a-eede-4182-bfff-694883c3ee7d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040397 Aug 29 11:30:59.826923 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3215/6392] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:31:00.704953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:00.714500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:00.721930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:00.722425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:00.722868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:00.723574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:00.724031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:00.724460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:00.795566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:00.804339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e04476b0-bcd3-4de0-815e-01de7d9a9cff tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1225 microversion: 2.1 time: 0.103641 Aug 29 11:31:00.805032 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3178/6393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:00 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:01.826788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:01.827448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:01.834123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:01.834631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:01.835093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:01.835814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:01.836289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:01.836737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:01.905221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:01.913281 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-12a06bf0-3607-4944-8a38-1bb7d5c6a12e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1225 microversion: 2.1 time: 0.091761 Aug 29 11:31:01.913888 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3216/6394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:01 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:02.934994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:02.935599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:02.942646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:02.943135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:02.943582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:02.944289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:02.944744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:02.945174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:03.028345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:03.036267 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a0c9ad8-6b0e-41a7-a79a-58b956c55ab6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1225 microversion: 2.1 time: 0.105290 Aug 29 11:31:03.036844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3179/6395] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:02 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:04.057750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:04.058389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:04.066430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:04.066941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:04.067409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:04.068135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:04.068689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:04.069059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:04.102321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:04.102830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:04.103286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:04.104561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:31:04.148891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:04.157511 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3deb4be8-36a8-4650-9cc8-657c9be05e20 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 200 len: 1230 microversion: 2.1 time: 0.103767 Aug 29 11:31:04.158114 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3217/6396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:04 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:05.179289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:05.179888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:05.187561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:05.188055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:05.188502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:05.189242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:05.189728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:05.190165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:05.204179 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 HTTP/1.1 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '84c5d0c8-4aa1-4fcf-8195-64d6edb3a939'} Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:31:05.205898 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b273c7ef-fb95-42a2-972e-cc4caf9d1184 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 404 len: 111 microversion: 2.1 time: 0.032056 Aug 29 11:31:05.211031 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3180/6397] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:05 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:31:05.259994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1352290793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2021143868", "security_groups": [{"name": "tempest-secgroup-smoke-1214146659"}], "block_device_mapping_v2": [{"uuid": "2bfb29ac-ea21-49ba-85a3-5384c1ca6491", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:31:05.379679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:31:06.179216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:31:06.179672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:31:06.180177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:31:06.180623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:31:06.181063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:31:06.191831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:06.192373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:06.192835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:06.193624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:06.194148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:06.194588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:06.216670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:31:06.223023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:31:06.297776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:31:06.300191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bfb29ac-ea21-49ba-85a3-5384c1ca6491',volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:31:06.452529 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a02ea3a2-d582-4950-b5bd-823bb79e389f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.196602 Aug 29 11:31:06.453366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3218/6398] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:31:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:31:06.470372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-649bee17-c451-4f48-ac0b-e262d6d30190 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:06.471007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-649bee17-c451-4f48-ac0b-e262d6d30190 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:06.534364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-649bee17-c451-4f48-ac0b-e262d6d30190 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:06.542916 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-649bee17-c451-4f48-ac0b-e262d6d30190 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1095 microversion: 2.1 time: 0.076352 Aug 29 11:31:06.543487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3181/6399] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:06 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:31:07.564906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:07.565559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:07.572770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:07.573988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:07.574451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:07.575183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:07.575658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:07.576113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:07.652624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:07.661178 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35f9d5d8-a5d3-44cf-9698-096bb24b3711 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1201 microversion: 2.1 time: 0.101038 Aug 29 11:31:07.661896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3219/6400] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:07 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:08.685312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:08.686176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:08.694234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:08.695022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:08.695468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:08.696186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:08.696643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:08.698039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:08.840372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:08.849053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a7e65976-f0c8-4db2-aa09-e63727c48bfa tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1279 microversion: 2.1 time: 0.168981 Aug 29 11:31:08.850047 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3182/6401] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:08 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:09.083860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86305c53-3aad-49f3-9c59-a5648e553cf9", "tag": "f6c0cbee-a640-4c47-9f30-000519623417"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:31:09.104708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:09.106063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:09.107955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:09.122715 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] Creating event network-changed:f6c0cbee-a640-4c47-9f30-000519623417 for instance 86305c53-3aad-49f3-9c59-a5648e553cf9 on n-h2-854121-10 Aug 29 11:31:09.128387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-10f14cc3-62a3-448b-84d2-c951c19d3d30 req-335634c0-f661-4384-ae31-87d0755600fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051847 Aug 29 11:31:09.129064 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3220/6402] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:31:09.874149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:09.875460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:09.884365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:09.885895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:09.886341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:09.887059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:09.887518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:09.888004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:10.085607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:10.095333 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-19a5b020-c37e-4cfd-88c2-79e181e954eb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1279 microversion: 2.1 time: 0.227049 Aug 29 11:31:10.095919 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3183/6403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:09 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1279 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:11.121481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:11.122245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:11.132601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:11.283008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:11.293150 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbc109fd-bf53-4cb0-86b9-2a93b0ffd01f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1279 microversion: 2.1 time: 0.178003 Aug 29 11:31:11.293911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3221/6404] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:11 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:12.316042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:12.316633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:12.324835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:12.325337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:12.325823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:12.326556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:12.327020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:12.327456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:12.465251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:12.473405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c95c667f-cfcf-4ff3-b296-3668b3d55ab1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1279 microversion: 2.1 time: 0.161448 Aug 29 11:31:12.474031 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3184/6405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:12 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:13.495079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:13.495733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:13.502660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:13.503158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:13.503607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:13.504318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:13.504784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:13.505222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:13.660359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:13.669639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9b2f15b9-7b36-4164-94f8-291de58323d4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.178570 Aug 29 11:31:13.670290 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3222/6406] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:13 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:14.691751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:14.692541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:14.699650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:14.700142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:14.700577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:14.701282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:14.701762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:14.702192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:14.848967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:14.857553 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8938ba10-d7be-4c10-98cf-0cde92da24e4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.169787 Aug 29 11:31:14.858179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3185/6407] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:14 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:15.879255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:15.879911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:15.886671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:15.887169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:15.887617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:15.888333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:15.888797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:15.889234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:16.037842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:16.046918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adc42225-9be5-417d-82d5-f2a0f4d8d289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.171888 Aug 29 11:31:16.047512 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3223/6408] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:15 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:31:17.068387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:17.069020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:17.071818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:31:17.077672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:17.078536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:17.079303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:17.080016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:17.080470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:17.080898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:17.221339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:17.229693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-631a9cfe-1ca8-473e-a8b5-65e9aaef76c1 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.165262 Aug 29 11:31:17.230299 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3186/6409] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:17 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:18.249602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:18.250258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:18.252221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:31:18.252907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:31:18.260639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:18.261141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:18.261595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:18.262328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:18.262801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:18.263242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:18.399046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:18.407204 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-de88d24d-54a5-4345-ac58-0a5fede7c920 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.161443 Aug 29 11:31:18.407789 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3224/6410] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:18 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:19.427314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:19.427935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:19.436025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:19.436587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:19.437012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:19.437754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:19.438221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:19.438659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:19.577639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:19.585892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-392fe7b7-9b84-4631-9b26-ed508f267d0c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.162560 Aug 29 11:31:19.586474 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3187/6411] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:19 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:20.606845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:20.607505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:20.614451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:20.614960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:20.615423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:20.616126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:20.616604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:20.617043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:20.752174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:20.760016 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8bc1d994-81f7-4be2-9e9c-d5f4482ce3b8 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.157396 Aug 29 11:31:20.760601 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3225/6412] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:20 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:21.780776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:21.781390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:21.788389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:21.788878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:21.789318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:21.790044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:21.790510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:21.791575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:21.928015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:21.936902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0732a739-3860-4238-a9db-feac83a7fc96 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.160002 Aug 29 11:31:21.937483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3188/6413] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:21 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:22.959420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:22.960048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:22.967623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:22.968118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:22.968566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:22.969271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:22.969764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:22.970204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:23.115091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:23.123651 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ddd66273-ba2c-4479-b729-8ece4f7aacf4 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.168235 Aug 29 11:31:23.124248 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3226/6414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:22 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:23.202597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86305c53-3aad-49f3-9c59-a5648e553cf9", "name": "network-vif-plugged", "status": "completed", "tag": "f6c0cbee-a640-4c47-9f30-000519623417"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:31:23.214499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:23.214992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:23.215429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:23.226880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] Creating event network-vif-plugged:f6c0cbee-a640-4c47-9f30-000519623417 for instance 86305c53-3aad-49f3-9c59-a5648e553cf9 on n-h2-854121-10 Aug 29 11:31:23.231566 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] [9d741e41-af34-4521-9953-4ee390d43694] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:31:24.145242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:24.145954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:24.153676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:24.154206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:24.154663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:24.155406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:24.155880 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:24.156324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:24.239620 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] [9d741e41-af34-4521-9953-4ee390d43694] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 36924. Aug 29 11:31:24.243232 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d2269277-4a16-4c4d-b40d-14163a7f6086 req-2beb7565-67b3-49db-b7c2-0f155180ba01 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044541 Aug 29 11:31:24.244956 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3189/6415] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:31:24.303410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:24.312269 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-723f6bc5-9dcb-43b7-8066-d4ed4cf25289 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.170862 Aug 29 11:31:24.312867 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3227/6416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:24 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:31:25.335205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:25.335830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:25.342954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:25.343443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:25.343882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:25.344583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:25.345042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:25.345471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:25.493268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:25.501237 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4eb3cca8-0395-4cb3-8e42-ad82d8ba419a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1267 microversion: 2.1 time: 0.171349 Aug 29 11:31:25.501837 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3190/6417] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:25 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:26.522412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:26.523039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:26.531178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:26.531694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:26.532178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:26.532915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:26.533397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:26.533892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:26.676983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:26.685855 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07de4e5e-9aa8-4f59-a0f1-db61e0ecc157 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1453 microversion: 2.1 time: 0.167218 Aug 29 11:31:26.686463 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3228/6418] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:26 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:26.707792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:31:26.708414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:31:26.717303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:26.717817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:26.718252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:26.718952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:26.719409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:26.719860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:26.862682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:31:26.872353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c322090f-19b6-414c-b1ed-9d07f323965f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1453 microversion: 2.1 time: 0.168462 Aug 29 11:31:26.872937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3191/6419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:31:26 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:31:28.562810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86305c53-3aad-49f3-9c59-a5648e553cf9", "tag": "f6c0cbee-a640-4c47-9f30-000519623417"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:31:28.568378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:31:28.574824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:31:28.575418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:31:28.575946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:31:28.580638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:31:28.590253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] Creating event network-changed:f6c0cbee-a640-4c47-9f30-000519623417 for instance 86305c53-3aad-49f3-9c59-a5648e553cf9 on n-h2-854121-10 Aug 29 11:31:28.597172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ad65655c-b650-4673-b48b-23d2ea33c1c5 req-3c1828df-cd8d-41e7-bdbf-e5fd15e9d31d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038104 Aug 29 11:31:28.597918 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3229/6420] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:33:08.340870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=34 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:33:08.341636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=82 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:33:08.342793 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:33:08.342942 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:33:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 29 11:33:08.347658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1864541281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2021143868", "security_groups": [{"name": "tempest-secgroup-smoke-1214146659"}], "block_device_mapping_v2": [{"uuid": "7fa38540-b2cd-4d8b-a005-9cd1a0a4a220", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96714ce3-3311-4a14-b858-024998644fb4"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:33:08.683424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] validate_networks() for [('96714ce3-3311-4a14-b858-024998644fb4', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:33:09.099240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:33:09.099666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:33:09.100168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:33:09.100600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:33:09.101011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:33:09.112937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:09.113424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:09.113904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:09.114641 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:09.115099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:09.115531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:09.136182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:33:09.141765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Getting quotas for user 97080da718e941a3a683a0942929b6b8 and project 4d698c5ab58f40f2979b660454ea6dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:33:09.204450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:33:09.206694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fa38540-b2cd-4d8b-a005-9cd1a0a4a220',volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:33:09.352186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be040d01-1549-474b-9ba4-0250315c3efe tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013263 Aug 29 11:33:09.352805 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3192/6421] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:33:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:33:09.369781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4636f965-9589-4734-927c-0c7cd493d67a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:09.370910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4636f965-9589-4734-927c-0c7cd493d67a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:09.575599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4636f965-9589-4734-927c-0c7cd493d67a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:09.582963 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4636f965-9589-4734-927c-0c7cd493d67a tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1095 microversion: 2.1 time: 0.222611 Aug 29 11:33:09.583633 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3230/6422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:09 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1095 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:10.605904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:10.606976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:10.615992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:10.616491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:10.616932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:10.617841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:10.618309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:10.618734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:10.698415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:10.708026 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-954bac4f-e95f-474b-a322-fe10e2480ce7 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1211 microversion: 2.1 time: 0.106653 Aug 29 11:33:10.708610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3193/6423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:10 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:11.734945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:11.735684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:11.747368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:11.747884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:11.748347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:11.749083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:11.749562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:11.750048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:12.232277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64527cac-616a-4a6a-bdfd-d605423d64e6", "tag": "5c7dcde6-a5c3-4755-a92c-b5401652f3a0"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:33:12.242637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:12.243395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:12.243844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:12.259101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] Creating event network-changed:5c7dcde6-a5c3-4755-a92c-b5401652f3a0 for instance 64527cac-616a-4a6a-bdfd-d605423d64e6 on n-h1-854121-10 Aug 29 11:33:12.265260 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8e4ea4fe-c650-4ef5-80de-d5de4663ae56 req-3641a31a-827d-4f16-9d27-da317b4c8f78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104722 Aug 29 11:33:12.266080 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3194/6424] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:33:12.360270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:12.371974 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73d867c4-ec2d-48f2-a805-c24331971d10 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1279 microversion: 2.1 time: 0.641741 Aug 29 11:33:12.372588 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3231/6425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:11 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1279 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:13.394855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:13.395471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:13.403019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:13.403746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:13.404167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:13.405111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:13.405691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:13.406338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:13.554276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:13.565534 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be807c13-15ce-4580-be16-dcb482f89500 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1279 microversion: 2.1 time: 0.175638 Aug 29 11:33:13.566836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3195/6426] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:13 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:14.600577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:14.601223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:14.611171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:14.611700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:14.612175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:14.612926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:14.613402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:14.614173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:14.765466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:14.773516 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e168801-944d-469a-bf32-b8669f6309bc tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1279 microversion: 2.1 time: 0.185996 Aug 29 11:33:14.774123 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3232/6427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:14 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:15.796608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:15.797284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:15.805602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:15.806226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:15.807399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:15.808193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:15.808733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:15.809228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:15.949805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:15.958113 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd8a48c4-bac3-4fb4-abd7-768963128deb tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.165959 Aug 29 11:33:15.958710 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3196/6428] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:15 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:16.982012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:16.982646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:16.989377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:16.989922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:16.990380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:16.991097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:16.991571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:16.992015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:17.124980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:17.132876 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7afcde7a-d84c-42e2-bb7c-fa0c271883e6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.156130 Aug 29 11:33:17.133448 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3233/6429] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:16 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:18.155598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:18.156213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:18.163035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:18.163518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:18.163957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:18.164649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:18.165104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:18.165529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:18.315163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:18.324429 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be09a618-25e6-4b3d-841f-a6e2ea11d22e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.172681 Aug 29 11:33:18.325098 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3197/6430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:18 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:19.347563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:19.348203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:19.356632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:19.357137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:19.357595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:19.358342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:19.358819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:19.359263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:19.492472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:19.501385 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30677065-f168-4127-ae21-69245e9459e9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.158452 Aug 29 11:33:19.501979 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3234/6431] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:19 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:20.522807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:20.523699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:20.526891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:33:20.527587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:33:20.534902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:20.536025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:20.536025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:20.536189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:20.536617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:20.537051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:20.700963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:20.709310 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-057e9e71-6aff-47b4-8629-c0f9a28dcf85 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.190463 Aug 29 11:33:20.709948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3198/6432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:20 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:21.730098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:21.730741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:21.732703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:33:21.739066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:21.739562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:21.740007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:21.740716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:21.741183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:21.741627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:21.876610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:21.885039 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4fa6015-0838-484a-9b8c-504966ada16c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.158728 Aug 29 11:33:21.885552 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3235/6433] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:21 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:22.906681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:22.907329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:22.914410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:22.914905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:22.915347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:22.916069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:22.916523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:22.916953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:23.056933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:23.065824 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96e21168-458b-4aa1-a566-9322b4f7536b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.162876 Aug 29 11:33:23.066405 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3199/6434] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:22 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:33:24.087471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:24.088108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:24.095669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:24.096177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:24.096641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:24.097357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:24.097872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:24.098324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:24.252159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:24.260805 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6dbeff7c-dca9-4aff-97e1-c5797c488b1b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.177201 Aug 29 11:33:24.262241 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3236/6435] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:24 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:33:25.282585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:25.283194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:25.290137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:25.290615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:25.291050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:25.291737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:25.292685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:25.293240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:25.425830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:25.433645 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3eafa6c0-1cba-4b5d-be96-0f8f9229edd2 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.154960 Aug 29 11:33:25.434313 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3200/6436] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:25 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:26.034097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64527cac-616a-4a6a-bdfd-d605423d64e6", "name": "network-vif-plugged", "status": "completed", "tag": "5c7dcde6-a5c3-4755-a92c-b5401652f3a0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:33:26.044264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:26.044763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:26.045210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:26.059725 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] Creating event network-vif-plugged:5c7dcde6-a5c3-4755-a92c-b5401652f3a0 for instance 64527cac-616a-4a6a-bdfd-d605423d64e6 on n-h1-854121-10 Aug 29 11:33:26.064886 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-46f76ef4-bc61-4cda-a239-a59f6337b347 req-d4f2ab93-77e5-4ae5-be5a-376de4f2e33d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095846 Aug 29 11:33:26.065484 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3237/6437] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:33:26.455390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:26.455993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:26.462922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:26.463406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:26.463875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:26.465196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:26.465663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:26.466120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:26.611543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:26.621397 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2398494a-63b9-4f8e-a233-3d4d9ddcb74b tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1267 microversion: 2.1 time: 0.169488 Aug 29 11:33:26.622224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3201/6438] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:26 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:27.644342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:27.645071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:27.654537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:27.655054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:27.655524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:27.656244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:27.656728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:27.657177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:27.803685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:27.811891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ceea0265-9faa-4b10-bd44-ceb859fc3224 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1453 microversion: 2.1 time: 0.172716 Aug 29 11:33:27.812476 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3238/6439] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:27 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:27.832377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:33:27.832985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:33:27.840717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:27.841205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:27.841648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:27.842417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:27.842876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:27.843304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:27.992194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:33:28.001497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a3afdb7-63fb-4c5b-90a4-e1e060239718 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1453 microversion: 2.1 time: 0.173010 Aug 29 11:33:28.002132 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3202/6440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:33:27 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:33:30.017429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64527cac-616a-4a6a-bdfd-d605423d64e6", "tag": "5c7dcde6-a5c3-4755-a92c-b5401652f3a0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:33:30.028148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:33:30.028652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:33:30.029099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:33:30.040437 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] Creating event network-changed:5c7dcde6-a5c3-4755-a92c-b5401652f3a0 for instance 64527cac-616a-4a6a-bdfd-d605423d64e6 on n-h1-854121-10 Aug 29 11:33:30.046563 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-bb162f0a-9480-445c-abb6-f84bf1704674 req-03509bce-3178-4ea9-9c49-8dce8e4da271 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Aug 29 11:33:30.047215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3239/6441] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:02.536775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:02.537597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:02.541479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:02.541743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=23 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:02.542832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=47 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:02.543003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=58 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:02.543796 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:35:02.544027 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 29 11:35:02.544658 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:35:02.545057 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 (ip 10.222.0.47) !!! Aug 29 11:35:02.546057 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:35:02.546245 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 29 11:35:02.556635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64527cac-616a-4a6a-bdfd-d605423d64e6", "tag": "5c7dcde6-a5c3-4755-a92c-b5401652f3a0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:02.563854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:02.564519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:02.565514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:02.566614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:02.567226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:02.568582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:02.578798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:02.579614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:02.580069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:02.595799 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] Creating event network-changed:5c7dcde6-a5c3-4755-a92c-b5401652f3a0 for instance 64527cac-616a-4a6a-bdfd-d605423d64e6 on n-h1-854121-10 Aug 29 11:35:02.602332 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-25e14cba-b096-4ecb-89a3-e5f165e0a0a1 req-eac03b1b-c31e-4b37-91be-d192220ecc2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064077 Aug 29 11:35:02.603189 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:35:02.603677 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3240/6442] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:02.728356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4473a5b5-bb18-4e91-9950-d2f659f2794e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 204 len: 0 microversion: 2.1 time: 0.195023 Aug 29 11:35:02.730060 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3203/6443] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:35:02 2022] DELETE /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:35:02.740386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:02.741462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:02.755807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:02.756836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:02.757498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:02.758649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:02.760304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:02.761019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:02.942446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:02.953343 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a57f8001-16fe-4548-93ca-b4c84db765d9 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1578 microversion: 2.1 time: 0.218185 Aug 29 11:35:02.953997 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3241/6444] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:02 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:03.989403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:03.990095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:03.997603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:03.998154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:03.998605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:03.999324 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:03.999788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:04.000221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:04.235120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:04.246736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-95a2076b-4bd7-4e8b-9fdf-fa3f2ed2b9f3 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1578 microversion: 2.1 time: 0.261807 Aug 29 11:35:04.254450 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3204/6445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:03 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:04.949514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64527cac-616a-4a6a-bdfd-d605423d64e6", "name": "network-vif-deleted", "tag": "5c7dcde6-a5c3-4755-a92c-b5401652f3a0"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:04.960142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:04.960724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:04.961176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:04.977798 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] Creating event network-vif-deleted:5c7dcde6-a5c3-4755-a92c-b5401652f3a0 for instance 64527cac-616a-4a6a-bdfd-d605423d64e6 on n-h1-854121-10 Aug 29 11:35:04.979708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2a2e16e0-c279-4aa8-bf5e-9a828e450906 req-f72b8a5f-a8c7-492d-b18c-a5b389bd8d5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094261 Aug 29 11:35:04.981267 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3242/6446] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:05.270789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:05.272002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:05.280681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:05.281330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:05.282106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:05.283137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:05.283714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:05.284317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:05.364268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:05.374564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4bf0bb01-e8e2-49e3-8918-d1be2cc94351 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1226 microversion: 2.1 time: 0.107979 Aug 29 11:35:05.375293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3205/6447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:05 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:06.397651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:06.398551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:06.405639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:06.406194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:06.406651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:06.407396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:06.407871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:06.408327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:06.481794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:06.492696 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3552f39a-a9e9-464d-bac4-3f15bd4b1744 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1226 microversion: 2.1 time: 0.100269 Aug 29 11:35:06.493332 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3243/6448] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:06 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:07.517356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:07.518454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:07.531978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:07.532883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:07.533682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:07.535006 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:07.535847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:07.536626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:07.632009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:07.641148 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f59aa332-08c1-4d23-9ebc-6a2d60cf6e82 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1226 microversion: 2.1 time: 0.128187 Aug 29 11:35:07.641803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3206/6449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:07 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:08.664657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:08.666404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:08.674058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:08.674590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:08.675030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:08.675774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:08.676322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:08.677042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:08.761612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:08.770056 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-86c66d74-c838-48f8-8783-93c321ccd938 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1226 microversion: 2.1 time: 0.109239 Aug 29 11:35:08.770646 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3244/6450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:08 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:09.791848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:09.792461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:09.801801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:09.802292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:09.802731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:09.803437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:09.803897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:09.804315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:09.839507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:09.839999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:09.840439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:09.840892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid 64527cac-616a-4a6a-bdfd-d605423d64e6 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:35:09.902610 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:09.913039 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd9a20e3-4321-4e89-8c49-2eda08fe9cac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 200 len: 1185 microversion: 2.1 time: 0.125216 Aug 29 11:35:09.913688 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3207/6451] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:09 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 1185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:10.944622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:10.945507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 64527cac-616a-4a6a-bdfd-d605423d64e6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:10.953435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:10.953982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:10.954435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:10.955343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:10.955725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:10.956071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:10.973137 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 HTTP/1.1 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '64527cac-616a-4a6a-bdfd-d605423d64e6'} Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:10.974913 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 64527cac-616a-4a6a-bdfd-d605423d64e6 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a5d6b6c0-45bb-4e7c-b637-358aa9413859 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6" status: 404 len: 111 microversion: 2.1 time: 0.035703 Aug 29 11:35:10.978896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3245/6452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:10 2022] GET /compute/v2.1/servers/64527cac-616a-4a6a-bdfd-d605423d64e6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:35:17.356766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:17.357278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:17.363409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86305c53-3aad-49f3-9c59-a5648e553cf9", "tag": "f6c0cbee-a640-4c47-9f30-000519623417"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:17.364817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:17.365407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:17.365944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:17.366715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:17.367518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:17.368058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:17.382435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:17.384402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:17.385256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:17.395939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:35:17.408724 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] Creating event network-changed:f6c0cbee-a640-4c47-9f30-000519623417 for instance 86305c53-3aad-49f3-9c59-a5648e553cf9 on n-h2-854121-10 Aug 29 11:35:17.418999 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ab4d8206-db81-49c3-b9e7-821f6915f865 req-92f6ddbd-1a57-4c41-a69e-e5fb40a613e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062423 Aug 29 11:35:17.420311 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3246/6453] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:17.516362 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-464fed0d-dd87-45ed-9e3e-2a202f96ec29 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 204 len: 0 microversion: 2.1 time: 0.162768 Aug 29 11:35:17.521806 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3208/6454] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:35:17 2022] DELETE /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:35:17.541312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:17.542706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:17.553875 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:17.554975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:17.556327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:17.557870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:17.558755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:17.559601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:17.726110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:17.735107 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c848d7ab-a0f9-48d3-95c3-c7382db16aa6 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1577 microversion: 2.1 time: 0.207338 Aug 29 11:35:17.735816 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3247/6455] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:17 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:18.757254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:18.758111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:18.766836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:18.767394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:18.767873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:18.768651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:18.769107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:18.769537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:18.927744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:18.937474 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d875b41f-3541-4b31-8b51-d1f4f1cf0620 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1577 microversion: 2.1 time: 0.184490 Aug 29 11:35:18.938207 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3209/6456] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:18 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:35:19.642001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86305c53-3aad-49f3-9c59-a5648e553cf9", "name": "network-vif-deleted", "tag": "f6c0cbee-a640-4c47-9f30-000519623417"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:19.652796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:19.653286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:19.653770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:19.666904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] Creating event network-vif-deleted:f6c0cbee-a640-4c47-9f30-000519623417 for instance 86305c53-3aad-49f3-9c59-a5648e553cf9 on n-h2-854121-10 Aug 29 11:35:19.672908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e02823ec-34cd-43e2-9660-9aa3fdb2f660 req-9d1e6cc9-5268-49d2-a7a8-820ae746a14a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Aug 29 11:35:19.673538 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3248/6457] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:19.960443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:19.961056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:19.969065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:19.969566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:19.970017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:19.970884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:19.971171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:19.971595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:20.064897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:20.074633 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89090d5a-e4e6-45bc-8d10-1de28967dd18 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1226 microversion: 2.1 time: 0.118132 Aug 29 11:35:20.075546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3210/6458] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:19 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:35:21.100652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:21.102025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:21.109774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:21.110297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:21.110759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:21.111533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:21.112010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:21.112484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:21.188320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:21.202253 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c75f3a77-b690-4293-a44e-e1cda597c876 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1226 microversion: 2.1 time: 0.108567 Aug 29 11:35:21.203309 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3249/6459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:21 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:22.227493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:22.228603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:22.236418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:22.236921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:22.237368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:22.238137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:22.238687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:22.239058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:22.313945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:22.330173 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a6378120-2f6c-4434-872e-84d6ebb4f4ac tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1226 microversion: 2.1 time: 0.107260 Aug 29 11:35:22.332023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3211/6460] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:22 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:23.356488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:23.357370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:23.364576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:23.365085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:23.365578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:23.366349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:23.366833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:23.367283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:23.442305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:23.460613 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-68a1dfbd-5514-4d4f-9413-b55278f7833f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1226 microversion: 2.1 time: 0.108968 Aug 29 11:35:23.469801 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3250/6461] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:23 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:24.486527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:24.489043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:24.497843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:24.498333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:24.498813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:24.499536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:24.500005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:24.500440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:24.551050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:24.551716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:24.552359 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:24.553429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lazy-loading 'fault' on Instance uuid 86305c53-3aad-49f3-9c59-a5648e553cf9 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:35:24.608396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97080da718e941a3a683a0942929b6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d698c5ab58f40f2979b660454ea6dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:24.620241 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7db3bbcb-cd47-41db-9991-7352b852337f tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 200 len: 1185 microversion: 2.1 time: 0.140966 Aug 29 11:35:24.620866 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3212/6462] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:24 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 1185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:25.642690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:25.643589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 86305c53-3aad-49f3-9c59-a5648e553cf9] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:25.650710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:25.651214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:25.651672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:25.652389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:25.652859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:25.653304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:25.667869 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 HTTP/1.1 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '86305c53-3aad-49f3-9c59-a5648e553cf9'} Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:25.669590 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 86305c53-3aad-49f3-9c59-a5648e553cf9 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be60c187-41a2-4da4-923a-df43e32ed6d0 tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9" status: 404 len: 111 microversion: 2.1 time: 0.032666 Aug 29 11:35:25.673040 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3251/6463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:25 2022] GET /compute/v2.1/servers/86305c53-3aad-49f3-9c59-a5648e553cf9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:35:26.155500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:26.156038 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:26.163305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:26.163792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:26.164228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:26.165512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:26.165993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:26.166418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:26.181662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 HTTP/1.1 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '84c5d0c8-4aa1-4fcf-8195-64d6edb3a939'} Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:35:26.183372 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0a6f705-217c-4541-ad55-76bb4d1bd1ea tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 404 len: 111 microversion: 2.1 time: 0.033395 Aug 29 11:35:26.187170 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3213/6464] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:35:26 2022] DELETE /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:35:26.195104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:26.195779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] [instance: 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:26.202334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:26.202840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:26.203303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:26.204032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:26.204512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:26.204964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:26.219374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] HTTP exception thrown: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Request method failure captured: Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 HTTP/1.1 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKH0_aQ4f9e_XSY9lr2jajLvgKUgU1km28_nfNjmDJQi49B1qJ5UiJDyGO2GnXjex9_Rod1A9vCVZZQdXFM5wD5zYdAZCLuudSCVwQrco1bFllogQy86GdUeBA4kWbE6y-h5Rr5DoA4nB8bUEdqEBvJJFHenm45vkcbh7z0gKafUSDk Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4d698c5ab58f40f2979b660454ea6dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 4d698c5ab58f40f2979b660454ea6dfc Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestVolumeBootPattern-329443180 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 97080da718e941a3a683a0942929b6b8 Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestVolumeBootPattern-329443180-project Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '84c5d0c8-4aa1-4fcf-8195-64d6edb3a939'} Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:35:26.220954 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Returning 404 to user: Instance 84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-147979bb-8bdb-428d-9221-d2d0c1d7ce2c tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939" status: 404 len: 111 microversion: 2.1 time: 0.031409 Aug 29 11:35:26.225075 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3252/6465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:26 2022] GET /compute/v2.1/servers/84c5d0c8-4aa1-4fcf-8195-64d6edb3a939 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:35:29.681656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f3b514df-e2c2-468a-b574-faad67b3038e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] Calling method '.version_select at 0x7f66c5ca04c0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:29.709932 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f3b514df-e2c2-468a-b574-faad67b3038e tempest-TestVolumeBootPattern-329443180 tempest-TestVolumeBootPattern-329443180-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2021143868" status: 202 len: 0 microversion: 2.1 time: 0.032303 Aug 29 11:35:29.710829 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3214/6466] 10.222.0.47 () {58 vars in 1263 bytes} [Mon Aug 29 11:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2021143868 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:35:49.075500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=26 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:49.076363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=50 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:49.197164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-354456695", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:49.254982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] validate_networks() for None {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:35:49.463775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:35:49.464473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:35:49.465109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:35:49.465689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:35:49.466148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:35:49.478721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:49.479224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:49.479680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:49.480424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:49.481191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:49.481636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:49.502055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Getting quotas for project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:35:49.507554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Getting quotas for user caf96cb00477454c9d784f78f41fe035 and project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:35:49.521191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:35:49.524421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:35:49.579450 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c4a90ff5-e7da-4617-aac5-ddecd2f69f09 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509322 Aug 29 11:35:49.580159 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3253/6467] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:35:49.593319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:49.595229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:35:49.600046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e401d3b1-10bf-434f-abca-71fe0b7f2e5f tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:49.602117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e401d3b1-10bf-434f-abca-71fe0b7f2e5f tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:49.668963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e401d3b1-10bf-434f-abca-71fe0b7f2e5f tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:49.679341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e401d3b1-10bf-434f-abca-71fe0b7f2e5f tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1221 microversion: 2.1 time: 0.087677 Aug 29 11:35:49.679960 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3215/6468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:49 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:50.702100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:50.703445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:50.714751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:50.715279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:50.715818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:50.716598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:50.717161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:50.717908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:50.801782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:50.810539 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-93017204-b0df-4a4d-a2be-c8131148cb0c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1291 microversion: 2.1 time: 0.113704 Aug 29 11:35:50.811149 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3254/6469] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:50 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:51.832756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:51.834001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:51.841922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:51.842416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:51.842925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:51.843561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:51.844015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:51.844442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:52.448361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:52.456680 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7a7a461-aae6-4232-a40d-e99c1d466962 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.627898 Aug 29 11:35:52.466972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3216/6470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:51 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:52.588967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7102feb-fd62-46ff-9a94-663dc472417d", "tag": "22b7a333-8a5e-4e42-8770-0f19b220a671"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:52.600471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:52.600967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:52.602009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:52.614387 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] Creating event network-changed:22b7a333-8a5e-4e42-8770-0f19b220a671 for instance f7102feb-fd62-46ff-9a94-663dc472417d on n-h2-854121-10 Aug 29 11:35:52.621456 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2040d591-8f89-4b8a-8c69-6d0451cf9a52 req-21ab3646-726f-4e09-9de1-ef97bd0f5bb0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036907 Aug 29 11:35:52.622354 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3255/6471] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:35:53.479014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:53.479668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:53.486795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:53.487292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:53.487732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:53.488445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:53.488906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:53.489337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:53.643456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:53.651637 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f44e998-b1cc-4f19-8bd5-144f567e7258 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.177217 Aug 29 11:35:53.652235 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3217/6472] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:53 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:54.673520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:54.674279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:54.680659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:54.681170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:54.681634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:54.682380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:54.682861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:54.683311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:54.821577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:54.829984 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a3bcf8c1-2d04-420b-abc3-5ab496c1a490 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.161519 Aug 29 11:35:54.830584 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3256/6473] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:54 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:55.851546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:55.852344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:55.859451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:55.859950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:55.860401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:55.861110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:55.861575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:55.862059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:56.001506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:56.010293 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-057038a8-2a63-483f-ad70-e7fc6778b266 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.162610 Aug 29 11:35:56.012292 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3218/6474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:55 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:57.031480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:57.032234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:57.041292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:57.042138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:57.042616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:57.043377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:57.043866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:57.044334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:57.212257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:57.221608 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2dd9c30b-083c-4e83-8e6e-c7f6e76b2356 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.193927 Aug 29 11:35:57.222592 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3257/6475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:57 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:58.245122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:58.245758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:58.253163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:58.253654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:58.254123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:58.254832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:58.255286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:58.255718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:58.400731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:58.408530 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf55be09-0c22-4178-9328-89ba7c27f52a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.167988 Aug 29 11:35:58.409111 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3219/6476] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:58 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:35:58.685621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7102feb-fd62-46ff-9a94-663dc472417d", "name": "network-vif-plugged", "status": "completed", "tag": "22b7a333-8a5e-4e42-8770-0f19b220a671"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:35:58.696747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:58.697258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:58.697777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:58.710070 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] Creating event network-vif-plugged:22b7a333-8a5e-4e42-8770-0f19b220a671 for instance f7102feb-fd62-46ff-9a94-663dc472417d on n-h2-854121-10 Aug 29 11:35:58.715292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-479ed2a4-0d33-4458-a8b0-fcb678332be6 req-3356260d-0d1d-4976-99a8-6f9c4ed70817 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 Aug 29 11:35:58.716180 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3258/6477] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:35:59.429273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:35:59.430129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:35:59.437387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:59.437840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:59.438321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:59.439037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:35:59.439501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:35:59.439935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:35:59.576002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:35:59.584172 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6dcbaa29-bf95-44c1-aa54-87b7f75d7c3e tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1321 microversion: 2.1 time: 0.158758 Aug 29 11:35:59.584757 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3220/6478] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:35:59 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:00.602279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:00.602981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:00.608252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:00.608979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:00.616172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:00.616675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:00.617679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:00.618534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:00.619012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:00.619465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:00.760708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:00.768949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67c27395-d51c-4e94-b65b-c326eb5eff7c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1470 microversion: 2.1 time: 0.167986 Aug 29 11:36:00.769531 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3259/6479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:00 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:00.793436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:00.845756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d3aae1b0-f229-4f6b-acb7-f4459a303083 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '.version_select at 0x7f66c5c93550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:00.911108 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d3aae1b0-f229-4f6b-acb7-f4459a303083 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/779016dbd934463693ba53338415b5f4" status: 200 len: 371 microversion: 2.1 time: 0.123238 Aug 29 11:36:00.911683 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3221/6480] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 11:36:00 2022] GET /compute/v2.1/os-quota-sets/779016dbd934463693ba53338415b5f4 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:00.923488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-206335e3-72b4-434d-8fe2-69f4f8b592e4 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-507217172", "id": 479687297, "os-flavor-access:is_public": "True"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:00.942705 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-206335e3-72b4-434d-8fe2-69f4f8b592e4 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022868 Aug 29 11:36:00.943302 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3260/6481] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:36:00 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:00.955974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "479687297"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:00.958341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:00.965175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:00.965661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:00.966132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:00.966835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:00.967288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:00.967712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.208924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4da02f2e4c0e4def804b686cf4118e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779016dbd934463693ba53338415b5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:01.215698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-507217172 {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:36:01.222847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.223334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.223774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.224506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.224960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.225387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.250411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Getting quotas for project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:36:01.255381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Getting quotas for user caf96cb00477454c9d784f78f41fe035 and project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:36:01.268671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.api [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] ram quota exceeded for 779016dbd934463693ba53338415b5f4, tried to resize instance. Aug 29 11:36:01.269213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Request method failure captured: Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action HTTP/1.1 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 38 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKSU6H5XNSkNsVdvZhDA5juhMFQdzuuA6YwJDXCUod9FTn-wrH_rpwBzC9fjjr8T6j7amcfFGClVOYdBs-HkPheKp6KzymX_POUDfUZDPapAh8y2QrrbWOUjLiXQeItxnRaoLCtYWz-l7dPFt0B64L8c6v1YSr8LmTakLJMsb1lAYXI Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 779016dbd934463693ba53338415b5f4 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Role: member,reader,admin Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: member,reader,admin Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/779016dbd934463693ba53338415b5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_779016dbd934463693ba53338415b5f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/779016dbd934463693ba53338415b5f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/779016dbd934463693ba53338415b5f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 779016dbd934463693ba53338415b5f4 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersAdminNegativeTestJSON-1715959445-project-admin Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 4da02f2e4c0e4def804b686cf4118e3f Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1715959445-project-admin Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: {"resize": {"flavorRef": "479687297"}} Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'f7102feb-fd62-46ff-9a94-663dc472417d', 'body': {'resize': {'flavorRef': '479687297'}}} Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.271216 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b630200f-f63a-4e0b-8b00-31c8304c5a0b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action" status: 403 len: 118 microversion: 2.1 time: 0.320885 Aug 29 11:36:01.275186 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3222/6482] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:36:00 2022] POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action => generated 118 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:36:01.282218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-33dff7ef-5fb6-4d80-b683-73922c527908 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.299573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-33dff7ef-5fb6-4d80-b683-73922c527908 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/479687297" status: 202 len: 0 microversion: 2.1 time: 0.021245 Aug 29 11:36:01.300306 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3261/6483] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 11:36:01 2022] DELETE /compute/v2.1/flavors/479687297 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:36:01.309519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-676d6143-1a0e-4191-8088-2b49e9e6cb7c tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.334618 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-676d6143-1a0e-4191-8088-2b49e9e6cb7c tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029891 Aug 29 11:36:01.335194 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3223/6484] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 11:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:01.354573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-55459c23-0e62-4e51-891a-b41aee79234b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '.version_select at 0x7f66c5b47430>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.423512 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-55459c23-0e62-4e51-891a-b41aee79234b tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/779016dbd934463693ba53338415b5f4" status: 200 len: 371 microversion: 2.1 time: 0.072689 Aug 29 11:36:01.424391 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3262/6485] 10.222.0.47 () {58 vars in 1242 bytes} [Mon Aug 29 11:36:01 2022] GET /compute/v2.1/os-quota-sets/779016dbd934463693ba53338415b5f4 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:01.436498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-974d0033-b32e-478a-9f9d-eddc06d16910 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-422646853", "id": 108745730, "os-flavor-access:is_public": "True"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:01.454469 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-974d0033-b32e-478a-9f9d-eddc06d16910 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021594 Aug 29 11:36:01.455067 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3224/6486] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:36:01 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:01.467091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "108745730"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:01.469517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:01.475789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.476817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.477283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.478047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.478527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.478979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.645541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4da02f2e4c0e4def804b686cf4118e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779016dbd934463693ba53338415b5f4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:01.653036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-422646853 {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:36:01.659888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.660394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.660862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.661614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.662129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.662579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.685217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Getting quotas for project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:36:01.690363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Getting quotas for user caf96cb00477454c9d784f78f41fe035 and project 120e8c82b6f04d5abf33eb66f3abf09e. Resources: {'ram', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:36:01.704733 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] cores quota exceeded for 779016dbd934463693ba53338415b5f4, tried to resize instance. Aug 29 11:36:01.705294 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Request method failure captured: Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action HTTP/1.1 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 38 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKSU6H5XNSkNsVdvZhDA5juhMFQdzuuA6YwJDXCUod9FTn-wrH_rpwBzC9fjjr8T6j7amcfFGClVOYdBs-HkPheKp6KzymX_POUDfUZDPapAh8y2QrrbWOUjLiXQeItxnRaoLCtYWz-l7dPFt0B64L8c6v1YSr8LmTakLJMsb1lAYXI Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 779016dbd934463693ba53338415b5f4 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Role: member,reader,admin Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: member,reader,admin Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/779016dbd934463693ba53338415b5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_779016dbd934463693ba53338415b5f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/779016dbd934463693ba53338415b5f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/779016dbd934463693ba53338415b5f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 779016dbd934463693ba53338415b5f4 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1715959445 Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdminNegativeTestJSON-1715959445-project-admin Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 4da02f2e4c0e4def804b686cf4118e3f Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1715959445-project-admin Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: {"resize": {"flavorRef": "108745730"}} Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f7102feb-fd62-46ff-9a94-663dc472417d', 'body': {'resize': {'flavorRef': '108745730'}}} Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.707450 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8c9d1cc1-b1ca-4e6f-b4ea-f34256a7e361 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action" status: 403 len: 113 microversion: 2.1 time: 0.245788 Aug 29 11:36:01.712009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3263/6487] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:36:01 2022] POST /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d/action => generated 113 bytes in 247 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:36:01.718156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c5a9a8b-5197-4da2-8470-0135c68a86b7 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.739485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c5a9a8b-5197-4da2-8470-0135c68a86b7 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/108745730" status: 202 len: 0 microversion: 2.1 time: 0.021595 Aug 29 11:36:01.740093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3225/6488] 10.222.0.47 () {58 vars in 1158 bytes} [Mon Aug 29 11:36:01 2022] DELETE /compute/v2.1/flavors/108745730 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:36:01.749863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc7c0a76-7c7d-4c48-ac38-472e17ffd2b6 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.769891 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc7c0a76-7c7d-4c48-ac38-472e17ffd2b6 tempest-ServersAdminNegativeTestJSON-1715959445 tempest-ServersAdminNegativeTestJSON-1715959445-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023734 Aug 29 11:36:01.770468 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3264/6489] 10.222.0.47 () {58 vars in 1146 bytes} [Mon Aug 29 11:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:01.791278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.791815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:01.798356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.798987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.799269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.799963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.800419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.800844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.828866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:36:01.907865 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-99eaa06a-4bb7-484c-9e5c-d6a7919d948c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 204 len: 0 microversion: 2.1 time: 0.121019 Aug 29 11:36:01.908574 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3226/6490] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:36:01 2022] DELETE /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:36:01.917661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:01.918318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:01.924381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.924878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.925326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:01.926087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:01.926557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:01.926996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:02.066941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:02.075678 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dde9a35-f14d-4c13-9980-b4923d78fb0a tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1476 microversion: 2.1 time: 0.162672 Aug 29 11:36:02.076261 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3265/6491] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:01 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:03.097144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:03.097920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:03.105465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:03.105980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:03.106421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:03.107122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:03.107575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:03.107999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:03.257306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:03.265842 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e58c86a-c35f-4aa8-a496-c6d6c7e45b4c tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1476 microversion: 2.1 time: 0.172949 Aug 29 11:36:03.266431 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3227/6492] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:03 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1476 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:03.807548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7102feb-fd62-46ff-9a94-663dc472417d", "name": "network-vif-deleted", "tag": "22b7a333-8a5e-4e42-8770-0f19b220a671"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:03.831340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:03.831964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:03.832588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:03.845951 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] Creating event network-vif-deleted:22b7a333-8a5e-4e42-8770-0f19b220a671 for instance f7102feb-fd62-46ff-9a94-663dc472417d on n-h2-854121-10 Aug 29 11:36:03.851665 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-96cc0f25-2c84-48ca-801d-980284c27542 req-9173bddd-f9e8-411c-b336-8dd675002f56 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048113 Aug 29 11:36:03.852384 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3266/6493] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:04.291936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:04.293144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:04.301117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:04.301609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:04.302163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:04.303017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:04.303586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:04.304032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:04.338767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:04.339407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:04.339755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:04.340305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lazy-loading 'fault' on Instance uuid f7102feb-fd62-46ff-9a94-663dc472417d {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:36:04.384148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf96cb00477454c9d784f78f41fe035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120e8c82b6f04d5abf33eb66f3abf09e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:04.391697 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0945b024-fd1d-4f56-881d-2dc3a7d8ed38 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 200 len: 1311 microversion: 2.1 time: 0.105271 Aug 29 11:36:04.392270 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3228/6494] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:04 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:05.414650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:05.415465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] [instance: f7102feb-fd62-46ff-9a94-663dc472417d] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:05.422544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:05.423030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:05.423485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:05.424205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:05.424677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:05.425122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:05.439142 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] HTTP exception thrown: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Request method failure captured: Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d HTTP/1.1 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKSUnYXPZP3kZUXBevbkwKhsQeLWb7xLXZzeURf5SfHtl357KK_vJEHgYffJm7dPkFY8VExhGGkySn1Car1CQqihiK4HtUu9DaoVoYMTyNdaPeDcEFyvE49RnLUKL4YbrDUKEfkq42lhEUxbNy0P4LGIzvODQ48EurJer6wtVz_5SEA Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 120e8c82b6f04d5abf33eb66f3abf09e Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-559338443 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/120e8c82b6f04d5abf33eb66f3abf09e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_120e8c82b6f04d5abf33eb66f3abf09e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/120e8c82b6f04d5abf33eb66f3abf09e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/120e8c82b6f04d5abf33eb66f3abf09e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersAdminNegativeTestJSON-559338443 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 120e8c82b6f04d5abf33eb66f3abf09e Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-559338443 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersAdminNegativeTestJSON-559338443-project Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: caf96cb00477454c9d784f78f41fe035 Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersAdminNegativeTestJSON-559338443-project Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f7102feb-fd62-46ff-9a94-663dc472417d'} Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:05.440881 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] Returning 404 to user: Instance f7102feb-fd62-46ff-9a94-663dc472417d could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07c069ba-b863-4730-a14c-55cd60d2e7e4 tempest-ServersAdminNegativeTestJSON-559338443 tempest-ServersAdminNegativeTestJSON-559338443-project] 10.222.0.47 "GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d" status: 404 len: 111 microversion: 2.1 time: 0.033567 Aug 29 11:36:05.445555 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3267/6495] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:05 2022] GET /compute/v2.1/servers/f7102feb-fd62-46ff-9a94-663dc472417d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:36:11.924908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:11.928300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:12.079159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-447619331", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "c4a7a8cc-125a-424a-b136-6c5f3fe0e035"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:12.139209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] validate_networks() for [('c4a7a8cc-125a-424a-b136-6c5f3fe0e035', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:36:12.596092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:36:12.596526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:36:12.597041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:36:12.597465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:36:12.597928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:36:12.609175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:12.609673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:12.610182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:12.610984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:12.611449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:12.611884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:12.632056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Getting quotas for project c7ac030657db4cc5bf605ca89d0c1882. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:36:12.638289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Getting quotas for user e8166d5a4d754206949dc2f430fca241 and project c7ac030657db4cc5bf605ca89d0c1882. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:36:12.655410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:36:12.657924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:36:12.712777 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [fbb0b732-432d-45e9-941a-43e94fa7cb1b] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:36:13.721787 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [fbb0b732-432d-45e9-941a-43e94fa7cb1b] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 37550. Aug 29 11:36:13.726817 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d57d06a5-684b-4d70-b963-7de1090b6938 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807665 Aug 29 11:36:13.733259 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3229/6496] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:36:13.740720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2bd054b2-794a-4fa2-a563-3cf311accd4f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:13.742584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2bd054b2-794a-4fa2-a563-3cf311accd4f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:13.745752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:13.746465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:13.812035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2bd054b2-794a-4fa2-a563-3cf311accd4f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:13.824423 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2bd054b2-794a-4fa2-a563-3cf311accd4f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1214 microversion: 2.1 time: 0.087907 Aug 29 11:36:13.825169 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3268/6497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:13 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:14.849173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:14.849810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:14.856144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:14.856628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:14.857061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:14.857791 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:14.858243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:14.858662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:14.927836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:14.937453 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2c86ad0b-dc92-4977-bda6-c3cb71729323 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1266 microversion: 2.1 time: 0.093426 Aug 29 11:36:14.938459 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3230/6498] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:14 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:15.960968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:15.962636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:15.965331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=53 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:15.970661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:15.971331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:15.971796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:15.972531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:15.972998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:15.973596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:16.219255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:16.227249 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef622ddb-1309-4d25-8f38-070d176cc61f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1314 microversion: 2.1 time: 0.272218 Aug 29 11:36:16.227855 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3269/6499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:15 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:16.533525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:16.551112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:16.551597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:16.552057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:16.571445 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] Creating event network-changed:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h2-854121-10 Aug 29 11:36:16.578081 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ccb6ad4a-58d8-4dc1-aa54-9973360756e2 req-cf04ff8d-22d4-44e4-8c7f-6d70884f044e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048148 Aug 29 11:36:16.579387 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3231/6500] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:17.248758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:17.249290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:17.256528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:17.257625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:17.258099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:17.258811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:17.259280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:17.259719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:17.404868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:17.412894 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72773e21-b668-4431-9d48-7c3d53c788b9 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1314 microversion: 2.1 time: 0.168123 Aug 29 11:36:17.413882 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3270/6501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:17 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:18.435216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:18.435907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:18.443010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:18.443492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:18.443926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:18.444684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:18.445143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:18.446144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:18.592974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:18.602343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-85f834e5-d598-4beb-a362-ab74da4e50a4 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1314 microversion: 2.1 time: 0.170962 Aug 29 11:36:18.602955 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3232/6502] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:18 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:19.623824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:19.625088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:19.627933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:19.633911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:19.634457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:19.634862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:19.635619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:19.636045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:19.636486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:19.774913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:19.782918 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-135d94cb-ce12-443e-867a-49907ae5ab0f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1314 microversion: 2.1 time: 0.163138 Aug 29 11:36:19.783496 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3271/6503] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:19 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:20.799223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "name": "network-vif-plugged", "status": "completed", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:20.804482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:20.805390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:20.807721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:20.812139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:20.812622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:20.813080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:20.816713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:20.817298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:20.817460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:20.818042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:20.819094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:20.820822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:20.821833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:20.829179 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] Creating event network-vif-plugged:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h2-854121-10 Aug 29 11:36:20.836191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2d2e0f2d-bc48-41d7-9de9-4cffa17c905e req-e716e717-7f91-442b-a4a1-91512612420b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040409 Aug 29 11:36:20.838262 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3233/6504] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:21.019307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:21.028552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c689639-40e3-4cca-bcdc-08a5bd55f4ea tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1314 microversion: 2.1 time: 0.229350 Aug 29 11:36:21.029127 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3272/6505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:20 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:22.051312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:22.052013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:22.060147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.060639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.061087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.061823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.062288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.062722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.208890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:22.216931 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-796cac80-56e1-4641-88aa-d53a1c35956c tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1501 microversion: 2.1 time: 0.171505 Aug 29 11:36:22.217520 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3234/6506] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:22 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:22.237119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:22.239507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:22.247021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.247535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.247994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.248722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.249261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.249739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.279489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:22.286093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:36:22.293143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:36:22.293578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:36:22.294107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:36:22.294532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:36:22.294958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:36:22.359211 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbef643a-53d1-4586-be91-7da2fe0803c7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "POST /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd/action" status: 202 len: 0 microversion: 2.1 time: 0.125993 Aug 29 11:36:22.360136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3273/6507] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:36:22 2022] POST /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:36:22.368536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:22.369162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:22.375185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.375689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.376118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.376842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:22.377299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:22.377754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:22.516864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:22.525993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0a2e714f-18db-4e0a-bb86-4c21ecc1f214 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1510 microversion: 2.1 time: 0.161847 Aug 29 11:36:22.526604 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3235/6508] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:22 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:23.548280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:23.548947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:23.557429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:23.557951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:23.558420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:23.559146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:23.559734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:23.560136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:23.689922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:23.699601 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9da762f1-02f2-444d-95ba-0623b1747f3f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1510 microversion: 2.1 time: 0.155834 Aug 29 11:36:23.700446 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3274/6509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:23 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:24.720502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:24.721108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:24.723094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:24.723798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:24.730880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:24.731364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:24.731795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:24.732489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:24.732949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:24.733366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:24.880956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:24.889119 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62f0c24b-8e7a-4514-bbb5-e1898002d4c8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.172473 Aug 29 11:36:24.889723 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3236/6510] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:24 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:25.909633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:25.910371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:25.912346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:25.920389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:25.920940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:25.921391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:25.922141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:25.922610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:25.923048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:26.064908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:26.073291 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ab2abbff-df4f-417a-a5b3-e470fb1cb016 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.167473 Aug 29 11:36:26.073915 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3275/6511] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:25 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:27.095184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:27.095801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:27.102923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:27.103406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:27.103840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:27.104540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:27.104992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:27.105414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:27.239923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:27.248186 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-381e5301-1023-49a6-a7d2-284783ed6d10 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.156886 Aug 29 11:36:27.248765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3237/6512] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:27 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:28.273686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:28.274352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:28.281648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:28.282264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:28.282878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:28.283682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:28.284157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:28.284603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:28.424587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:28.432707 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2faba8c-b614-49ce-861c-c966a5e8f55e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.163554 Aug 29 11:36:28.433289 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3276/6513] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:28 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:29.455035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:29.455690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:29.463921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:29.464407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:29.464840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:29.465573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:29.466055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:29.466477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:29.602166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:29.613988 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8e32222-51fb-4f77-b5cc-5714bc843a62 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.163013 Aug 29 11:36:29.614607 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3238/6514] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:29 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:30.635954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:30.636614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:30.643572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:30.644076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:30.644544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:30.645256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:30.645809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:30.646200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:30.782967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:30.791010 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d6a86ffc-5b27-4d0d-9aea-08416999e701 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.159255 Aug 29 11:36:30.791934 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3277/6515] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:30 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:31.812623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:31.813246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:31.821365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:31.821886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:31.822328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:31.823030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:31.823486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:31.823913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:31.955511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:31.964329 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2562a582-2363-4952-aac4-595c4a34de33 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.155601 Aug 29 11:36:31.964928 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3239/6516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:31 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:32.986707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:32.987532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:32.995013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:32.995517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:32.995978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:32.996731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:32.997208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:32.997653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:33.501836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:33.511331 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ab3a176-3b1e-4f5d-bf96-1730583e3a3d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.528642 Aug 29 11:36:33.511927 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3278/6517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:32 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:34.532656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:34.533188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:34.541389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:34.541911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:34.542354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:34.543061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:34.543600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:34.544107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:34.680304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:34.688413 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0724908e-a5e0-49bb-afae-2872616662df tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.159713 Aug 29 11:36:34.688991 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3240/6518] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:34 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:35.709251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:35.709921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:35.716757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:35.717253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:35.717719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:35.718427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:35.718899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:35.719341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:35.855634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:35.863623 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-285592f4-c857-4557-a9dd-a313c1db82d1 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.158271 Aug 29 11:36:35.864209 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3279/6519] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:35 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:36.886011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:36.886625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:36.893622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:36.894149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:36.894583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:36.895274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:36.895721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:36.896142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:37.027978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:37.035888 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-41fba060-d3df-4b1e-923a-b457b9f5c19d tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.154410 Aug 29 11:36:37.036465 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3241/6520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:36 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:38.061539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:38.062644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:38.075123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:38.075895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:38.076915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:38.078174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:38.078957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:38.079717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:38.245677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:38.253737 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03065923-f9dc-4b69-820d-46fa8fc1664e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.199971 Aug 29 11:36:38.254315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3280/6521] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:38 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:39.276131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:39.276734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:39.283997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:39.284489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:39.284927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:39.285626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:39.286116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:39.286543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:39.418497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:39.426420 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35c74a10-9787-4ca2-9fcc-125b13d74a57 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.155050 Aug 29 11:36:39.427007 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3242/6522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:39 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:40.448294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:40.448914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:40.456516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:40.457020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:40.457469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:40.458218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:40.459129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:40.459956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:40.599745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:40.608758 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e24ede78-3af9-4465-a032-ae1460484c72 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.164610 Aug 29 11:36:40.609338 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3281/6523] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:40 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:41.630166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:41.630769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:41.637782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:41.638279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:41.638721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:41.639430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:41.639899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:41.640334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:41.775836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:41.783654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c476edb-360a-49b1-a70e-701241284ca0 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.157368 Aug 29 11:36:41.784257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3243/6524] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:41 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:42.805515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:42.806849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:42.814563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:42.815108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:42.815568 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:42.816345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:42.816797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:42.817273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:42.948174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:42.957083 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03319406-f6d0-4100-a1e9-1a674b34ca8e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.156182 Aug 29 11:36:42.957684 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3282/6525] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:42 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:43.979150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:43.979760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:43.988296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:43.988856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:43.989356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:43.990193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:43.990712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:43.991202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:44.137672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:44.146044 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-68a920a4-e0d6-4205-86a6-aaee242a1d0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.171017 Aug 29 11:36:44.146641 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3244/6526] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:43 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:45.168416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:45.169042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:45.176070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:45.176582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:45.177039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:45.177814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:45.178300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:45.178761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:45.319631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:45.328260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be232c3e-026a-4c20-8111-aec92df1b3d6 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.164836 Aug 29 11:36:45.329287 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3283/6527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:45 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:46.351377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:46.352021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:46.358905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:46.359408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:46.359841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:46.360530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:46.360983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:46.361397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:46.493966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:46.501766 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ab2c2b7a-9f18-43af-9829-5e8e5c8e7b46 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.154717 Aug 29 11:36:46.502341 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3245/6528] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:46 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:36:47.523394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:47.524026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:47.531566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:47.532048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:47.532512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:47.533257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:47.533940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:47.534245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:47.537338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:47.687220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:47.695652 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3bacc7f-b77b-4f1d-a24b-ed05059a12d2 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.176760 Aug 29 11:36:47.696246 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3284/6529] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:47 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:48.717259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:48.717914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:48.725109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:48.725728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:48.726772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:48.727484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:48.727947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:48.728379 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:48.866477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:48.874532 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73b89bfc-aa42-4d1e-ae3c-db13c2210491 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.161256 Aug 29 11:36:48.875101 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3246/6530] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:48 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:49.896467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:49.897100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:49.900582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=32 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:49.906097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:49.906602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:49.907057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:49.907768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:49.908239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:49.908680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:50.054657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:50.062561 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e02b77ca-c8cc-405b-85ec-43266fae3d07 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.170082 Aug 29 11:36:50.063145 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3285/6531] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:49 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:51.083713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:51.084323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:51.091270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:51.091754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:51.092192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:51.092879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:51.093330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:51.093785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:51.229589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:51.237604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1af358e6-4269-4c34-8fb9-b3f1d0c1f5da tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1515 microversion: 2.1 time: 0.157643 Aug 29 11:36:51.238136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3247/6532] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:51 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:52.227646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "name": "network-vif-unplugged", "status": "completed", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:52.238356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:52.238894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:52.239345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:52.252769 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Creating event network-vif-unplugged:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h1-854121-10 Aug 29 11:36:52.259869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:36:52.261295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:52.262107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:52.265663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=30 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:52.271473 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-badada98-5089-449c-8780-4d501c88db76 req-e106304d-f43a-4ec0-8cca-24f88ec8655f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048074 Aug 29 11:36:52.272255 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3286/6533] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:52.272615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:52.273186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:52.273640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:52.274411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:52.274878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:52.275314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:52.278570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=86 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:36:52.421163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:52.430042 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-145a2d15-94bd-4def-a602-b7f8becaf9a8 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1514 microversion: 2.1 time: 0.173138 Aug 29 11:36:52.430923 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3248/6534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:52 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:36:53.454690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:53.455411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:53.463109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:53.463611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:53.464062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:53.464782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:53.465255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:53.465714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:53.620420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:53.629374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9e6fa16-c0a3-4e59-83e2-cf600fea4e3e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1512 microversion: 2.1 time: 0.180106 Aug 29 11:36:53.630017 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3287/6535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:53 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:54.290072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:54.300258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:54.300728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:54.301161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:54.312508 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Creating event network-changed:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h1-854121-10 Aug 29 11:36:54.317761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:36:54.329505 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6b1979ab-c321-4c24-b4f1-9249e96f9022 req-89175328-25d3-413e-a832-16e5177a3f74 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043962 Aug 29 11:36:54.330145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3249/6536] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:36:54.654194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:54.655220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:54.662508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:54.664151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:54.665070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:54.666076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:54.667056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:54.667750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:54.919818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:54.938552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b3258a0-b7f1-4076-99e6-7ff91b8342c5 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1509 microversion: 2.1 time: 0.290199 Aug 29 11:36:54.941147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3288/6537] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:54 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:54.963793 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:54.964859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:54.972668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:54.973385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:54.979826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:54.989184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:54.989676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:54.990293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:55.025031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:36:55.080665 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.compute.api [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Found an unconfirmed migration during delete, id: 16, status: finished Aug 29 11:36:56.579458 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c07702bd-c3ae-4ee0-9880-6c73f60a2b0a tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 204 len: 0 microversion: 2.1 time: 1.621172 Aug 29 11:36:56.580294 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3250/6538] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:36:54 2022] DELETE /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 0 bytes in 1624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:36:56.592921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:56.594165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:56.603558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:56.603991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:56.604453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:56.605190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:56.605684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:56.606155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:56.751448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:56.760282 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60323d75-a41d-4ae2-9ce8-abbf180c8a55 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1501 microversion: 2.1 time: 0.175182 Aug 29 11:36:56.761012 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3289/6539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:56 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:36:56.849840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "name": "network-vif-plugged", "status": "completed", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:56.860948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:56.861519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:56.861983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:56.874124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] Creating event network-vif-plugged:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h1-854121-10 Aug 29 11:36:56.879023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-7b1cb010-a993-4576-84d8-70c6f81818ef req-5e97381b-b6f4-48d2-9955-1081254ae8a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Aug 29 11:36:56.879637 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3251/6540] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:36:57.782482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:57.783177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:57.791220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:57.791727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:57.792183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:57.792906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:57.793379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:57.793857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:57.960009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8166d5a4d754206949dc2f430fca241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ac030657db4cc5bf605ca89d0c1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:36:57.973052 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ca0a84a1-79b1-4dd1-8df4-ee82ba3a2e6b tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 200 len: 1501 microversion: 2.1 time: 0.193065 Aug 29 11:36:57.976756 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3290/6541] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:57 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:36:58.472820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e473e407-f9ce-4a54-885f-8ebb9d3bdfdd", "name": "network-vif-deleted", "tag": "09d26ba8-f824-4da4-86ab-61d42a866648"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:36:58.487336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:58.487826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:58.488375 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:58.504440 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] Creating event network-vif-deleted:09d26ba8-f824-4da4-86ab-61d42a866648 for instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd on n-h1-854121-10 Aug 29 11:36:58.510648 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a11c2e74-36e9-4c70-9869-07f7d9a28fd8 req-8e57b48a-beb5-4e6a-b58e-c2792b56eae3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044369 Aug 29 11:36:58.511439 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3252/6542] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:36:58.998135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:58.998850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:59.005501 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.006148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.007289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.008018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.008487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.008957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.024038 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] HTTP exception thrown: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Request method failure captured: Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd HTTP/1.1 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKSrdh_AMxM790epj-ghWl4Jp_-QjRJ-zhjufm47YzouDGwL8USrK3YyW9i564cjOejbh_nRRegu87VZfPUT5QQDcOBv5LBtLwJyMjhvb-GeeDZIfox9p7DhALhwkWUvcdF7Rg_UoFRWrG0hIUbIKfOdqQgoEx-q2SYuVRUc9uhvMbU Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e8166d5a4d754206949dc2f430fca241 Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e473e407-f9ce-4a54-885f-8ebb9d3bdfdd'} Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.025735 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Returning 404 to user: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cfce2df9-bdce-407c-8bbe-319ebec83fd7 tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 404 len: 111 microversion: 2.1 time: 0.033044 Aug 29 11:36:59.029763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3291/6543] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:58 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:36:59.043696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:59.044297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:59.057989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.058488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.058941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.059653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.060111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.060538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.074770 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] HTTP exception thrown: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Request method failure captured: Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd HTTP/1.1 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKSrdh_AMxM790epj-ghWl4Jp_-QjRJ-zhjufm47YzouDGwL8USrK3YyW9i564cjOejbh_nRRegu87VZfPUT5QQDcOBv5LBtLwJyMjhvb-GeeDZIfox9p7DhALhwkWUvcdF7Rg_UoFRWrG0hIUbIKfOdqQgoEx-q2SYuVRUc9uhvMbU Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: e8166d5a4d754206949dc2f430fca241 Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'e473e407-f9ce-4a54-885f-8ebb9d3bdfdd'} Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:36:59.076712 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Returning 404 to user: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27b71ef5-aebf-44fb-ba8f-3d43bc43e10f tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 404 len: 111 microversion: 2.1 time: 0.039716 Aug 29 11:36:59.080023 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3253/6544] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:36:59 2022] DELETE /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:36:59.092762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:36:59.093395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] [instance: e473e407-f9ce-4a54-885f-8ebb9d3bdfdd] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:36:59.099519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.100009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.101139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.101877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:36:59.102342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:36:59.102779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:36:59.118668 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] HTTP exception thrown: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Request method failure captured: Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd HTTP/1.1 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKSrdh_AMxM790epj-ghWl4Jp_-QjRJ-zhjufm47YzouDGwL8USrK3YyW9i564cjOejbh_nRRegu87VZfPUT5QQDcOBv5LBtLwJyMjhvb-GeeDZIfox9p7DhALhwkWUvcdF7Rg_UoFRWrG0hIUbIKfOdqQgoEx-q2SYuVRUc9uhvMbU Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c7ac030657db4cc5bf605ca89d0c1882"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: c7ac030657db4cc5bf605ca89d0c1882 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-DeleteServersTestJSON-49961237 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e8166d5a4d754206949dc2f430fca241 Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-DeleteServersTestJSON-49961237-project Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'e473e407-f9ce-4a54-885f-8ebb9d3bdfdd'} Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:36:59.120220 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] Returning 404 to user: Instance e473e407-f9ce-4a54-885f-8ebb9d3bdfdd could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d43778e-d96c-40ce-bc86-421e9674b80e tempest-DeleteServersTestJSON-49961237 tempest-DeleteServersTestJSON-49961237-project] 10.222.0.47 "GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd" status: 404 len: 111 microversion: 2.1 time: 0.032957 Aug 29 11:36:59.124188 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3292/6545] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:36:59 2022] GET /compute/v2.1/servers/e473e407-f9ce-4a54-885f-8ebb9d3bdfdd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:37:08.280072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2005925129", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "50c4f7e5-82e8-4582-af7f-f198497a924b"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:08.342657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] validate_networks() for [('50c4f7e5-82e8-4582-af7f-f198497a924b', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:37:08.809857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:37:08.810292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:37:08.810778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:37:08.811197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:37:08.811617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:37:08.821007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:08.821495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:08.822009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:08.822750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:08.823212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:08.823648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:08.842775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:37:08.848542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for user a8cba79588af4e3baf2caf3de2a4c464 and project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:37:08.862638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:37:08.865044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:37:08.913975 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fababbef-8eb3-4134-89c3-e64c3b1f6658 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781300 Aug 29 11:37:08.920743 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3254/6546] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:37:08.926578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1d617dcb-0d16-4ef7-ae91-52c6eac878c7 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:08.927842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1d617dcb-0d16-4ef7-ae91-52c6eac878c7 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:08.992870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1d617dcb-0d16-4ef7-ae91-52c6eac878c7 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:09.000689 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1d617dcb-0d16-4ef7-ae91-52c6eac878c7 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1218 microversion: 2.1 time: 0.078437 Aug 29 11:37:09.001521 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3293/6547] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:08 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:10.025592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:10.026827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:10.039308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:10.044252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:10.045534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:10.046883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:10.048765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:10.049358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:10.126466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:10.136384 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d5c94d77-b329-42da-a18b-30c8ad071bbb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1270 microversion: 2.1 time: 0.117063 Aug 29 11:37:10.137484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3255/6548] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:10 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:37:11.172055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:11.173323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:11.182706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=43 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:11.185631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:11.186418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:11.186891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:11.187666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:11.188603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:11.189142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:11.358721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:11.383807 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-925e82b0-3778-4837-8725-da7b59412f38 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.216071 Aug 29 11:37:11.398550 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3294/6549] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:11 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:11.841730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:11.868634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:11.869127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:11.869629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:11.884015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] Creating event network-changed:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h1-854121-10 Aug 29 11:37:11.891628 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6fcf5082-cf5f-4ea9-ba95-2c1268c931d0 req-bad8d2f4-b6c5-4a00-bb18-6ee9cad87b33 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053685 Aug 29 11:37:11.892937 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3256/6550] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:12.406513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:12.407145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:12.415478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:12.415975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:12.416428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:12.417145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:12.417613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:12.418082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:12.557135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:12.565060 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00d8750d-4153-4d04-83cc-d038bd2f29ad tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.162514 Aug 29 11:37:12.565772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3295/6551] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:12 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:13.588386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:13.589107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:13.595612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:13.596106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:13.596551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:13.597258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:13.597763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:13.598209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:13.734595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:13.742714 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2ac5a937-4972-4fd9-b66c-9d3af63b1a5a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.160203 Aug 29 11:37:13.743288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3257/6552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:13 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:14.762807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:14.763387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:14.770598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:14.771104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:14.771565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:14.772974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:14.773452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:14.773938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:14.921378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:14.930441 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d84426ee-ab92-4d26-ab71-f1536149e980 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.171483 Aug 29 11:37:14.931066 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3296/6553] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:14 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:15.951734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:15.952348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:15.960125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:15.960945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:15.961067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:15.961769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:15.962225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:15.962654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:16.108991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:16.116900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ddc9055-98a3-445c-965d-89e4ef7e24e2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.169311 Aug 29 11:37:16.117493 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3258/6554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:15 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:16.949373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "name": "network-vif-plugged", "status": "completed", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:16.961079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:16.961594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:16.962077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:16.975784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] Creating event network-vif-plugged:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h1-854121-10 Aug 29 11:37:16.981274 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d866a2f6-07ef-4b65-aef6-df1310668f4e req-ab066367-6747-4cd2-b8cc-f40d72b63540 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Aug 29 11:37:16.982324 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3297/6555] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:17.137332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:17.137992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:17.144682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:17.145156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:17.145591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:17.146297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:17.146798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:17.147314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:17.542548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:17.550366 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87772b80-d55a-47b3-92f5-ec0eccd52471 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1318 microversion: 2.1 time: 0.416925 Aug 29 11:37:17.550949 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3259/6556] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:17 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:18.572719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:18.573365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:18.579883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.580387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.580845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:18.581565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.582075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.582524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:18.729194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:18.737091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c3fb30c3-7a80-45ac-9214-9a2eb9050a8f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1508 microversion: 2.1 time: 0.169619 Aug 29 11:37:18.737719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3298/6557] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:18 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:18.757380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:18.758019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:18.764763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.765301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.765758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:18.766463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.766923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.767383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:18.832041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:18.856548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:18.903429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:18.911356 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc022af2-dd07-4f3f-8a36-e747356eabce tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1508 microversion: 2.1 time: 0.158555 Aug 29 11:37:18.911997 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3260/6558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:18 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:18.932120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:18.934594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:18.940741 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.941243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.941726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:18.942434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:18.942908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:18.943355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.000506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:19.012592 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4765a033-7b87-4e25-8c79-19e7fcfbdd5e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "PUT /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1080 microversion: 2.1 time: 0.084829 Aug 29 11:37:19.013263 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3299/6559] 10.222.0.47 () {60 vars in 1256 bytes} [Mon Aug 29 11:37:18 2022] PUT /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1080 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:19.030551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:19.031168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:19.037145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.037651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.038130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.038831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.039292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.039718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.175033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:19.183573 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ce3946a-65c4-4c4b-992f-4fe02f312e4e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1506 microversion: 2.1 time: 0.156878 Aug 29 11:37:19.184142 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3261/6560] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:19 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:19.203979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:19.204748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:19.211727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.212266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.212722 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.213431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.213960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.214376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.355268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:19.363189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c52f7cd8-4b0a-4fcf-95ab-ad94ba577a21 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1506 microversion: 2.1 time: 0.163421 Aug 29 11:37:19.363799 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3300/6561] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:19 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:19.384215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:19.386461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:19.392408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.392896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.393334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.394067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.394523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.394960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.423664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:19.430516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:37:19.438284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:37:19.438716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:37:19.439200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:37:19.439615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:37:19.440033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:37:19.510632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38e507fe-9b00-4114-b2c6-d795598800b8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2/action" status: 202 len: 0 microversion: 2.1 time: 0.131021 Aug 29 11:37:19.514419 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3262/6562] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:37:19 2022] POST /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:37:19.522595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:19.523236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:19.530106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.531000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.531533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.535582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:19.535582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:19.535582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:19.689520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:19.697975 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8630305b-7795-48dc-aad1-1dd977627da1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1517 microversion: 2.1 time: 0.181770 Aug 29 11:37:19.698563 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3301/6563] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:19 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:20.720502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:20.721122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:20.729648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:20.730093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:20.730535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:20.731266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:20.731690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:20.732116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:20.872705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:20.880634 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c20676e1-2f76-4398-9b95-cc62af5eb9f4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1517 microversion: 2.1 time: 0.165052 Aug 29 11:37:20.881797 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3263/6564] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:20 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:21.902934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:21.903564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:21.906421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:21.912019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:21.913210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:21.913735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:21.914559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:21.915034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:21.915475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:22.060538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:22.069278 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df9f1cf0-cc62-41e0-8ee9-f2bb819c80bd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.169649 Aug 29 11:37:22.069911 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3302/6565] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:21 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:37:23.091062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:23.091687 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:23.094507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:23.101330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:23.101862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:23.102314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:23.103035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:23.103502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:23.103936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:23.107236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:23.600453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:23.608301 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ddcdbd08-9ccc-416c-a940-9aad02e2ca05 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.521220 Aug 29 11:37:23.608902 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3264/6566] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:23 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:24.630557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:24.631842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:24.638982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:24.639487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:24.639938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:24.640651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:24.641118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:24.641560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:24.773345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:24.781385 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9f56971d-889b-4f98-92a4-e3b7a47a812c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.154942 Aug 29 11:37:24.781996 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3303/6567] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:24 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:25.802135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:25.803294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:25.810774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:25.811270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:25.811713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:25.812424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:25.812885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:25.813323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:25.946854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:25.955199 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22db59c9-21b5-4014-84f3-00ca2b77be42 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156957 Aug 29 11:37:25.955777 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3265/6568] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:25 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:26.976376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:26.977016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:26.984319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:26.984830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:26.985293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:26.986055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:26.986529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:26.987233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:27.124029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:27.132435 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f61b70f-1482-44d0-ab97-e69e8bd097fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.160039 Aug 29 11:37:27.133018 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3304/6569] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:26 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:28.152692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:28.153305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:28.160224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:28.160708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:28.161149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:28.161875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:28.162337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:28.162764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:28.301102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:28.309318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7113d216-8424-4640-99a4-f3f0161163cd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.160620 Aug 29 11:37:28.309922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3266/6570] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:28 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:29.331060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:29.331622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:29.339503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:29.340002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:29.340453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:29.341164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:29.341635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:29.342102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:29.475104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:29.483758 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2610881e-e5e0-486f-935b-4922dd870592 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156867 Aug 29 11:37:29.484342 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3305/6571] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:29 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:30.507977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:30.508658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:30.517799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:30.518653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:30.519399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:30.520188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:30.520854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:30.525670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:30.660779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:30.668763 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a7fbc6e-f161-444f-9187-3a6a82bc912a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.164974 Aug 29 11:37:30.669336 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3267/6572] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:30 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:31.689769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:31.690407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:31.697337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:31.697884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:31.698344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:31.699064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:31.699536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:31.699981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:31.832536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:31.841116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ecf5b9f-92e7-4b37-9fe8-e9500eac2382 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.155273 Aug 29 11:37:31.841728 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3306/6573] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:31 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:32.862105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:32.862695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:32.869811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:32.870295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:32.870734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:32.871422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:32.871877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:32.872307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:33.005474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:33.014221 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d66b77c1-a312-4fed-b62b-5fe977f70b7a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.155935 Aug 29 11:37:33.014819 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3268/6574] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:32 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:34.035997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:34.036624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:34.044495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:34.044993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:34.045445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:34.046201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:34.046715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:34.047325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:34.181500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:34.189376 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25819e6d-4894-4283-83e9-26fb873f5d71 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.157327 Aug 29 11:37:34.189980 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3307/6575] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:34 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:35.212600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:35.213254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:35.221253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:35.221848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:35.222299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:35.223014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:35.223475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:35.223906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:35.355709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:35.363567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9916370f-7132-4535-9f41-109400a6f586 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156079 Aug 29 11:37:35.364145 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3269/6576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:35 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:36.385492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:36.386261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:36.393156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:36.393650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:36.394129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:36.394837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:36.395305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:36.395744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:36.536566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:36.544522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5a7d3f46-a69e-44da-b2f5-14efb4d9dc95 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.164019 Aug 29 11:37:36.545086 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3308/6577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:36 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:37.566238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:37.566853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:37.574335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:37.574821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:37.575266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:37.576220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:37.576677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:37.577105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:37.711447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:37.719223 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-22eece59-d983-4985-a687-4c51c989df08 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156940 Aug 29 11:37:37.719809 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3270/6578] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:37 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:38.742440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:38.743179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:38.750066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:38.750572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:38.751026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:38.751743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:38.752208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:38.752653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:38.886818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:38.894656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-337a266a-7afe-4ef3-827d-10e3902ba943 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156814 Aug 29 11:37:38.895237 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3309/6579] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:38 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:39.915807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:39.916422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:39.923750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:39.924244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:39.924685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:39.925391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:39.925890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:39.926337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:40.066807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:40.075263 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7e7e66fc-de69-45ea-8fed-270df2e30102 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.163490 Aug 29 11:37:40.076103 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3271/6580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:39 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:41.096450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:41.097076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:41.104790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:41.105285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:41.105751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:41.106457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:41.106926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:41.107363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:41.125659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:41.240976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:41.249421 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-641c8c15-9f95-4181-a17d-02c56c12e883 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.156965 Aug 29 11:37:41.250051 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3310/6581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:41 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:42.270476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:42.271084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:42.278075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:42.278565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:42.279008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:42.279710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:42.280170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:42.280601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:42.419051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:42.426820 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5e58daa8-144d-44b1-9c17-0dbf96384400 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.160331 Aug 29 11:37:42.427399 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3272/6582] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:42 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:43.447949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:43.448571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:43.455931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:43.456426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:43.456873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:43.457576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:43.458075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:43.458515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:43.591963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:43.599669 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97f0973f-5439-4adb-b3fc-993ad33e3851 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.155706 Aug 29 11:37:43.600247 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3311/6583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:43 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:44.621862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:44.622387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:44.629807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:44.630352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:44.630795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:44.631513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:44.631974 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:44.632401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:44.769600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:44.778825 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-24e55918-84ca-493f-aebc-ef4f7c632827 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.160980 Aug 29 11:37:44.779417 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3273/6584] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:44 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:45.801370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:45.801948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:45.809445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:45.809981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:45.810432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:45.811146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:45.811623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:45.812061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:45.963187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:45.971099 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67599fca-9521-4fe4-8db2-eb6fdd868abb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.173910 Aug 29 11:37:45.971689 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3312/6585] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:45 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:46.995975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:46.996590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:47.003518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:47.004003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:47.004441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:47.005139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:47.005592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:47.006056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:47.138352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:47.146079 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51213e3d-a79f-48fa-828e-b160ecd303a6 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.154881 Aug 29 11:37:47.146654 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3274/6586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:46 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:48.167607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:48.168367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:48.175538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:48.176045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:48.176505 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:48.177235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:48.178119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:48.178573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:48.326242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:48.336005 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-def4ae5d-d277-403f-8276-b924b7817c89 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1522 microversion: 2.1 time: 0.173005 Aug 29 11:37:48.337826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3313/6587] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:48 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:48.808712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:48.819938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:48.820427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:48.821220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:48.834654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Creating event network-vif-unplugged:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h2-854121-10 Aug 29 11:37:48.841213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:37:48.853757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d96c903e-4a8b-4962-9606-03c1e0700420 req-848e3b51-06a9-44bd-9454-c58e8511c225 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050159 Aug 29 11:37:48.854643 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3275/6588] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:49.359186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:49.359834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:49.367036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:49.367588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:49.368772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:49.369765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:49.370243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:49.370702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:49.591857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:49.601087 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1fdeeacc-6a32-434a-8661-a13c7ba97adb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1521 microversion: 2.1 time: 0.245856 Aug 29 11:37:49.601720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3314/6589] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:49 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:50.626870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:50.627571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:50.635089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:50.635583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:50.636032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:50.636740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:50.637201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:50.637633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:50.783108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:50.791588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ac818aac-d3f3-4ce2-8945-3f75c774b8a1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1519 microversion: 2.1 time: 0.169732 Aug 29 11:37:50.792203 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3276/6590] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:50 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:50.869168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:50.879712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:50.880212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:50.880674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:50.892837 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Creating event network-changed:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h2-854121-10 Aug 29 11:37:50.898353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:37:50.909474 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4539f69f-7e04-4271-93be-f58d917c024e req-43d05483-6a52-4479-88b2-ca15b6feef2c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045363 Aug 29 11:37:50.910141 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3315/6591] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:51.813870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:51.814526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:51.822134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:51.822636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:51.823086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:51.823805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:51.824269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:51.824706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:51.984819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:51.993466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-819ab687-361f-4819-8d7c-06667d5e6225 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1516 microversion: 2.1 time: 0.182928 Aug 29 11:37:51.994223 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3277/6592] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:51 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:52.015820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:52.016464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:52.018729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=28 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:52.025648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:52.026089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:52.026578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:52.027310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:52.027780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:52.028220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:52.094608 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f5d4dc7-ae50-4fdd-89cb-14dddc4fe12a tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2/action" status: 204 len: 0 microversion: 2.1 time: 0.083843 Aug 29 11:37:52.095302 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3316/6593] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:37:52 2022] POST /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:37:52.104845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:52.105481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:52.111769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:52.112269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:52.112871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:52.113599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:52.114202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:52.114713 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:52.279259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:52.287245 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f84e006c-fe3a-4510-a1a5-d224532fb3fc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1516 microversion: 2.1 time: 0.186673 Aug 29 11:37:52.287848 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3278/6594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:52 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:53.205896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "name": "network-vif-plugged", "status": "completed", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:53.219368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:53.220080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:53.220526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:53.233433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] Creating event network-vif-plugged:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h2-854121-10 Aug 29 11:37:53.240800 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d19d9d1c-64cb-4b7f-948e-b109a43877ff req-6526942f-44e2-48af-8155-05bdd104c3c1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039717 Aug 29 11:37:53.241678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3317/6595] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:53.310050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:53.311355 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:53.314314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=30 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:53.319609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:53.320434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:53.322017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:53.322908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:53.323635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:53.324141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:53.329571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=88 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:37:53.485571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:53.494671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9caa17db-9a71-4f9c-8062-352fd3dac56c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1508 microversion: 2.1 time: 0.190184 Aug 29 11:37:53.495257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3279/6596] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:53 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:53.516186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:53.516893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:53.523266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:53.523770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:53.524789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:53.525525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:53.526072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:53.526532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:53.667069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:53.675419 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-84c15ae4-b55d-479d-a379-630b4b65d0f2 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1508 microversion: 2.1 time: 0.163651 Aug 29 11:37:53.676018 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3318/6597] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:53 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:37:53.699723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b3da3837-3315-4dd8-9661-c1654fdb77d8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'create', calling method: .version_select at 0x7f66c5ab2f70>, body: {"keypair": {"name": "tempest-keypair-376214881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJG+IhhHm7fwPaLZgkYlXxyU/L3FURPsDwsqHnegXvBpjpRnOB40U8dy8JUwer6BewjxoYuCb0mj/Qpf+DD9ZeTqVB6YmE5uZIa32PU8V5FdVF4L/zkeYqaY+e8gq48H0g=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:53.717061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b3da3837-3315-4dd8-9661-c1654fdb77d8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:37:53.722835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b3da3837-3315-4dd8-9661-c1654fdb77d8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for user a8cba79588af4e3baf2caf3de2a4c464 and project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:37:53.752200 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b3da3837-3315-4dd8-9661-c1654fdb77d8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056712 Aug 29 11:37:53.752826 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3280/6598] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:37:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:55.331519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:55.332151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:55.339219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:55.339696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:55.340154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:55.340877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:55.341351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:55.341823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:55.475938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:55.484745 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2f463989-b3c7-4206-9c17-e50a7228cdfb tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 200 len: 1508 microversion: 2.1 time: 0.157127 Aug 29 11:37:55.485337 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3319/6599] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:55 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:55.506196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:55.506722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:55.514052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:55.514542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:55.514984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:55.515682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:55.516136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:55.516561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:55.542233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:37:55.626647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9a231d99-3800-4441-a58f-94d34458b941 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "DELETE /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 204 len: 0 microversion: 2.1 time: 0.124673 Aug 29 11:37:55.627353 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3281/6600] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:37:55 2022] DELETE /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:37:55.686176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-902296320", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "50c4f7e5-82e8-4582-af7f-f198497a924b"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:55.740651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] validate_networks() for [('50c4f7e5-82e8-4582-af7f-f198497a924b', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:37:56.152607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:37:56.153048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:37:56.153549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:37:56.154005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:37:56.154436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:37:56.163661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:56.164167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:56.165199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:56.165977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:56.166451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:56.166895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:56.184718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:37:56.190131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Getting quotas for user a8cba79588af4e3baf2caf3de2a4c464 and project 09aaaa00d000456cb37bc189edaeda6b. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:37:56.204039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:37:56.206430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:37:56.253644 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d0fcc5a-2bf5-4668-a601-cab246bab4b4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571465 Aug 29 11:37:56.254323 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3320/6601] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:37:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:37:56.266005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6d31aee6-3d28-4062-9384-5d8bffb2ffea tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:56.266750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6d31aee6-3d28-4062-9384-5d8bffb2ffea tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:56.328851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6d31aee6-3d28-4062-9384-5d8bffb2ffea tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:56.340297 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6d31aee6-3d28-4062-9384-5d8bffb2ffea tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1217 microversion: 2.1 time: 0.078339 Aug 29 11:37:56.343751 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3282/6602] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:56 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:57.362320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:57.363587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:57.372950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:57.373468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:57.373961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:57.374765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:57.375176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:57.375623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:57.476564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:57.494488 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e29a1a62-c44e-4f77-ac1a-12c50959a275 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1277 microversion: 2.1 time: 0.136741 Aug 29 11:37:57.510236 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3321/6603] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:57 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:57.513781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2a0cd-a0a7-411d-a46d-6ecb206867b2", "name": "network-vif-deleted", "tag": "f3b51583-17ee-4116-884d-9119acfad24a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:57.531126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:57.532373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:57.533011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:57.547102 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] Creating event network-vif-deleted:f3b51583-17ee-4116-884d-9119acfad24a for instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 on n-h2-854121-10 Aug 29 11:37:57.553191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5c7144e1-8bde-4e6c-b728-d4fcd94e261c req-fae13860-e555-47fe-a551-b40f9703a2b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042945 Aug 29 11:37:57.554551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3283/6604] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:58.524630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:58.527269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:58.537890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:58.538409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:58.538865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:58.540299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:58.540786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:58.541540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:58.701871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:58.712643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03ac7afe-53cb-4e59-a044-ec45863fa4fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1317 microversion: 2.1 time: 0.197047 Aug 29 11:37:58.713262 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3322/6605] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:58 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:37:59.037576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:37:59.059026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:59.059795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:59.060332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:59.072563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] Creating event network-changed:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h2-854121-10 Aug 29 11:37:59.078242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6148f3fe-6b39-4f08-8e1f-19ebc8dac4eb req-43aa3fa3-0fb1-4c98-9a6c-a0bb546bbb78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044892 Aug 29 11:37:59.079043 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3284/6606] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:37:59.732711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:37:59.733258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:37:59.740238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:59.740736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:59.741184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:59.741949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:37:59.743058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:37:59.743503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:37:59.883018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:37:59.891405 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1af3f7d5-7f4e-4bcc-8dcd-435a475f6b7d tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1317 microversion: 2.1 time: 0.162720 Aug 29 11:37:59.891987 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3323/6607] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:37:59 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:00.913729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:00.915533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:00.921973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:00.922462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:00.922907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:00.923613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:00.924068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:00.924499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:01.068136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:01.076889 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4aa75907-c503-47e9-b48a-89da226487fd tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1317 microversion: 2.1 time: 0.168329 Aug 29 11:38:01.077717 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3285/6608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:00 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:02.098051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:02.098715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:02.106193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:02.106697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:02.107153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:02.107874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:02.108349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:02.108795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:02.246563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:02.254306 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-897c3bff-6eb1-476d-9500-174329872019 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1317 microversion: 2.1 time: 0.160228 Aug 29 11:38:02.254897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3324/6609] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:02 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:03.234332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "name": "network-vif-plugged", "status": "completed", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:03.246577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:03.247075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:03.247520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:03.260302 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] Creating event network-vif-plugged:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h2-854121-10 Aug 29 11:38:03.265373 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-64d12723-8e56-482a-9865-4b6251432bc4 req-2b6bec12-8fb9-43fa-a37a-ba75dc42f0f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Aug 29 11:38:03.266179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3286/6610] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:03.277033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:03.277864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:03.285948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:03.286556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:03.287018 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:03.288140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:03.288620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:03.289962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:03.435931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:03.443892 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bd4aaa0-9f8a-45be-8d2f-3c3064af6faa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1317 microversion: 2.1 time: 0.172203 Aug 29 11:38:03.444466 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3325/6611] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:03 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:04.467960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:04.468694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:04.475403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.475890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.476328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.477779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.478353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.478828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.622812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:04.631452 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bd94369e-c992-4f47-904b-801a81394dd8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1508 microversion: 2.1 time: 0.169877 Aug 29 11:38:04.632054 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3287/6612] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:04 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:04.651297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:04.651938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:04.658896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.659405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.659866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.660590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.661068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.661517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.799123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:04.808739 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aa863789-ba33-40e6-aedb-8d8a609d437c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1508 microversion: 2.1 time: 0.161186 Aug 29 11:38:04.809346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3326/6613] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:04 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:04.828938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:04.831346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:04.838163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.838663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.839116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.839826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.840292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.840730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.871002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:04.877069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Old instance type m1.heat2, new instance type m1.heat {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:38:04.884145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:38:04.884575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:38:04.885060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:38:04.885478 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:38:04.885943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:38:04.951653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ddf80853-8c44-4025-8735-d6a22b11c113 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191/action" status: 202 len: 0 microversion: 2.1 time: 0.126896 Aug 29 11:38:04.953228 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3288/6614] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:38:04 2022] POST /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:38:04.962584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:04.964332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:04.970953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.971638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.971973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:04.972657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:04.973142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:04.979266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:05.122442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:05.124882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:05.132831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61d5d2db-986b-4763-8ecd-68c7df1e60a5 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1515 microversion: 2.1 time: 0.175038 Aug 29 11:38:05.133593 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3327/6615] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:04 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:38:06.157382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:06.158153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:06.166283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:06.166858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:06.167385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:06.168204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:06.168715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:06.169395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:06.312463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:06.320895 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02f8073e-5cf9-4a66-9a4d-9dd11a7a83aa tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1515 microversion: 2.1 time: 0.170397 Aug 29 11:38:06.321984 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3289/6616] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:06 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:07.343515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:07.344037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:07.346852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:07.347536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:07.354903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:07.355406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:07.355860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:07.356581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:07.357057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:07.357503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:07.489472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:07.497946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89b8626d-9887-4696-800c-6b1e57a96edc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.158695 Aug 29 11:38:07.498554 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3328/6617] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:07 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:08.520187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:08.520799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:08.522884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:08.530115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:08.530603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:08.531040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:08.531751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:08.532209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:08.532635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:08.672245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:08.680886 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88520c54-1a8f-4a64-9717-23842ce43112 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.164364 Aug 29 11:38:08.681487 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3290/6618] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:08 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:09.702762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:09.703381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:09.712094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:09.712609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:09.713065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:09.713832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:09.714306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:09.714746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:09.912359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:09.921143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-565d4925-d3d9-45a4-873d-2301aeabc03c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.222651 Aug 29 11:38:09.921721 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3329/6619] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:09 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:10.942665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:10.943294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:10.951254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:10.951749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:10.952199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:10.952911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:10.953376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:10.953879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:11.142961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:11.150721 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-90e568c8-1c05-4b64-8bff-026a0fe0b19c tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.211981 Aug 29 11:38:11.151294 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3291/6620] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:10 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:12.172500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:12.173101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:12.180324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:12.180694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:12.181141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:12.181876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:12.182344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:12.182784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:12.322109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:12.331609 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-376355ee-f21e-47f7-ac7c-f7afb4b54c68 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.163380 Aug 29 11:38:12.332189 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3330/6621] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:12 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:13.353615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:13.354264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:13.361282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:13.361840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:13.362285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:13.363018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:13.363474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:13.363903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:13.498128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:13.506055 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8b013360-9723-4d26-9d45-5fa114120198 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.157404 Aug 29 11:38:13.506638 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3292/6622] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:13 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:14.528044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:14.528650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:14.535657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:14.536151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:14.536600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:14.537306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:14.537796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:14.538234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:14.668987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:14.679875 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a1616d1-a41f-4e95-8d7d-ca2e8e463242 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.154953 Aug 29 11:38:14.680826 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3331/6623] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:14 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:15.700937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:15.701467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:15.708465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:15.708955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:15.709397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:15.710118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:15.710579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:15.711461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:15.847492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:15.856274 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8ac7f75-97bf-488f-bfa2-9e04a9dfd784 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.159643 Aug 29 11:38:15.856852 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3293/6624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:15 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:38:16.877914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:16.878554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:16.885239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:16.885847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:16.886240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:16.886967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:16.887442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:16.887887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:17.024355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:17.032403 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b6f8bdb-75d9-4e2f-8a8e-a77683fe66dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.158601 Aug 29 11:38:17.033003 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3332/6625] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:16 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:18.054120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:18.056017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:18.063972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:18.064463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:18.064903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:18.065613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:18.066096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:18.066521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:18.446686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:18.455020 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed6e8684-8830-4439-8090-922941f01141 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.405675 Aug 29 11:38:18.455594 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3294/6626] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:18 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:19.476463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:19.477094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:19.484464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:19.484960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:19.485412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:19.486277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:19.486696 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:19.487131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:19.619576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:19.627502 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-85eb5aac-9d2d-48e5-a48d-4cd853c35349 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.154933 Aug 29 11:38:19.628139 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3333/6627] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:19 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:20.649957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:20.650627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:20.657653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:20.658164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:20.658606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:20.659314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:20.659773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:20.660204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:20.796449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:20.804858 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59022654-bcad-47de-b881-290644554a55 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.158852 Aug 29 11:38:20.805538 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3295/6628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:20 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:21.826838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:21.827499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:21.834417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:21.834921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:21.835378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:21.836748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:21.837221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:21.837666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:21.971715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:21.980964 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6fb99435-3bb1-47c3-a052-81e1f5165ba1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.158251 Aug 29 11:38:21.981616 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3334/6629] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:21 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:23.003654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:23.004262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:23.012496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:23.012983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:23.013426 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:23.014171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:23.014627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:23.015052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:23.151213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:23.153395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:23.161060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae12cde3-76d0-4c90-95c6-24d4c4f54953 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.161336 Aug 29 11:38:23.161640 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3296/6630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:22 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:24.182670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:24.183218 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:24.185671 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:38:24.185842 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 (ip 10.222.0.47) !!! Aug 29 11:38:24.188074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:24.196690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:24.197195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:24.197650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:24.198398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:24.198878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:24.199325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:24.338038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:24.346129 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-462b98d6-71dc-468b-9231-557ec6213cda tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.167443 Aug 29 11:38:24.346717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3335/6631] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:24 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:25.369366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:25.370031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:25.373684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:25.382222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:25.382596 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:25.383200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:25.383954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:25.384433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:25.384876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:25.519956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:25.528761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0b6a9b92-a3d7-4420-9050-4f5019d97bb4 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.164141 Aug 29 11:38:25.529349 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3297/6632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:25 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:26.550180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:26.550817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:26.558619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:26.559122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:26.559579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:26.560304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:26.560774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:26.561230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:26.713243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:26.721413 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-681161d0-c18c-4f60-8598-c4fcc386ca72 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.175193 Aug 29 11:38:26.722031 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3336/6633] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:26 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:27.742555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:27.743179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:27.750167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:27.750663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:27.751112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:27.751823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:27.752286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:27.752721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:27.889385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:27.897800 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e66b9b8b-f3a0-4087-a351-f554518077ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.159161 Aug 29 11:38:27.898393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3298/6634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:27 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:28.920056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:28.920610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:28.927211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:28.927715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:28.928164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:28.928898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:28.929995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:28.930437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:29.069015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:29.078554 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5265ceff-0b52-4041-91e5-a9ebd8b6207e tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.163027 Aug 29 11:38:29.079142 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3337/6635] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:28 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:30.101845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:30.102645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:30.108885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:30.109370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:30.109835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:30.110540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:30.111001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:30.111430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:30.249213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:30.258201 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-174c3f96-49e3-4541-ac5d-cabceb133aed tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.160469 Aug 29 11:38:30.259167 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3299/6636] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:30 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:31.279597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:31.280176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:31.287349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:31.287846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:31.288376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:31.289095 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:31.289566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:31.290042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:31.425214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:31.434007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9566fb3c-9431-4c8e-8b0a-a8d4d9f1a576 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.158338 Aug 29 11:38:31.434603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3338/6637] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:31 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:32.455205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:32.455860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:32.463353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:32.463842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:32.464280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:32.464984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:32.466183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:32.466953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:32.602308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:32.610086 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-377417b7-81fe-4da4-b121-573c9e0a72e3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1520 microversion: 2.1 time: 0.159513 Aug 29 11:38:32.610654 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3300/6638] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:32 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:33.631881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:33.632777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:33.639681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:33.640184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:33.640633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:33.641354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:33.641908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:33.642383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:33.776544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:33.785058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-399a990d-b2dd-4ff3-9aa4-e80349635c67 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1519 microversion: 2.1 time: 0.157131 Aug 29 11:38:33.785677 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3339/6639] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:33 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:34.061531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "name": "network-vif-unplugged", "status": "completed", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:34.074184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:34.074746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:34.075728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:34.089450 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Creating event network-vif-unplugged:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h1-854121-10 Aug 29 11:38:34.095243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:38:34.108070 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-17349b9e-1d84-41c1-9919-0e569b0ea50e req-8121af45-153c-4bc3-955d-1667c60044ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050663 Aug 29 11:38:34.108699 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3301/6640] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:34.807613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:34.808243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:34.815458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:34.815884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:34.816332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:34.817054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:34.817518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:34.818000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:34.971007 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:34.980182 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8b46f16c-4d04-4688-8656-9fd68dd18f8b tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1519 microversion: 2.1 time: 0.176569 Aug 29 11:38:34.981372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3340/6641] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:34 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:36.002268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:36.002965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:36.010739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:36.011237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:36.011684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:36.012437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:36.012901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:36.013336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:36.140042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:36.150933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:36.151406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:36.151855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:36.153329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:36.161822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2981419-bd1f-438a-bc0f-d2d7dc252e16 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1517 microversion: 2.1 time: 0.163721 Aug 29 11:38:36.162348 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3302/6642] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:35 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:36.165234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Creating event network-changed:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h1-854121-10 Aug 29 11:38:36.171469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:38:36.189459 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d0cff692-47a4-4498-aa71-e904a26ca9be req-ce335df7-bca2-4cd3-925b-2c0072a72a94 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053181 Aug 29 11:38:36.190301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3341/6643] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:37.183471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:37.184070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:37.191195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.191681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.192120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.192814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.193271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.193717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.341915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:37.350312 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7154675c-6fdf-474c-a387-c59b049307e8 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1514 microversion: 2.1 time: 0.170924 Aug 29 11:38:37.351118 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3303/6644] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:37 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:37.372803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:37.373495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:37.380369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.380884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.381353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.382670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.383155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.383604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.386815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=84 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:37.447300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb47f42c-9067-49d7-b7c2-4d15c5951c19 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "POST /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191/action" status: 204 len: 0 microversion: 2.1 time: 0.079665 Aug 29 11:38:37.448603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3342/6645] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:38:37 2022] POST /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:38:37.458196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:37.459060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:37.467337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.467833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.468438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.470341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:37.470813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:37.471252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:37.621439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:37.633070 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1e29586-0ee5-4cfe-99eb-8d1cbb7d55dc tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1514 microversion: 2.1 time: 0.178360 Aug 29 11:38:37.634162 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3304/6646] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:37 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:38.656806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:38.657535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:38.664113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:38.664628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:38.665251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:38.666457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:38.666850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:38.667595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:38.811416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:38.822119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-453ab808-7072-4118-adc8-3a6506df667f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1506 microversion: 2.1 time: 0.171753 Aug 29 11:38:38.822705 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3343/6647] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:38 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:38.842104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:38.842746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:38.849636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:38.850156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:38.851159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:38.852052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:38.852505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:38.852937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:38.989868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:38.998761 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f63f47f2-2987-41c6-9624-f34ef991bbc9 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1506 microversion: 2.1 time: 0.160671 Aug 29 11:38:38.999335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3305/6648] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:38 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:39.021406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:39.022063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:39.028984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.029489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.029979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.030680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.031147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.031586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.164559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:39.172753 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-506b6c43-758e-40f7-850c-105164864ab1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1506 microversion: 2.1 time: 0.156638 Aug 29 11:38:39.173339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3344/6649] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:39 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:38:39.193642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:39.194108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:39.200760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.201288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.201693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.202415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.202874 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.203309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.229899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:38:39.324138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4577d4c3-41d0-4775-a6b0-1fefccfbf937 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 204 len: 0 microversion: 2.1 time: 0.134201 Aug 29 11:38:39.324765 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3306/6650] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:38:39 2022] DELETE /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:38:39.341849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:39.342456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:39.348646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.349226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.349683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.350426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.351531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.351973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.379275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:38:39.428692 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.compute.api [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Instance is already in deleting state, ignoring this request Aug 29 11:38:39.430361 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e16e4c4-0118-457b-98b7-b6e881f2e2c0 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 204 len: 0 microversion: 2.1 time: 0.092435 Aug 29 11:38:39.431056 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3345/6651] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:38:39 2022] DELETE /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:38:39.439899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:39.442788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:39.449812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.450579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.451029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.451755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.452222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.452663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.511476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "name": "network-vif-plugged", "status": "completed", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:39.521472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:39.522003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:39.523307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:39.535216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] Creating event network-vif-plugged:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h1-854121-10 Aug 29 11:38:39.540996 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-542ce5db-9100-46f9-87bf-edecf8bb2151 req-bd7f1b7e-7472-47cf-9b46-653568884936 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105028 Aug 29 11:38:39.541957 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3346/6652] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:38:39.602311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:39.611045 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2a687dd-2a87-454b-af77-929d85db88b3 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1512 microversion: 2.1 time: 0.175480 Aug 29 11:38:39.611629 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3307/6653] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:39 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:40.634170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:40.634902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:40.642183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:40.643028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:40.643146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:40.643827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:40.644330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:40.644775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:40.784905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cba79588af4e3baf2caf3de2a4c464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aaaa00d000456cb37bc189edaeda6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:40.793326 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-337d50e3-2e94-4c9b-b487-a41c1c191870 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 200 len: 1512 microversion: 2.1 time: 0.164368 Aug 29 11:38:40.794020 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3347/6654] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:40 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:41.425396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb6cfa0-6676-44dc-8b59-1f82391e2191", "name": "network-vif-deleted", "tag": "2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:41.436956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:41.437444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:41.437914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:41.451628 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] Creating event network-vif-deleted:2bc1a976-35b4-4f1a-a4b3-3499c41c2d9d for instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 on n-h1-854121-10 Aug 29 11:38:41.457028 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f51b6714-f826-44ac-9023-40366669f4b7 req-e0c0fa84-cace-49b9-9557-73358faa3202 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035247 Aug 29 11:38:41.457644 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3308/6655] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:41.814704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:41.815337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 8cb6cfa0-6676-44dc-8b59-1f82391e2191] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:41.823547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:41.824052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:41.824513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:41.825854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:41.826329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:41.826774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:41.840931 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] HTTP exception thrown: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Request method failure captured: Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 HTTP/1.1 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKTjeeKktgAlwvjgQgm1CEeK7wW2f7KpAzzapX19U03rT-ltKqj4lOXUoxoYlS7pQtT6uAsizJj7VV1KgVXhhFpBkEnyNqLNzOFSXyQRDPXXthGDdh1hXBCkwW1QU2Nb_uZ_f3bK769VHH0SfqY92Y2aBpPOcIoYt0uRRM7VE7fMnjM Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a8cba79588af4e3baf2caf3de2a4c464 Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8cb6cfa0-6676-44dc-8b59-1f82391e2191'} Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:41.842691 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Returning 404 to user: Instance 8cb6cfa0-6676-44dc-8b59-1f82391e2191 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aae181c9-dc39-4d13-be6c-76ea61ec0485 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191" status: 404 len: 111 microversion: 2.1 time: 0.033392 Aug 29 11:38:41.847080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3348/6656] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:41 2022] GET /compute/v2.1/servers/8cb6cfa0-6676-44dc-8b59-1f82391e2191 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:38:41.854276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d5bc2dbe-65a5-4d8d-9340-f175c8af61f1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '.version_select at 0x7f66cafec160>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:41.874796 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d5bc2dbe-65a5-4d8d-9340-f175c8af61f1 tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376214881" status: 202 len: 0 microversion: 2.1 time: 0.025356 Aug 29 11:38:41.875399 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3309/6657] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 11:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376214881 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:38:42.504908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:42.505435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:42.511540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:42.512026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:42.512480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:42.513226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:42.513657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:42.514122 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:42.528498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] HTTP exception thrown: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Request method failure captured: Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 HTTP/1.1 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKTjeeKktgAlwvjgQgm1CEeK7wW2f7KpAzzapX19U03rT-ltKqj4lOXUoxoYlS7pQtT6uAsizJj7VV1KgVXhhFpBkEnyNqLNzOFSXyQRDPXXthGDdh1hXBCkwW1QU2Nb_uZ_f3bK769VHH0SfqY92Y2aBpPOcIoYt0uRRM7VE7fMnjM Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: a8cba79588af4e3baf2caf3de2a4c464 Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '65d2a0cd-a0a7-411d-a46d-6ecb206867b2'} Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:38:42.530113 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Returning 404 to user: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0880311-0442-405c-9310-4dedde4c16ae tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "DELETE /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 404 len: 111 microversion: 2.1 time: 0.030622 Aug 29 11:38:42.533978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3349/6658] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:38:42 2022] DELETE /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:38:42.542506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:42.543250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] [instance: 65d2a0cd-a0a7-411d-a46d-6ecb206867b2] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:42.550085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:42.550574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:42.551018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:42.551714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:42.552182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:42.552608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:42.566676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] HTTP exception thrown: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Request method failure captured: Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 HTTP/1.1 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKTjeeKktgAlwvjgQgm1CEeK7wW2f7KpAzzapX19U03rT-ltKqj4lOXUoxoYlS7pQtT6uAsizJj7VV1KgVXhhFpBkEnyNqLNzOFSXyQRDPXXthGDdh1hXBCkwW1QU2Nb_uZ_f3bK769VHH0SfqY92Y2aBpPOcIoYt0uRRM7VE7fMnjM Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09aaaa00d000456cb37bc189edaeda6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 09aaaa00d000456cb37bc189edaeda6b Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-674304566 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: a8cba79588af4e3baf2caf3de2a4c464 Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerDiskConfigTestJSON-674304566-project Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '65d2a0cd-a0a7-411d-a46d-6ecb206867b2'} Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:38:42.568361 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] Returning 404 to user: Instance 65d2a0cd-a0a7-411d-a46d-6ecb206867b2 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7abfd5ba-4ee1-46f0-bd13-6be46adc4c4f tempest-ServerDiskConfigTestJSON-674304566 tempest-ServerDiskConfigTestJSON-674304566-project] 10.222.0.47 "GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2" status: 404 len: 111 microversion: 2.1 time: 0.033977 Aug 29 11:38:42.573416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3310/6659] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:42 2022] GET /compute/v2.1/servers/65d2a0cd-a0a7-411d-a46d-6ecb206867b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:38:51.694818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0408024-50a7-41b7-9457-07cc473b5bb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: .version_select at 0x7f66c62db8b0>, body: {"keypair": {"name": "tempest-keypair-119231836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOG2KGAackIwWPHTrD2Ba4zHVF8atOQBZ7ABgr8BZ0Hy+tIW3F0cyTHj5kP4a0ai2klc6vEHReIrAC8Nya1RI6S1ZWWF2Z1a1yiSmNf42/ZPyW/s21c7xaUUcU9CMkWIg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:51.712167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f0408024-50a7-41b7-9457-07cc473b5bb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:38:51.717625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-f0408024-50a7-41b7-9457-07cc473b5bb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:38:51.766401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0408024-50a7-41b7-9457-07cc473b5bb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216963 Aug 29 11:38:51.767011 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3350/6660] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:38:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:53.169794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1046052049", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6360aba1-ad32-413f-91a8-c01968210d62"}], "security_groups": [{"name": "tempest-securitygroup--1302556704"}], "key_name": "tempest-keypair-119231836", "user_data": "}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:53.179883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:53.180550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:53.281951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] validate_networks() for [('6360aba1-ad32-413f-91a8-c01968210d62', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:38:53.672051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:38:53.672481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:38:53.672960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:38:53.673374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:38:53.673819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:38:53.682827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:53.683317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:53.683760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:53.684491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:53.684948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:53.685378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:53.703509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:38:53.708868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:38:53.723249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:38:53.727172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:38:53.778222 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a01124d-4acc-448a-9554-d45d2ebf891e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.612771 Aug 29 11:38:53.779056 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3311/6661] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:38:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:38:53.790337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3abe0d6f-b5b1-4103-b47d-3a3f93056b17 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:53.791574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3abe0d6f-b5b1-4103-b47d-3a3f93056b17 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:53.798145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:53.861541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3abe0d6f-b5b1-4103-b47d-3a3f93056b17 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:53.870280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3abe0d6f-b5b1-4103-b47d-3a3f93056b17 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1238 microversion: 2.1 time: 0.084230 Aug 29 11:38:53.870550 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3351/6662] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:53 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:54.892922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:54.894123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:54.905448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:54.919452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:54.920112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:54.920881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:54.921503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:54.921967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:55.018187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:55.029578 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-adb7e29c-2d8d-4f58-95db-1455c02fd300 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1298 microversion: 2.1 time: 0.141771 Aug 29 11:38:55.030944 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3312/6663] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:54 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:38:56.053420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:56.054118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:56.058619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:38:56.065485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:56.066047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:56.066691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:56.067626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:56.068299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:56.069910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:56.212814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:56.221194 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-36c6156a-6c64-43e5-97b1-7a0987970a1d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.172374 Aug 29 11:38:56.222171 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3352/6664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:56 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:56.338910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:38:56.357387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:56.358704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:56.359977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:56.375803 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] Creating event network-changed:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h2-854121-10 Aug 29 11:38:56.382366 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-97603fad-ed0d-4866-95ab-784f9c41bb72 req-71666c32-f9e6-4e60-8937-d557add0fb28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051303 Aug 29 11:38:56.387608 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3313/6665] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:38:57.242466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:57.243014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:57.250305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:57.250898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:57.251356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:57.252091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:57.252556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:57.252995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:57.395016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:57.403260 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8fa1845f-2767-4dc0-ad16-5cc73d041762 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.165127 Aug 29 11:38:57.403838 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3353/6666] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:57 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:58.426218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:58.426911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:58.433430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:58.433953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:58.434398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:58.435088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:58.435542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:58.435971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:58.571704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:58.580096 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6714f91f-54e2-4e08-ad57-3b5d625079de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.159250 Aug 29 11:38:58.580662 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3314/6667] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:58 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:38:59.601118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:38:59.601772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:38:59.609382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:59.609913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:59.610363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:59.611079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:38:59.611550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:38:59.611992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:38:59.747469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:38:59.755927 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-56ac6f1b-b5fb-49ba-b6c3-7bc015fc7f72 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.159529 Aug 29 11:38:59.757347 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3354/6668] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:38:59 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:00.777365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:00.777997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:00.784044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:00.784536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:00.784976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:00.785668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:00.786146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:00.786573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:00.920524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:00.928962 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-97bbcf1c-058c-40f6-b0d6-12d9526702f9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.155194 Aug 29 11:39:00.929544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3315/6669] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:00 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:01.471897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "name": "network-vif-plugged", "status": "completed", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:01.483705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:01.484206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:01.484701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:01.496412 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] Creating event network-vif-plugged:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h2-854121-10 Aug 29 11:39:01.501600 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-83055c0c-793f-4eae-a143-59a2a3a29cc0 req-5c7af1f9-7dec-4a16-8012-f3cb175909ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Aug 29 11:39:01.502507 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3355/6670] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:01.950600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:01.951217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:01.958552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:01.959052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:01.960135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:01.961190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:01.961659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:01.962144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:02.094619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:02.102941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96952ae1-a1b4-4458-9759-777fc1d4a32e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1364 microversion: 2.1 time: 0.156435 Aug 29 11:39:02.103538 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3316/6671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:01 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:03.124940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:03.125656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:03.133865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:03.134362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:03.134816 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:03.135556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:03.136051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:03.136489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:03.509810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:03.518641 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5c14ca91-17af-48d6-b1a4-e6be65709720 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1552 microversion: 2.1 time: 0.398996 Aug 29 11:39:03.519255 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3356/6672] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:03 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1552 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:03.540446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:03.540994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:03.548394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:03.549117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:03.549565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:03.550349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:03.550813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:03.551356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:03.630474 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e09283b5-575c-4537-8484-175be42b7277 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093973 Aug 29 11:39:03.631134 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3317/6673] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:39:03 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:04.585723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:04.643919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:04.656288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:04.656793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:04.657248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:04.670999 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] Creating event network-changed:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h2-854121-10 Aug 29 11:39:04.676433 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8118a4f5-ae9e-494d-bd25-6d92f4ec10ee req-7b64e3f1-a554-4259-b6f6-d863e82eb0cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095918 Aug 29 11:39:04.677406 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3357/6674] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:34.229270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.230000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.231969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.232755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.237552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:34.238191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:34.246721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.247220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.247661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.248365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.248826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.249258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.385722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:34.393669 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-17bd1952-1307-4c6e-90a9-aaaa739bb0b7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.165316 Aug 29 11:39:34.394260 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3318/6675] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:34 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:34.414608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=11 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.415169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=28 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:34.419113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:34.419920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:34.428598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.430073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.430856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.431914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.432440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.432904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.570059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:34.578194 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-72497d95-a381-4b27-b45f-308a1ac4b806 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.166282 Aug 29 11:39:34.578771 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3358/6676] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:34 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:34.598565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:34.599185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:34.605818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.606318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.606768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.607477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.607939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.608377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.737643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:34.745938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3ea835ae-b198-47e9-9205-9b968025da47 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.151202 Aug 29 11:39:34.746512 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3319/6677] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:34 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:34.766168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:34.768454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:34.775149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.775647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.776099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.776800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.777267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.777730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.805724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:34.811547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:39:34.817899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:39:34.818334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:39:34.819068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:39:34.819244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:39:34.820185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:39:34.883791 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-53821898-b496-4dc1-8bec-d3431e79571c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/action" status: 202 len: 0 microversion: 2.1 time: 0.121699 Aug 29 11:39:34.887364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3359/6678] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:39:34 2022] POST /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:39:34.892498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:34.893115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:34.900022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.900511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.900955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:34.901658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:34.902209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:34.902643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:35.048736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:35.057607 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-84ad3b3b-e9c6-4f50-bc45-a643641e03e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1679 microversion: 2.1 time: 0.168849 Aug 29 11:39:35.058638 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3320/6679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:34 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:36.081323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:36.081986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:36.088765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:36.089264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:36.089721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:36.090455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:36.090921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:36.091360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:36.228469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:36.236849 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5db545e4-ff89-43bb-9d7c-1e6455d038d0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1679 microversion: 2.1 time: 0.160386 Aug 29 11:39:36.237528 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3360/6680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:36 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:37.259594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:37.260133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:37.266996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:37.267487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:37.267932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:37.268631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:37.269093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:37.269527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:37.401319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:37.409146 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a6a0209-97cf-4b09-9018-c4148be57333 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.154594 Aug 29 11:39:37.409828 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3321/6681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:37 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:38.430959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:38.431589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:38.438494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:38.438994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:38.439445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:38.440148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:38.440616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:38.441054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:38.578639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:38.587043 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e37e2115-6578-4cc8-ab09-739fae881f62 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.160250 Aug 29 11:39:38.587623 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3361/6682] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:38 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:39.611058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:39.611694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:39.620072 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:39.620560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:39.621181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:39.621934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:39.622397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:39.622997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:39.754254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:39.762373 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0e6530df-471f-44e2-8f87-7ecfbdfe484c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.155266 Aug 29 11:39:39.762959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3322/6683] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:39 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:39:40.783989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:40.784666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:40.793442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:40.793953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:40.794408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:40.795117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:40.795585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:40.796043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:40.931308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:40.939249 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e084cb4-e0c5-483b-9633-8561aaff0e2a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.159214 Aug 29 11:39:40.939962 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3362/6684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:40 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:41.962642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:41.963259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:41.970289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:41.970781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:41.971233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:41.971936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:41.972401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:41.972840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:42.105806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:42.113662 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c2dc58c-ffd1-42df-839e-c6f6411f0c13 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.155780 Aug 29 11:39:42.114265 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3323/6685] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:41 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:43.134946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:43.135573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:43.142537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:43.143039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:43.143492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:43.144205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:43.144677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:43.145119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:43.277842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:43.285611 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98127869-b9ad-42e7-b929-e7f7fa9784c3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.154885 Aug 29 11:39:43.286291 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3363/6686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:43 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:44.306778 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:44.307399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:44.314691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:44.315182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:44.315634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:44.316336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:44.316798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:44.317246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:44.462799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:44.470750 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8efac8e-e289-4a27-b115-7f2c6baadc5e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.167884 Aug 29 11:39:44.471333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3324/6687] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:44 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:45.494304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:45.494943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:45.501887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:45.502393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:45.502848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:45.503560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:45.504033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:45.504480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:45.637397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:45.645382 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e41b0be-4f13-447e-86d5-c93a9f54ba63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.156405 Aug 29 11:39:45.645997 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3364/6688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:45 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:46.668248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:46.668864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:46.675844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:46.676326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:46.676773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:46.677460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:46.677941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:46.678369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:46.812658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:46.820539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3325e4d0-bd9a-4916-941d-406f2ed960ac tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.156697 Aug 29 11:39:46.821254 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3325/6689] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:46 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:47.842584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:47.843211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:47.850061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:47.850557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:47.851004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:47.851940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:47.852428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:47.852869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:47.988869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:47.997422 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01ed91c0-0114-4cfa-b35a-1dc8f5e5ab75 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1684 microversion: 2.1 time: 0.158680 Aug 29 11:39:47.998029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3365/6690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:47 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:49.020042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:49.020776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:49.028209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:49.028794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:49.029314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:49.030065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:49.030530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:49.030964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:49.169059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:49.173787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "name": "network-vif-unplugged", "status": "completed", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:49.180750 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-16684610-bda8-433f-a74e-739eea2bc234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1683 microversion: 2.1 time: 0.162665 Aug 29 11:39:49.180750 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3326/6691] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:49 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:49.186991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:49.187489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:49.187938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:49.202389 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Creating event network-vif-unplugged:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h1-854121-10 Aug 29 11:39:49.208070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] Instance bbfea663-f73b-46de-b413-30526b3317c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:39:49.219312 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fa9fa0d8-37be-446c-ab2c-3ddb5ae2f209 req-83913b9a-8bbd-497e-aa10-e2fce3b75245 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049926 Aug 29 11:39:49.220428 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3366/6692] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:39:50.202616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:50.203569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:50.211209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:50.211700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:50.212207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:50.212918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:50.213381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:50.213838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:50.353556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:50.361567 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-529ac6f8-a1fb-4e8b-9c8e-34c2be642223 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1681 microversion: 2.1 time: 0.163543 Aug 29 11:39:50.362179 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3327/6693] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:50 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:51.236449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:51.246321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:51.246809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:51.247253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:51.259741 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Creating event network-changed:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h1-854121-10 Aug 29 11:39:51.264992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] Instance bbfea663-f73b-46de-b413-30526b3317c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:39:51.277261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f82475f8-da28-4b78-b07a-603afeb99c6d req-ddbdb9df-a371-4ded-9f6f-abeff553dcd1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045699 Aug 29 11:39:51.277912 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3367/6694] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:51.383703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:51.384644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:51.391337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:51.391829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:51.392274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:51.393165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:51.393637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:51.394101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:51.531041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:51.539727 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4fde094f-8dae-42f6-a45b-528e1eff2377 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1681 microversion: 2.1 time: 0.160641 Aug 29 11:39:51.558407 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3328/6695] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:51 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:52.581461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:52.582224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:52.589014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.589535 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.590022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.590752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.591231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.591680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.726060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:52.734967 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-162b6fef-bd5f-4cac-ae4e-abd59fd1a757 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1678 microversion: 2.1 time: 0.158715 Aug 29 11:39:52.735547 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3368/6696] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:52 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:52.755114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:52.755695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:52.763085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.763571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.764008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.764699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.765160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.765588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.834261 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b0e28146-4955-416c-a838-14bb83692e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/action" status: 204 len: 0 microversion: 2.1 time: 0.082816 Aug 29 11:39:52.834915 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3329/6697] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:39:52 2022] POST /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:39:52.843395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:52.844033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:52.850057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.850653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.851194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.852560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:52.853061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:52.853563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:52.997561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:53.005746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40a9bb77-85df-4858-9c6e-7595511ecc30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1678 microversion: 2.1 time: 0.166219 Aug 29 11:39:53.006328 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3369/6698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:52 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:53.784855 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "name": "network-vif-plugged", "status": "completed", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:53.798808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:53.799651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:53.800114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:53.813794 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Creating event network-vif-plugged:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h1-854121-10 Aug 29 11:39:53.819288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] Instance bbfea663-f73b-46de-b413-30526b3317c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:39:53.831526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-bc65d2cc-6ec1-4cff-b912-7a4f5fa87ff6 req-579d7028-f869-4c6c-824b-00578e2f5836 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050427 Aug 29 11:39:53.832466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3330/6699] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:54.028274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:54.028896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:54.036159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.036597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.037050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.037788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.038259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.038701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.184892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:54.192672 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-59683f7f-cd44-46d5-af8f-f45d912e72f5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.169229 Aug 29 11:39:54.193241 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3370/6700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:54 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:54.214933 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:54.215644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:54.222240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.222733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.223178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.223885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.224348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.224780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.361318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:54.370367 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbdb7e48-1e50-4487-bd64-0329d7bf0839 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.159985 Aug 29 11:39:54.370963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3331/6701] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:54 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:54.390637 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:54.391263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:54.397569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.398112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.398569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.399414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.399882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.400332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.532083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:54.540468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6445966f-0e3d-4391-8aef-4c08da962fe9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1670 microversion: 2.1 time: 0.153337 Aug 29 11:39:54.541050 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3371/6702] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:54 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:54.560616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:54.561050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:54.567096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.567589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.568032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.568755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.569220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.569658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.597077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:39:54.632112 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:39:54.678802 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-184a075b-c190-4c59-a2d9-9e22dac001af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 204 len: 0 microversion: 2.1 time: 0.121803 Aug 29 11:39:54.679368 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3332/6703] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:39:54 2022] DELETE /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:39:54.689815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:54.690461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:54.697247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.697808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.698274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.699000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:54.699730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:54.700179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:54.833596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:54.841720 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4304b9be-1030-431c-9213-5ad24bff66ae tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1676 microversion: 2.1 time: 0.155961 Aug 29 11:39:54.842307 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3372/6704] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:54 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:55.863421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:55.864152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:55.871876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:55.872368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:55.872814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:55.873512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:55.874001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:55.874439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:56.010702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:56.019144 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c24c62ed-95c3-4a16-aeb4-ae7c0e749bb0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 200 len: 1676 microversion: 2.1 time: 0.159939 Aug 29 11:39:56.019738 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3333/6705] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:55 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:39:56.807193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfea663-f73b-46de-b413-30526b3317c0", "name": "network-vif-deleted", "tag": "e6e1fd9b-5243-4710-b0c0-c0230ff14fcc"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:56.824102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:56.824970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:56.825482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:56.841731 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] Creating event network-vif-deleted:e6e1fd9b-5243-4710-b0c0-c0230ff14fcc for instance bbfea663-f73b-46de-b413-30526b3317c0 on n-h1-854121-10 Aug 29 11:39:56.849083 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4e0f91c9-36ed-4996-96cb-0de3863e9630 req-d2de92e4-17a1-4928-bda1-6e5b318d9618 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046473 Aug 29 11:39:56.849930 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3373/6706] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:39:57.041057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:57.041797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:57.049276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.049908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.050429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.051217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.051943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.052475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.068657 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 HTTP/1.1 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'bbfea663-f73b-46de-b413-30526b3317c0'} Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:39:57.070387 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f260013-a4dd-46d9-b379-fda9fac5e7f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 404 len: 111 microversion: 2.1 time: 0.036037 Aug 29 11:39:57.077140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3334/6707] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:57 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:39:57.087891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:57.088617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:57.095049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.095555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.096014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.096736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.097210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.097657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.112498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 HTTP/1.1 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'bbfea663-f73b-46de-b413-30526b3317c0'} Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:39:57.114228 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a7ffbbb-bb67-4f68-8814-eae3a9536268 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 404 len: 111 microversion: 2.1 time: 0.032830 Aug 29 11:39:57.118887 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3374/6708] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:57 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:39:57.168416 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1695136910", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "6360aba1-ad32-413f-91a8-c01968210d62"}], "security_groups": [{"name": "tempest-securitygroup--1302556704"}], "key_name": "tempest-keypair-119231836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:39:57.276307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] validate_networks() for [('6360aba1-ad32-413f-91a8-c01968210d62', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:39:57.670144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:39:57.670587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:39:57.671073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:39:57.671496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:39:57.671914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:39:57.681781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.682277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.682724 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.683470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:57.683934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:57.684370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:57.703212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:39:57.708866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:39:57.722560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:39:57.724867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:39:57.775604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67880585-8d2f-47bb-876e-6bc7c031a978 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.611069 Aug 29 11:39:57.776596 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3335/6709] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:39:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:39:57.787297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b4e55a5e-c324-4b4e-aac4-d5bcba6fd0d4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:57.787929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b4e55a5e-c324-4b4e-aac4-d5bcba6fd0d4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:57.854948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b4e55a5e-c324-4b4e-aac4-d5bcba6fd0d4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:57.867007 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b4e55a5e-c324-4b4e-aac4-d5bcba6fd0d4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1238 microversion: 2.1 time: 0.083629 Aug 29 11:39:57.868894 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3375/6710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:57 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:39:58.889715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:39:58.890374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:39:58.899667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:58.900178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:58.900640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:58.901389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:39:58.902067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:39:58.902669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:39:58.971211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:39:58.982175 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be36921d-a387-4719-b834-546121dcec7b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1308 microversion: 2.1 time: 0.097261 Aug 29 11:39:58.982774 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3336/6711] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:58 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:40:00.005865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:00.006661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:00.017206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:00.018070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:00.018539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:00.019290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:00.019772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:00.020406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:00.027477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:00.188154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:00.199460 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-829571ed-3a1b-4701-a84e-a03fbb85b9aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.198370 Aug 29 11:40:00.200217 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3376/6712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:39:59 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:00.621259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:40:00.635579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:00.636062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:00.636503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:00.650855 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] Creating event network-changed:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h2-854121-10 Aug 29 11:40:00.656468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e834c6b8-c1c4-4579-a9ff-b8968a6212c2 req-f63f5330-3661-4533-9879-3a7fc7daba8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040977 Aug 29 11:40:00.657085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3337/6713] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:40:01.221084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:01.221734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:01.229066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:01.229587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:01.230079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:01.230806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:01.231278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:01.231726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:01.385461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:01.393506 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8ce7024-eb49-4e00-8e47-4d771fcb5f3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.176382 Aug 29 11:40:01.394117 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3377/6714] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:01 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:02.418169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:02.418901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:02.426207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:02.426708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:02.427149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:02.427854 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:02.428316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:02.428750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:02.562649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:02.572526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-196c0d9d-f9e7-4508-88fb-d15a65822a4c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.159457 Aug 29 11:40:02.573115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3338/6715] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:02 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:03.593990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:03.594658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:03.601801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:03.602361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:03.602890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:03.603619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:03.604098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:03.604550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:03.752939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:03.762590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-691f8193-146d-447d-93e1-2c9531cd2d63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.172491 Aug 29 11:40:03.763192 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3378/6716] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:03 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:04.788469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:04.790027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:04.793624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:04.799122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:04.799619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:04.800093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:04.800815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:04.801279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:04.801736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:04.931533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:04.939266 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ca44067-677c-4395-85e3-873128a99e5c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.154897 Aug 29 11:40:04.939864 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3339/6717] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:04 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:05.791730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "name": "network-vif-plugged", "status": "completed", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:40:05.798267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=49 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:05.804803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:05.806596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:05.807064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:05.819013 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] Creating event network-vif-plugged:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h2-854121-10 Aug 29 11:40:05.825357 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-e3511228-8448-4b89-b1b0-71ebf4ba93c2 req-bf085c23-43dd-4e58-8530-89d1c344445b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037876 Aug 29 11:40:05.826418 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3379/6718] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:40:05.960733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:05.962055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:05.970584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:05.971036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:05.971480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:05.972203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:05.972668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:05.973098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:06.114257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:06.122551 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1ba80d17-63bc-492f-b179-087e32155398 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1364 microversion: 2.1 time: 0.165884 Aug 29 11:40:06.123147 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3340/6719] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:05 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:07.145599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:07.146363 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:07.154023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:07.154531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:07.155015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:07.155713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:07.156187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:07.156635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:07.298612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:07.307657 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2b3ab7ce-c252-447e-9dd3-d742198bb68f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1551 microversion: 2.1 time: 0.167715 Aug 29 11:40:07.308241 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3380/6720] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:07 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:07.328792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:07.329338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:07.336382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:07.336864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:07.337331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:07.338033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:07.338490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:07.338916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:07.420938 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c14c0802-2da8-4ae7-a21a-61a1182b86d5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096328 Aug 29 11:40:07.421546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3341/6721] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:40:07 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:40:08.665639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:40:08.670953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:08.679483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:08.680726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:08.681498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:08.694615 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] Creating event network-changed:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h2-854121-10 Aug 29 11:40:08.700482 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0b5ec0b5-ac74-4706-9257-e3cef8007ffb req-0ad5d088-6733-4a72-ba80-3e8101f57d11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Aug 29 11:40:08.701093 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3381/6722] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:40:41.605078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.605981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.608295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.608925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.613608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:40:41.623364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:41.623850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:41.624286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:41.646625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Going to try to stop instance {{(pid=128682) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 11:40:41.690135 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-31c4dc33-8671-46ec-b567-60cfe8b04eb5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action" status: 202 len: 0 microversion: 2.1 time: 0.085399 Aug 29 11:40:41.690749 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3342/6723] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:40:41 2022] POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:40:41.699995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:41.700721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:41.703070 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.703785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=26 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:40:41.709567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:41.710325 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:41.710783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:41.712260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:41.712746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:41.713200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:41.846799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:41.855610 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-038d5302-0f8d-49c5-8cfa-40c8da6f4ffa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.160409 Aug 29 11:40:41.856202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3382/6724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:41 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:42.879090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:42.879800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:42.886699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:42.887199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:42.887649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:42.888352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:42.888816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:42.889252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:43.029028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:43.037029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2050dfcf-6993-4bd7-aea2-8f523c40ccc4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.163152 Aug 29 11:40:43.037610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3343/6725] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:42 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:44.059930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:44.060636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:44.068616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:44.069061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:44.069512 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:44.070345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:44.070894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:44.071337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:44.204602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:44.213213 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7255ecb-4c1a-4e28-bbf8-60666ea821fd tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.157327 Aug 29 11:40:44.225722 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3383/6726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:44 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:45.234267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:45.234890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:45.242365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:45.242910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:45.243391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:45.244104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:45.244566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:45.244994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:45.382114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:45.390712 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6bee570b-b249-472d-a7ee-49d5df5659b2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.160405 Aug 29 11:40:45.391296 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3344/6727] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:45 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:46.414829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:46.415492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:46.422269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:46.422773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:46.423229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:46.423943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:46.424416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:46.424858 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:46.552933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:46.561607 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-714fd982-bf9a-486c-b76a-bd976dd7b0e0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.151460 Aug 29 11:40:46.562236 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3384/6728] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:46 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:47.584903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:47.585522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:47.591675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:47.592161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:47.592603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:47.593299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:47.593784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:47.594218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:47.722386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:47.730954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-57d1616f-f0aa-4e3b-b93b-5dbeb683accf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.150819 Aug 29 11:40:47.731532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3345/6729] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:47 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:48.753084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:48.753760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:48.761739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:48.762241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:48.762695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:48.763404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:48.763873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:48.764315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:48.900014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:48.907970 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78868f6d-6892-4cec-bc36-54939128533c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.158849 Aug 29 11:40:48.908551 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3385/6730] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:48 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:49.929323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:49.930166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:49.937134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:49.937617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:49.938114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:49.938796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:49.939254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:49.939683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:50.081675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:50.090361 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9f4eb95-fd78-4cf0-a283-e5830b74999e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.165008 Aug 29 11:40:50.090959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3346/6731] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:49 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:51.111457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:51.112100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:51.119699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:51.120203 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:51.120659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:51.121377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:51.121879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:51.122332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:51.259248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:51.267011 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b7da391b-d629-4901-87cb-663944643730 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.159511 Aug 29 11:40:51.267586 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3386/6732] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:51 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:52.288226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:52.291015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:52.298121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:52.298609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:52.299043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:52.299749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:52.300206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:52.300635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:52.436893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:52.444711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6e51284-38a3-47a7-acd7-2d0f8b92d8fe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.160498 Aug 29 11:40:52.445347 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3347/6733] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:52 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:53.466572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:53.467196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:53.474261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:53.474775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:53.475216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:53.475923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:53.477104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:53.477797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:53.614895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:53.623092 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac443886-4e20-488a-8f31-be25c7d98924 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.160404 Aug 29 11:40:53.623678 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3387/6734] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:53 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:54.644701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:54.645225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:54.652669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:54.653147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:54.653590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:54.654306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:54.654764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:54.655191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:54.791607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:54.799412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-714be406-81c4-4f15-ba89-48e59b3a1ce7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.158813 Aug 29 11:40:54.799986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3348/6735] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:54 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:55.821303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:55.821970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:55.829038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:55.829533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:55.830087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:55.830794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:55.831388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:55.831832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:55.962305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:55.970116 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cbab7b78-91a1-4283-8891-20edc49141a9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.153222 Aug 29 11:40:55.970697 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3388/6736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:55 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:56.991735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:56.992638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:56.999768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.000291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.000737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.001598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.002104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.002535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.141871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:57.150518 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b2553ba-e64a-4295-8dbf-61f471eeab3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1656 microversion: 2.1 time: 0.162648 Aug 29 11:40:57.151106 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3349/6737] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:56 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:57.171394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:40:57.173727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:57.181131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.181627 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.182114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.182822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.183290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.183731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.212713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:57.218653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:40:57.225065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:40:57.225499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:40:57.226097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:40:57.227271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:40:57.227701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:40:57.291542 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-abb33bf6-cdb9-4bcd-97cc-b1136e7c407f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action" status: 202 len: 0 microversion: 2.1 time: 0.123951 Aug 29 11:40:57.292122 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3389/6738] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:40:57 2022] POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:40:57.300554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:57.301205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:57.307487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.307982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.308479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.309297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:57.309774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:57.310217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:57.461582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:57.470495 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9213cc76-712f-4dcd-911d-0bb01e7f668b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.173879 Aug 29 11:40:57.471078 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3350/6739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:57 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:58.493420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:58.494016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:58.501267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:58.501824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:58.502286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:58.503207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:58.503702 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:58.504139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:58.644048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:58.652730 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-467c0b57-980f-4738-b2dd-cead34e04b7a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1679 microversion: 2.1 time: 0.164446 Aug 29 11:40:58.653425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3390/6740] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:58 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:40:59.675168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:40:59.675783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:40:59.682916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:59.683403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:59.683847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:59.684551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:40:59.685008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:40:59.685439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:40:59.814241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:40:59.822451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c22c9a3-d21f-4502-8529-006c91bd5d1c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1684 microversion: 2.1 time: 0.151208 Aug 29 11:40:59.823028 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3351/6741] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:40:59 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:00.843404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:00.844035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:00.851421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:00.852180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:00.852565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:00.853455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:00.853953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:00.854394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:00.998149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:01.006144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-380411c1-deba-4be8-8715-3ec8794a6c7d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1684 microversion: 2.1 time: 0.166730 Aug 29 11:41:01.006932 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3391/6742] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:00 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:01.441582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "name": "network-vif-unplugged", "status": "completed", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:01.452069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:01.452764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:01.452998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:01.465529 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Creating event network-vif-unplugged:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h1-854121-10 Aug 29 11:41:01.471200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:41:01.483127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-df6b837f-902e-4e52-97cc-9d43322af306 req-f59e44fc-f754-4015-a755-3ae1cc190b88 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111021 Aug 29 11:41:01.483747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3352/6743] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:02.029311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:02.029968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:02.036089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:02.036591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:02.037044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:02.037776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:02.038247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:02.038682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:02.190971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:02.200102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77acb94a-08e6-4546-ac2b-8906c76550af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1683 microversion: 2.1 time: 0.176242 Aug 29 11:41:02.200925 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3392/6744] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:02 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:03.223692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:03.224534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:03.231571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:03.232063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:03.232500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:03.233258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:03.233730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:03.234172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:03.379603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:03.390120 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f179647b-0555-4302-a85a-156769d0a548 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1681 microversion: 2.1 time: 0.170835 Aug 29 11:41:03.390720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3353/6745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:03 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:03.498168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:03.509781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:03.510277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:03.510718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:03.523192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Creating event network-changed:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h1-854121-10 Aug 29 11:41:03.530407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:41:03.543401 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b313cdf1-693a-4c5f-9bb8-02b7f75fe9ff req-08fd7608-76c3-4957-9d3b-d8055ac125ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049118 Aug 29 11:41:03.544015 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3393/6746] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:04.416824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:04.417455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:04.424880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.425394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.425885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.426624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.427090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.427531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.577949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:04.586192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bdd8aa46-5fa6-4583-a0d1-20845f4b52d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1677 microversion: 2.1 time: 0.173330 Aug 29 11:41:04.587034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3354/6747] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:04 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:04.608378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:04.609116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:04.615856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.616447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.616989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.618373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.618928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.619425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.681873 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82997a36-be1d-43e4-87ae-802d0c41157f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action" status: 204 len: 0 microversion: 2.1 time: 0.078563 Aug 29 11:41:04.682558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3394/6748] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:41:04 2022] POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:41:04.691028 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:04.691673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:04.698845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.699554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.699785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.700578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:04.701140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:04.701605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:04.924086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:04.932596 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d07c4b7a-6e63-495a-b7f7-2b812df21537 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1677 microversion: 2.1 time: 0.245702 Aug 29 11:41:04.933208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3355/6749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:04 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:05.957059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:05.957817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:05.966160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:05.966734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:05.967191 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:05.968098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:05.968459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:05.969012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.138222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:06.146893 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4afdd3a3-8bd5-4d28-a21b-e8c01edff4c8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1656 microversion: 2.1 time: 0.195746 Aug 29 11:41:06.147699 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3395/6750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:05 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:06.168653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:06.169347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:06.176704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:06.177199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:06.177643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.178447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:06.178911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:06.179360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.320062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:06.328837 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2214451a-566c-4c06-9b4b-3edb6121f860 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1656 microversion: 2.1 time: 0.164826 Aug 29 11:41:06.329416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3356/6751] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:06 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:06.349382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:06.356648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:06.357161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:06.357620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.372339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:06.384375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Going to try to start instance {{(pid=128681) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 11:41:06.429237 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ed0b099a-3814-4e11-bcd3-95f846f96c0c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action" status: 202 len: 0 microversion: 2.1 time: 0.083293 Aug 29 11:41:06.429895 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3396/6752] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:41:06 2022] POST /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:41:06.439184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:06.440174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:06.447844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:06.448863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:06.449382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.450206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:06.450903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:06.451512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:06.607070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:06.611205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:06.616197 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed8000d5-07bb-4e19-a138-a92de85a55a8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1665 microversion: 2.1 time: 0.181280 Aug 29 11:41:06.616796 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3357/6753] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:06 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:07.639107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:07.639818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:07.646922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.647419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.647869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:07.649182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.649650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.650113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:07.785189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:07.793593 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f0b58b32-492d-4484-ada7-536049de2065 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1669 microversion: 2.1 time: 0.158848 Aug 29 11:41:07.794204 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3397/6754] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:07 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:07.814440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:07.814970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:07.823720 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.824220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.824666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:07.825365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.825861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.826293 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:07.853946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:41:07.938242 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-88d82dda-1aee-496e-8807-006e324554d7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 204 len: 0 microversion: 2.1 time: 0.127726 Aug 29 11:41:07.938792 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3358/6755] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:41:07 2022] DELETE /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:41:07.947801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:07.948436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:07.954769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.955275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.955729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:07.956449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:07.956918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:07.957357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:08.112423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:08.116989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "name": "network-vif-plugged", "status": "completed", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:08.122218 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bbe9e9f0-50de-41a9-be8c-c4250c4eef18 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1675 microversion: 2.1 time: 0.178694 Aug 29 11:41:08.122781 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3398/6756] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:07 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:08.129866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:08.130948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:08.131394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:08.144405 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] Creating event network-vif-plugged:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h1-854121-10 Aug 29 11:41:08.150135 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0cd1443f-3280-4b54-a75d-a62345b8dbed req-edfb545e-d351-4e0a-830a-ad8445d7bc8f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037169 Aug 29 11:41:08.150939 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3359/6757] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:09.144550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:09.145183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:09.152387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:09.152893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:09.153352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:09.154096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:09.154572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:09.155015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:09.285469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:09.294197 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf6d2b63-b055-47e3-a5bd-fc795dc17e58 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1675 microversion: 2.1 time: 0.153491 Aug 29 11:41:09.294809 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3399/6758] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:09 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:10.072175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0", "name": "network-vif-deleted", "tag": "62811c07-9750-4f3a-b1b6-d93cf9d0f406"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:10.100719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:10.101350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:10.102647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:10.117957 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] Creating event network-vif-deleted:62811c07-9750-4f3a-b1b6-d93cf9d0f406 for instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 on n-h1-854121-10 Aug 29 11:41:10.124432 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-93c587c8-e606-461f-bb25-7b75a8a6db8b req-b6e5c0cd-fefe-4c52-86fd-a936009fc6b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058610 Aug 29 11:41:10.125369 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3360/6759] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:10.317061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:10.317690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:10.325385 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:10.325915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:10.326374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:10.327089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:10.327560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:10.328001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:10.363277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:10.363769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:10.364219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:10.364697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lazy-loading 'fault' on Instance uuid 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:41:10.412365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:10.421958 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d26883df-2c0b-48b9-87ec-e0e26b653e74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 200 len: 1328 microversion: 2.1 time: 0.108810 Aug 29 11:41:10.422792 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3400/6760] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:10 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:11.448178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:11.449081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:11.455288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:11.455774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:11.456218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:11.456914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:11.457370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:11.457832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:11.471243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 HTTP/1.1 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0'} Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:41:11.472877 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-47e4946b-168b-4c77-8f5c-f23fdbe35366 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 404 len: 111 microversion: 2.1 time: 0.034090 Aug 29 11:41:11.478418 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3361/6761] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:11 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:41:11.493282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:11.493914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:11.500846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:11.501348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:11.501825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:11.502563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:11.503033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:11.503468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:11.518128 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 HTTP/1.1 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0'} Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:41:11.519831 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:41:11.524613 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-15a8b8da-ab44-4c7c-a4d3-bb3bb06fcbb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 404 len: 111 microversion: 2.1 time: 0.032548 Aug 29 11:41:11.525409 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3401/6762] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:11 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:41:11.570769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1072407001", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "6360aba1-ad32-413f-91a8-c01968210d62"}], "security_groups": [{"name": "tempest-securitygroup--1302556704"}], "key_name": "tempest-keypair-119231836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:11.678017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] validate_networks() for [('6360aba1-ad32-413f-91a8-c01968210d62', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:41:11.857349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:12.097146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:41:12.097601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:41:12.098116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:41:12.098564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:41:12.098979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:41:12.109589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:12.110104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:12.110547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:12.111278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:12.111739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:12.112393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:12.130282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:41:12.136003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:41:12.148999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:41:12.151391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:41:12.198406 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c96fc917-7b11-4ce3-ad9a-e02d6cff599d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.631589 Aug 29 11:41:12.199330 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3362/6763] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:41:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:41:12.210377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6e75993c-6f85-4913-9ab0-aed5bb2c5e67 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:12.212081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6e75993c-6f85-4913-9ab0-aed5bb2c5e67 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:12.214309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=47 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:12.270500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6e75993c-6f85-4913-9ab0-aed5bb2c5e67 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:12.279072 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6e75993c-6f85-4913-9ab0-aed5bb2c5e67 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1238 microversion: 2.1 time: 0.072644 Aug 29 11:41:12.279650 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3402/6764] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:12 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:13.303160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:13.304774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:13.313541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:13.314063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:13.314506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:13.315217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:13.315674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:13.316106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:13.381957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:13.390861 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ed673878-954c-4ef4-8469-49202bb474e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1296 microversion: 2.1 time: 0.093966 Aug 29 11:41:13.391448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3363/6765] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:13 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:14.412849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:14.413492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:14.422620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:14.423117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:14.423578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:14.424315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:14.424791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:14.425240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:14.549423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:14.565768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:14.567118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:14.567735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:14.578785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:14.581745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] Creating event network-changed:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:41:14.587209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e62ed35f-46cf-4264-80aa-22601dee7948 req-104a2b1b-13bc-4133-bb21-a48344ee9747 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045769 Aug 29 11:41:14.588027 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3364/6766] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:14.588907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e8bd9ac8-4dc1-476f-bc5e-9c0897610d10 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.179933 Aug 29 11:41:14.589572 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3403/6767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:14 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:15.611452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:15.612163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:15.619894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:15.620388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:15.620831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:15.621540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:15.622050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:15.622488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:15.754202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:15.763354 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-238bef73-f41f-4241-b251-60c6b502d381 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.156168 Aug 29 11:41:15.763952 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3365/6768] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:15 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:16.784622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:16.785254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:16.792566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:16.793072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:16.793524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:16.794281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:16.794746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:16.795182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:16.922826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:16.930728 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d34027d8-13c3-4747-8c38-6dfa768ccf3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.150077 Aug 29 11:41:16.931381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3404/6769] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:16 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:17.951801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:17.952414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:17.959772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:17.960304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:17.960923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:17.961898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:17.962403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:17.962842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:18.113946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:18.123012 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9c4591fe-7a1f-4c62-9bc2-5a69efd33c22 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.175301 Aug 29 11:41:18.123630 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3366/6770] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:17 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:19.144307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:19.144974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:19.152842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:19.153352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:19.153845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:19.154569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:19.155050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:19.155498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:19.291660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:19.300158 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-977cb2bf-8e7a-4b33-b2a6-c3e0e3ed7653 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.159749 Aug 29 11:41:19.300786 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3405/6771] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:19 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:20.155445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "name": "network-vif-plugged", "status": "completed", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:20.167066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:20.167564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:20.168004 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:20.179536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] Creating event network-vif-plugged:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:41:20.184597 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4bb4974b-27e3-4b41-98a5-8745546632b1 req-3af296ae-43bd-44da-b85d-9bb7dc5e87b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Aug 29 11:41:20.185368 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3367/6772] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:20.322859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:20.323768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:20.331096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:20.331606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:20.332062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:20.332786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:20.333270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:20.333835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:20.474562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:20.485222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-73b032fe-cb0b-4b96-a953-0fe66ef2e281 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1364 microversion: 2.1 time: 0.166156 Aug 29 11:41:20.485959 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3406/6773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:20 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:21.508549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:21.509251 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:21.515574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:21.516066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:21.516510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:21.517207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:21.517667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:21.518130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:21.652062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:21.659895 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e8f0df9-fde7-4f4c-bd37-0cfd39b5dbb9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1552 microversion: 2.1 time: 0.156847 Aug 29 11:41:21.660468 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3368/6774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:21 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:41:21.683649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:21.684162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:21.691017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:21.691516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:21.691967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:21.692718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:21.693205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:21.693642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:21.770713 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adb67dea-ceeb-4bdd-ac27-159df1bc4e9e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092405 Aug 29 11:41:21.771319 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3407/6775] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:41:21 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:22.979148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:22.988912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:22.989594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:22.993053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:22.993545 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:22.994027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:23.006155 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] Creating event network-changed:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:41:23.012178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1aad7dde-8323-4494-b80e-84da456179e7 req-659707ee-34ad-4530-84b2-3e6a5dec9b58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037076 Aug 29 11:41:23.012799 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3369/6776] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:41:58.834948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:58.837802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=13 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:58.838469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:58.839847 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:41:58.840590 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/action (ip 10.222.0.47) !!! Aug 29 11:41:58.846167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:41:58.848425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:58.861307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:58.861975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:58.862570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:58.863312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:58.863794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:58.864244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:58.896398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:58.903248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:41:58.911023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:41:58.911463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:41:58.911961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:41:58.912395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:41:58.912827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:41:58.978259 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-267c979c-fb9f-47d5-ba5d-64878bb3dc6d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/action" status: 202 len: 0 microversion: 2.1 time: 0.143864 Aug 29 11:41:58.979103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3408/6777] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:41:58 2022] POST /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:41:58.988747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:41:58.989524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:41:58.993040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:58.993780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:41:58.994969 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:41:58.995134 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf (ip 10.222.0.47) !!! Aug 29 11:41:59.009317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:59.009851 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:59.010301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:59.011022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:41:59.011486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:41:59.012504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:41:59.156519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:41:59.165570 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9376ae9-c65e-4770-80ef-fb7a70b8e0a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1679 microversion: 2.1 time: 0.181329 Aug 29 11:41:59.166223 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3370/6778] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:41:58 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:00.188061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:00.188764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:00.194997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:00.195504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:00.195961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:00.196673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:00.197149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:00.197596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:00.334260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:00.344242 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8dfc9187-8d10-42c6-b3bd-dcbee449523f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1679 microversion: 2.1 time: 0.161052 Aug 29 11:42:00.344892 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3409/6779] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:00 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:01.371771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:01.372492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:01.378861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:01.379350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:01.379787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:01.380489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:01.380942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:01.381368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:01.517725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:01.526057 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a749586f-b781-4e2e-96e2-6036490c7ed4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.158749 Aug 29 11:42:01.526656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3371/6780] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:01 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:02.547839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:02.548471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:02.555430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:02.555927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:02.556383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:02.557091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:02.557566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:02.558041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:02.687077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:02.695004 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b3000d0-2d49-463f-9035-64b9a548bf8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.151239 Aug 29 11:42:02.695577 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3410/6781] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:02 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:03.720407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:03.721584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:03.729263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:03.729773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:03.730219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:03.731349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:03.731818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:03.732254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:03.869513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:03.878069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6c2eb215-8a32-4adf-a66e-a46c5b6392aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.164929 Aug 29 11:42:03.878686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3372/6782] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:03 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:04.899447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:04.900072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:04.907615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:04.908112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:04.908586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:04.909274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:04.910352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:04.910797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:05.053949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:05.062458 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-23fab842-7702-4a29-a287-f69d753d5082 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.166924 Aug 29 11:42:05.063045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3411/6783] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:04 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:06.085587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:06.086235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:06.094348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:06.094829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:06.095269 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:06.095965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:06.096421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:06.096848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:06.229833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:06.238198 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-405066ab-1d57-4b55-bf40-ef54a69526c0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.156395 Aug 29 11:42:06.238715 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3373/6784] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:06 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:07.259257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:07.259879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:07.267440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:07.267931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:07.268381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:07.269084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:07.269548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:07.270020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:07.403733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:07.411795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9bfcefc8-f740-4bbe-9e19-f786ce9814cc tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.156525 Aug 29 11:42:07.412377 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3412/6785] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:07 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:08.433150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:08.433880 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:08.441309 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:08.441842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:08.442378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:08.443096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:08.443559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:08.443995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:08.576733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:08.584740 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4330310-3416-43d7-9fb7-79d6f9b8b12e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.155531 Aug 29 11:42:08.585305 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3374/6786] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:08 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:09.607523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:09.608183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:09.615962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:09.616463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:09.616919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:09.617646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:09.618157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:09.618604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:09.760661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:09.769470 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bb17842e-3c3e-4c71-b75a-413e8d87d597 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.165989 Aug 29 11:42:09.770088 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3413/6787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:09 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:10.790649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:10.791261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:10.799212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:10.799703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:10.800154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:10.800881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:10.801364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:10.801825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:10.936183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:10.944047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-03a49180-34bf-4ef6-bd1a-f770e7a5444e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.157380 Aug 29 11:42:10.944624 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3375/6788] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:10 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:11.966567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:11.967113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:11.974034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:11.974536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:11.974987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:11.975698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:11.976169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:11.976608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:12.112571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:12.120234 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27f16b7d-e4ae-4193-8fe7-6499e5472253 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.158347 Aug 29 11:42:12.120844 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3414/6789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:11 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:13.141553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:13.142198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:13.149131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:13.149618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:13.150096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:13.150799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:13.151258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:13.151698 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:13.289954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:13.297965 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b284a04-b67e-4347-bde7-49807abc8cff tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.161151 Aug 29 11:42:13.298559 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3376/6790] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:13 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:14.319968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:14.320670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:14.330248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:14.331067 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:14.331784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:14.332847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:14.333596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:14.334346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:14.469481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:14.477486 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-39a318f8-1463-4e41-9760-02722e3fd5cf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.161930 Aug 29 11:42:14.478091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3415/6791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:14 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:15.498771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:15.499392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:15.507212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:15.507712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:15.508196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:15.508911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:15.509377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:15.509857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:15.644347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:15.652754 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a3b83712-93c2-4c75-a044-1e2234e72b06 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.157731 Aug 29 11:42:15.653355 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3377/6792] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:15 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:16.674128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:16.674762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:16.681405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:16.682416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:16.682871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:16.684180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:16.684647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:16.685089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:16.815762 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:16.824261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0274881c-b110-4bd7-9903-053f63a50fb8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1684 microversion: 2.1 time: 0.153773 Aug 29 11:42:16.824596 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3416/6793] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:16 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:17.844910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:17.845511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:17.852541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:17.853029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:17.853472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:17.854201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:17.854654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:17.855367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:18.091705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:18.100318 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f99acb75-39f9-4671-a0ef-bb31f40580f7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1683 microversion: 2.1 time: 0.259509 Aug 29 11:42:18.100916 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3378/6794] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:17 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:42:18.326567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "name": "network-vif-unplugged", "status": "completed", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:18.337743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:18.338345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:18.338949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:18.352276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Creating event network-vif-unplugged:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h2-854121-10 Aug 29 11:42:18.358612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:42:18.369969 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9c6cc1e0-2d15-474f-a6ab-d6303b7e01f7 req-a9394688-9511-40e2-98fa-5716fbc69a8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047580 Aug 29 11:42:18.371325 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3417/6795] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:19.123308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:19.123941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:19.130877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:19.131364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:19.131817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:19.132528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:19.132994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:19.133432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:19.346871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:19.354677 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3bb3b5c3-4c51-4098-a45c-9bf1ae61d3b3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1683 microversion: 2.1 time: 0.235885 Aug 29 11:42:19.355748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3379/6796] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:19 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:20.377726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:20.378357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:20.384619 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:20.385112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:20.385561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:20.386787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:20.387265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:20.387697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:20.403593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:20.414076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:20.414573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:20.415015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:20.428569 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Creating event network-changed:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h2-854121-10 Aug 29 11:42:20.434856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:42:20.446542 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-20982d45-8a82-4018-b206-bf0c4f1ad3d8 req-4df60da8-fa1f-4a87-9c17-390bb61abb90 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047231 Aug 29 11:42:20.447163 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3380/6797] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:42:20.538916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:20.547792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-485ddbb2-dc0b-4e49-a9b5-589c775f2736 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1681 microversion: 2.1 time: 0.175614 Aug 29 11:42:20.548393 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3418/6798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:20 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:42:21.570887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:21.571508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:21.578663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.579150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.579591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.580279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.580730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.581155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.712750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:21.720808 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-94da728c-b5c5-47ff-8276-fc44ca459b30 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1678 microversion: 2.1 time: 0.155302 Aug 29 11:42:21.721376 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3381/6799] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:21 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:21.741024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:21.741570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:21.749251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.749780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.750243 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.751075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.751559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.752046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.793138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.793622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.794098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.794896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.795314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.795755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.817561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:42:21.823015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:42:21.926238 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04b2c877-e167-4d01-a8e4-a090ca4d4b3d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/action" status: 202 len: 0 microversion: 2.1 time: 0.188981 Aug 29 11:42:21.926858 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3419/6800] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:42:21 2022] POST /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:42:21.935906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:21.936533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:21.943447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.943966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.944409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:21.945123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:21.945919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:21.946361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:22.159923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:22.176228 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf5ebf9d-2131-4d82-8039-8ef707f73e2f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1677 microversion: 2.1 time: 0.244393 Aug 29 11:42:22.177435 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3382/6801] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:21 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:23.200065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:23.200691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:23.210207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:23.210812 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:23.211275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:23.211998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:23.212465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:23.212932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:23.233743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:23.357394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:23.365593 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9057199-4a27-45dc-96e5-08f82be51eb3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1677 microversion: 2.1 time: 0.170930 Aug 29 11:42:23.366215 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3420/6802] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:23 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:24.387872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:24.388412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:24.395492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:24.395981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:24.396464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:24.397193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:24.397736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:24.398185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:24.539068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:24.547525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4dbfa99-2f82-4e42-b8f2-dbc4ebfa884e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1677 microversion: 2.1 time: 0.164342 Aug 29 11:42:24.548108 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3383/6803] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:24 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:24.729554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "name": "network-vif-plugged", "status": "completed", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:24.744422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:24.744422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:24.744772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:24.757743 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Creating event network-vif-plugged:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:42:24.764290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:42:24.778973 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-ece7cc54-0090-41f7-9105-79c440e487ca req-be47f455-a5cf-4d7f-8cef-0d6ced71854a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053666 Aug 29 11:42:24.779898 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3421/6804] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:25.369591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "name": "network-vif-unplugged", "status": "completed", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:25.380577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:25.381147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:25.381685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:25.395439 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Creating event network-vif-unplugged:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:42:25.400861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:42:25.412807 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-68f5b7b8-3cde-4e7b-8fa0-69774d594941 req-bc3123f7-4333-4ee6-924a-1904411d4ccf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046955 Aug 29 11:42:25.413748 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3384/6805] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:25.569263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:25.569936 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:25.577390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:25.577935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:25.578400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:25.579126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:25.579606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:25.580050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:25.717670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:25.725790 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-023197bd-a46f-456f-ba20-17c98078b975 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1677 microversion: 2.1 time: 0.160960 Aug 29 11:42:25.726376 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3422/6806] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:25 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:26.750266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:26.750969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:26.757317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:26.757838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:26.758283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:26.758984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:26.759441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:26.759873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:26.893336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:26.901138 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-61e294d8-63a4-4640-8ef4-9cbbaeeb0676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1677 microversion: 2.1 time: 0.156888 Aug 29 11:42:26.901767 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3385/6807] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:26 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:27.453280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:27.463454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:27.463946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:27.465424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:27.476872 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Creating event network-changed:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:42:27.483525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:42:27.494156 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-57d68d48-1b94-4876-ad00-cc0caf2ec98e req-04d082ef-84cd-484d-8f20-c6a33a6a6c1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045222 Aug 29 11:42:27.494747 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3423/6808] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:27.922437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:27.923063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:27.931642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:27.932147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:27.932595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:27.933320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:27.933973 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:27.934588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.159672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:28.168528 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32f0371c-f518-46e4-ba80-742de9f04863 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1670 microversion: 2.1 time: 0.250119 Aug 29 11:42:28.169371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3386/6809] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:27 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:28.190187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:28.190904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:28.197029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.197534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.198298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.199744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.200226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.200667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.339763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:28.347639 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8cd3bf1b-575f-45bc-af9e-6ff5fec91af5 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1670 microversion: 2.1 time: 0.161700 Aug 29 11:42:28.348205 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3424/6810] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:28 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:28.367035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:28.367712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:28.374220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.374708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.375142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.375836 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.376286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.376710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.380896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=100 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:28.509532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:28.518203 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba47778a-ebf0-4ebd-81af-a193a05bb66f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1670 microversion: 2.1 time: 0.154947 Aug 29 11:42:28.518790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3387/6811] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:28 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:28.539341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:28.539874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:28.547281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.547789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.548241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.548959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.549431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.549904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.578990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:42:28.673930 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-329ccdfe-321b-48e2-b2e1-b76a67515de6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 204 len: 0 microversion: 2.1 time: 0.138241 Aug 29 11:42:28.674639 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3425/6812] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:42:28 2022] DELETE /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:42:28.683334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:28.684601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:28.691832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.692452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.692969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.693837 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:28.694548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:28.695205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:28.834494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:28.843159 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2e2c92d-6c5f-4c3e-b662-7b991db06a2b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1676 microversion: 2.1 time: 0.164043 Aug 29 11:42:28.843728 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3388/6813] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:28 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:29.865089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:29.865840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:29.868580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:29.875799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:29.876297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:29.876750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:29.877468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:29.877971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:29.878410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:30.016495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:30.026480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-404ac79f-ded7-4b43-b462-1e6031389695 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1676 microversion: 2.1 time: 0.165572 Aug 29 11:42:30.027094 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3426/6814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:29 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:30.785693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85439a-3c87-4a84-9b4a-12343aeb85bf", "name": "network-vif-deleted", "tag": "3a712146-a1ac-4a79-bf35-1c57e4c3972a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:30.793013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=39 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:30.801510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:30.802102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:30.802617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:30.816672 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] Creating event network-vif-deleted:3a712146-a1ac-4a79-bf35-1c57e4c3972a for instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf on n-h1-854121-10 Aug 29 11:42:30.827796 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8449b2eb-8b83-4f4b-ad4f-43b7c37ddb02 req-8a9b0d1a-37ce-4d53-9110-67a6d83b5bb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045875 Aug 29 11:42:30.828824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3389/6815] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:31.054211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:31.054841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:31.063492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:31.063998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:31.064458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:31.065224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:31.065689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:31.066161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:31.100857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:31.101366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:31.101891 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:31.102295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lazy-loading 'fault' on Instance uuid 6d85439a-3c87-4a84-9b4a-12343aeb85bf {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:42:31.149005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:31.157578 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-37c8941a-7788-4e0d-928e-dc8511532bf2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 200 len: 1328 microversion: 2.1 time: 0.107362 Aug 29 11:42:31.158260 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3427/6816] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:31 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:42:32.180166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:32.180871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:32.188322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.188818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.189263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.189993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.190455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.190887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.205063 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf HTTP/1.1 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6d85439a-3c87-4a84-9b4a-12343aeb85bf'} Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:42:32.206747 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1393eabd-25d2-473b-b771-10f61927a74c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 404 len: 111 microversion: 2.1 time: 0.032289 Aug 29 11:42:32.211187 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3390/6817] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:32 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:42:32.227354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:32.227979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:32.229890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:32.236725 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.237224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.237727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.238439 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.238908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.239347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.253049 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf HTTP/1.1 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6d85439a-3c87-4a84-9b4a-12343aeb85bf'} Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:42:32.254738 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1bd21917-7d66-4e2f-8f10-dc793d107b8f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 404 len: 111 microversion: 2.1 time: 0.032753 Aug 29 11:42:32.260792 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3428/6818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:32 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:42:32.307311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1688976244", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "6360aba1-ad32-413f-91a8-c01968210d62"}], "security_groups": [{"name": "tempest-securitygroup--1302556704"}], "key_name": "tempest-keypair-119231836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:32.421748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] validate_networks() for [('6360aba1-ad32-413f-91a8-c01968210d62', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:42:32.794311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:42:32.794770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:42:32.795249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:42:32.795658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:42:32.796070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:42:32.805516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.805956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.806404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.807128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:32.807579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:32.808011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:32.826024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:42:32.831280 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:42:32.843966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:42:32.846358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:42:32.893292 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c0d6edba-41b2-42f1-bad2-988eb3e06d40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.590232 Aug 29 11:42:32.893975 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3391/6819] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:42:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:42:32.905915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e2c24ae-7470-4274-a5ab-ac9fe8035b44 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:32.906552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e2c24ae-7470-4274-a5ab-ac9fe8035b44 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:32.962923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9e2c24ae-7470-4274-a5ab-ac9fe8035b44 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:32.970443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e2c24ae-7470-4274-a5ab-ac9fe8035b44 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1238 microversion: 2.1 time: 0.069197 Aug 29 11:42:32.971029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3429/6820] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:32 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:33.993609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:33.994257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:34.002056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:34.002582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:34.003032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:34.003738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:34.004207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:34.004643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:34.068678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:34.077954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ea79a1ca-498e-46c0-80a3-e1ae0c4855ad tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1298 microversion: 2.1 time: 0.089058 Aug 29 11:42:34.078531 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3392/6821] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:33 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:35.100318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:35.100948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:35.108076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:35.108582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:35.109033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:35.109776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:35.110252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:35.110691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:35.334699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:35.343240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d2ed1abf-c767-4446-94c6-699f147bccaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.247739 Aug 29 11:42:35.343821 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3430/6822] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:35 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:35.516069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:35.530574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:35.531066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:35.531520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:35.545626 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] Creating event network-changed:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:42:35.551137 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b6b9445a-c7d4-49d3-b2be-1864d655c60a req-1792c253-cb19-4d28-8dc7-9c8b581d11fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039271 Aug 29 11:42:35.551759 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3393/6823] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:42:36.364598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:36.365164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:36.372649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:36.373154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:36.373604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:36.374420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:36.374895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:36.375341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:36.509263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:36.517248 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1f5f77f9-02a3-4181-8e7b-6c4207600666 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.156638 Aug 29 11:42:36.517872 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3431/6824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:36 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:37.539802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:37.540510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:37.548236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:37.548725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:37.549167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:37.549909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:37.550477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:37.550806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:37.695315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:37.705257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b2d5d09-58fa-49a4-913b-7f470dd17497 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.169831 Aug 29 11:42:37.705860 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3394/6825] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:37 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:38.727407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:38.728244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:38.735783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:38.736288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:38.736745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:38.737502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:38.738003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:38.738454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:38.877889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:38.885822 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c5f3a631-5daf-4cbb-ae73-93850189c05c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.162487 Aug 29 11:42:38.886412 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3432/6826] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:38 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:39.909423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:39.910065 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:39.916187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:39.916674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:39.917123 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:39.917852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:39.918314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:39.918745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:40.051879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:40.059644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d3d5b713-83c5-418b-8b47-5eaf5376db8e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.155826 Aug 29 11:42:40.060221 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3395/6827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:39 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:40.809077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-plugged", "status": "completed", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:40.820111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:40.820604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:40.821056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:40.834176 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] Creating event network-vif-plugged:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:42:40.839441 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-5e5d94e6-d1e1-4611-aeef-8e9c17c77044 req-d18f00f9-5f6a-4ce4-b643-6344f6e30f2e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034157 Aug 29 11:42:40.840053 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3433/6828] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:42:41.081913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:41.082547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:41.090034 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:41.090538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:41.090981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:41.091780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:41.092692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:41.093071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:41.334077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:41.341811 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-516a33ec-64a7-4001-b678-de794c45a051 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.263906 Aug 29 11:42:41.342448 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3396/6829] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:41 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:42.364488 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:42.365226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:42.371573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:42.372068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:42.372555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:42.373833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:42.374398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:42.374846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:42.512042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:42.520037 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-041dd09a-78a6-4ff6-9619-b8ad9780509a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1364 microversion: 2.1 time: 0.160900 Aug 29 11:42:42.520624 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3434/6830] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:42 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:43.542380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:43.542999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:43.546970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:43.547624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:43.554310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:43.554810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:43.555257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:43.555987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:43.556451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:43.556884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:43.694657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:42:43.703608 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d9ec3c6d-2a7a-47d7-b2e9-0b4d2d26f65d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1552 microversion: 2.1 time: 0.165133 Aug 29 11:42:43.704198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3397/6831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:42:43 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:42:43.724716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:42:43.725336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:42:43.727368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:42:43.734707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:43.735210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:43.735662 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:43.736407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:43.736885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:43.737386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:43.816062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-17927e74-c04a-43f6-9308-7b754e43e6d1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095435 Aug 29 11:42:43.816696 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3435/6832] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:42:43 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:42:44.804058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:42:44.827868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:42:44.828700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:42:44.829145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:42:44.845189 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] Creating event network-changed:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:42:44.851069 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f08644c2-ade2-48ec-84b0-b24a924b267d req-b0ce612f-743d-42f9-89f8-6cb7e871b572 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050326 Aug 29 11:42:44.851710 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3398/6833] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:43:14.720754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=23 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:14.721509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:14.725777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:14.726421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:14.733807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:14.734305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:14.734759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:14.735667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:14.736141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:14.736580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:14.956330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:14.964257 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f982aaa2-dc89-480a-8f16-a48a300d82aa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1670 microversion: 2.1 time: 0.245514 Aug 29 11:43:14.964838 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3436/6834] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:14 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:14.986327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "981db3eb-1caa-44f8-a7cc-35333b4d35a1"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:43:14.988715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:14.991079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:14.991725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=50 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:14.998427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:14.999019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:14.999458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:15.000164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:15.000621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:15.001049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:15.388470 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d5d5167f-dd73-438c-a086-8f9db6affcaf tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407345 Aug 29 11:43:15.389963 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3399/6835] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:43:14 2022] POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:43:26.123025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:43:26.125364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:26.128014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:26.128682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:26.134552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:26.135049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:26.135497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:26.136206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:26.136675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:26.137114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:26.166653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:26.173034 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128681) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:43:26.179991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:43:26.180421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:43:26.180907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:43:26.181328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:43:26.181772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:43:26.246923 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-95c7b4c5-6052-4fdd-8142-c40735827c05 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/action" status: 202 len: 0 microversion: 2.1 time: 0.127692 Aug 29 11:43:26.247475 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3437/6836] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:43:26 2022] POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:43:26.256905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:26.257679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:26.262048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:26.262845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:26.268508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:26.269015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:26.269451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:26.270205 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:26.270665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:26.271916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:26.423586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:26.432526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2e09fa27-831e-4d06-a1f0-cf8d73cbeaf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1725 microversion: 2.1 time: 0.179959 Aug 29 11:43:26.433122 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3400/6837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:26 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:27.456707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:27.457419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:27.468854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:27.469328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:27.469807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:27.470543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:27.471016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:27.471459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:27.684033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:27.693067 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-89994b0d-59b3-4c24-a1a3-f95cac8889a1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1725 microversion: 2.1 time: 0.242435 Aug 29 11:43:27.693715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3438/6838] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:27 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:28.716395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:28.717330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:28.724758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:28.725241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:28.725683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:28.726414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:28.726872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:28.727432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:28.862228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:28.870918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d16740b7-6a43-40bb-94d3-4691a82dab63 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.159026 Aug 29 11:43:28.871528 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3401/6839] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:28 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:29.894459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:29.895131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:29.901842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:29.902342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:29.902799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:29.903509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:29.904606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:29.905059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:30.051009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:30.060033 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b02bc335-741a-42c9-9445-6027a3d2e19d tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.169652 Aug 29 11:43:30.060638 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3439/6840] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:29 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:31.082003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:31.082633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:31.089332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:31.089858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:31.090306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:31.091026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:31.092062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:31.093151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:31.227033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:31.235708 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a84b44cc-c5d3-4815-9868-560a156fb37c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.157858 Aug 29 11:43:31.236283 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3402/6841] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:31 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:32.256615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:32.257156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:32.264823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:32.265321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:32.265793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:32.266499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:32.266964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:32.267400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:32.401301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:32.410157 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3492ca07-d6cf-4b95-8555-326f2a48d63f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.157453 Aug 29 11:43:32.410764 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3440/6842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:32 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:33.430799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:33.431422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:33.439121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:33.439604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:33.440042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:33.440727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:33.441259 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:33.441606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:33.581643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:33.590124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c402fd76-ec75-4c90-9793-a81ce7e250de tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.163215 Aug 29 11:43:33.590701 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3403/6843] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:33 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:43:34.611623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:34.612199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:34.619911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:34.620429 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:34.620892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:34.621655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:34.622167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:34.623214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:34.762598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:34.771681 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-60b38bf2-6272-46f2-a4a1-766497430189 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.164344 Aug 29 11:43:34.772243 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3441/6844] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:34 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:35.793215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:35.793871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:35.801433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:35.801959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:35.802401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:35.803107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:35.803567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:35.803993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:35.954742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:35.963681 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8cd5c8ee-c50b-4feb-a191-0738e5c9cf73 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.174510 Aug 29 11:43:35.964288 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3404/6845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:35 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:36.984932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:36.985902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:36.994084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:36.994596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:36.995056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:36.995817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:36.996296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:36.996747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:37.133974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:37.143521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5507ebab-b454-490d-94fb-1fcf38881228 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.162695 Aug 29 11:43:37.144120 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3442/6846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:36 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:38.168283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:38.168942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:38.177419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:38.177931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:38.178370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:38.179071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:38.179527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:38.179951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:38.326861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:38.338625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54fc81ab-c2ac-4470-b1e4-4b24e760f3d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.174207 Aug 29 11:43:38.339294 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3405/6847] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:38 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:39.360021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:39.360641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:39.369281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:39.369807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:39.370260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:39.370964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:39.371432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:39.371871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:39.507600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:39.517045 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cc898890-2fdc-443a-bef1-64a0c7a9db6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.161041 Aug 29 11:43:39.517617 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3443/6848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:39 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:40.538404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:40.539053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:40.547549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:40.548059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:40.548509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:40.549232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:40.549744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:40.550188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:40.689060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:40.698844 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a5ce0531-39dd-480c-b2bb-3ca54a95b234 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.164419 Aug 29 11:43:40.699434 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3406/6849] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:40 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:41.719165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:41.719792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:41.726881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:41.727381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:41.727830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:41.728547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:41.729015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:41.729455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:41.871172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:41.880262 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d8a53f3f-e4a0-471f-abb7-645cf14e3be7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.165188 Aug 29 11:43:41.880860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3444/6850] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:41 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:42.902377 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:42.902971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:42.910847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:42.911335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:42.911774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:42.912481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:42.912930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:42.913363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:43.052181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:43.061562 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6ae81cdb-830a-4340-9953-eea62e32632a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.163171 Aug 29 11:43:43.062224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3407/6851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:42 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:44.084405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:44.085046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:44.093357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:44.093983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:44.094634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:44.095490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:44.096073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:44.096686 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:44.257539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:44.266746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9be11760-c485-4c68-9901-180981b4caf9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.186409 Aug 29 11:43:44.267345 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3445/6852] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:44 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:45.291154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:45.291694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:45.299237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:45.299737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:45.300187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:45.300906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:45.301372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:45.301843 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:45.443364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:45.452850 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f146aa42-afe3-4dc6-96b7-76cf486b983f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.165711 Aug 29 11:43:45.453441 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3408/6853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:45 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:46.474771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:46.475400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:46.482360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:46.482983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:46.483446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:46.484169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:46.484643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:46.485088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:46.622631 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:46.631041 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-068579ba-95b2-49fb-9acc-2288478b39e4 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.160336 Aug 29 11:43:46.631623 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3446/6854] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:46 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:47.652570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:47.653164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:47.660296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:47.660780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:47.661220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:47.661950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:47.662404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:47.662830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:48.056330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:48.065728 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-59b4527d-9cc0-45c4-b1fc-5a427d1fe676 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.416964 Aug 29 11:43:48.066335 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3409/6855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:47 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:49.089575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:49.090256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:49.098238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:49.098739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:49.099193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:49.099915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:49.100389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:49.100832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:49.235695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:49.244436 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-35b4b1c9-483c-4c23-9605-84a2bc3efb11 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.158670 Aug 29 11:43:49.244950 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3447/6856] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:49 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:50.267305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:50.268521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:50.276336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:50.276829 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:50.277274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:50.278022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:50.279372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:50.279816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:50.424357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:50.433147 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-292a40e8-6bd3-42ca-8c07-52715d7d7dfa tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.170686 Aug 29 11:43:50.433787 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3410/6857] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:50 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:51.456798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:51.457442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:51.464818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:51.465332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:51.465900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:51.467384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:51.467871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:51.468319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:51.603438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:51.612495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c28bc344-3214-4e78-b865-2386853646f6 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1730 microversion: 2.1 time: 0.159591 Aug 29 11:43:51.613185 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3448/6858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:51 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:52.612182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-unplugged", "status": "completed", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:43:52.626981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:52.627581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:52.628203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:52.633673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:52.634460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:52.642252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:52.643068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:52.643711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:52.644452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:52.644932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:52.645381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:52.657212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Creating event network-vif-unplugged:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h1-854121-10 Aug 29 11:43:52.668512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] Instance 27fc0188-4d31-4183-8252-d4fafd02d21c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:43:52.690412 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f6928663-ecd0-4d94-b764-f2e39eecd9b5 req-982685af-2775-4766-abac-cd65eebccb34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083181 Aug 29 11:43:52.691130 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3411/6859] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:43:52.802074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:52.810939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7235c106-af40-4830-8eb2-63a0085ba43f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1729 microversion: 2.1 time: 0.181318 Aug 29 11:43:52.811561 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3449/6860] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:52 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:53.835454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:53.836857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:53.843926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:53.844428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:53.844876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:53.845585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:53.846077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:53.846680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:53.986583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:53.996191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a850d6c-0aea-4e8c-8b8b-505252d05e40 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.166213 Aug 29 11:43:53.998729 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3412/6861] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:53 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:54.737518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:43:54.748589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:54.749076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:54.749611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:54.765719 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Creating event network-changed:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h1-854121-10 Aug 29 11:43:54.771466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] Instance 27fc0188-4d31-4183-8252-d4fafd02d21c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:43:54.783802 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-59a53120-54af-4f94-9eba-1660f2bf2c01 req-eac490a7-4c9f-4571-8261-4afec472d7e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049885 Aug 29 11:43:54.784331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3450/6862] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:43:55.021569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:55.022172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:55.029465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:55.029986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:55.030423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:55.031139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:55.031598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:55.032023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:55.225244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:55.235089 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27d13da1-dbd3-4a2c-87d7-bb0d94a709a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.219645 Aug 29 11:43:55.246293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3413/6863] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:55 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:56.258015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:56.258623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:56.260641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=33 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:56.266519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:56.267023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:56.267466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:56.268178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:56.268643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:56.269078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:56.271943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:56.409092 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:56.417669 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0f80e5e-f270-4714-9d0c-20263c89886a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.164894 Aug 29 11:43:56.418272 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3451/6864] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:56 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:57.439417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:57.440196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:57.443148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=29 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:57.449773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:57.450944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:57.451566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:57.452308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:57.452783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:57.453347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:57.456393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=83 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:43:57.596001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:57.604966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0db405d8-3972-4d43-8d95-ebf4172cf9ed tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.169430 Aug 29 11:43:57.606946 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3414/6865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:57 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:58.627984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:58.628582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:58.635170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:58.635671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:58.636564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:58.636840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:58.637314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:58.638985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:58.778492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:58.786989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-75fdedbe-e3c8-4caa-bc71-ac4d6d44baca tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.163994 Aug 29 11:43:58.787567 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3452/6866] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:58 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:43:59.808692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:43:59.809306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:43:59.815394 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:59.815879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:59.816319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:59.817016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:43:59.817472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:43:59.818190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:43:59.951871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:43:59.960499 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2810d437-2cb0-453e-a8d3-4f20bdd471e2 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.156009 Aug 29 11:43:59.961093 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3415/6867] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:43:59 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:00.982021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:00.982661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:00.989948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:00.990465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:00.990920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:00.991650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:00.992127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:00.992573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:01.130999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:01.140244 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e7c3491e-e97e-4fad-9dba-87b6a8968791 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.162229 Aug 29 11:44:01.140829 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3453/6868] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:00 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:02.162616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:02.163246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:02.171210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:02.171712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:02.172336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:02.173070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:02.173540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:02.174015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:02.307869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:02.316627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0c0a5fc-2848-4f2b-b903-72900dff9518 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.158962 Aug 29 11:44:02.317208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3416/6869] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:02 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:03.340224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:03.341456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:03.349561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:03.350247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:03.350247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:03.351014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:03.351485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:03.351924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:03.501465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:03.510214 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7249f3dc-557d-4857-8d25-5d13025163d3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.174350 Aug 29 11:44:03.510810 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3454/6870] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:03 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:04.531988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:04.532591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:04.539571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:04.540059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:04.540501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:04.541196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:04.541650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:04.542103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:04.682237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:04.690892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-525cfe75-b917-4a2d-86f2-b22676bb9fcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1727 microversion: 2.1 time: 0.163024 Aug 29 11:44:04.691570 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3417/6871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:04 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:05.712491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:05.713120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:05.720104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.720605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.721057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.721791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.722287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.722729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.854996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:05.864397 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5477ac15-c414-4fb8-b950-eef4d4bbf934 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1724 microversion: 2.1 time: 0.155932 Aug 29 11:44:05.864978 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3455/6872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:05 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:05.886196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:05.886742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:05.893664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.894160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.894598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.895291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.895747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.896171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.935354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.935852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.936287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.937010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:05.937461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:05.937916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:05.958372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:44:05.963859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Getting quotas for user 173c1b51471a48fcaba5fa8107b0a308 and project 18b7e222466149ecae67be3c9cb899d2. Resources: {'ram', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:44:06.071080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-78928b64-6e9f-42c4-9982-29c8c42a7502 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/action" status: 202 len: 0 microversion: 2.1 time: 0.188547 Aug 29 11:44:06.071959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3418/6873] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:44:05 2022] POST /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:44:06.082172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:06.082547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:06.089492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:06.090056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:06.091161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:06.092033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:06.092506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:06.093063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:06.235366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:06.244744 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cae271cb-9bb3-4e02-b1fb-e023a29ccb1f tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.168225 Aug 29 11:44:06.245344 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3456/6874] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:06 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:07.268027 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:07.269494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:07.278994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:07.279489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:07.279928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:07.280638 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:07.281122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:07.281555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:07.436074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:07.445737 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c9b8593c-40e2-4a2b-8028-d77c233570a7 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.182949 Aug 29 11:44:07.446331 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3419/6875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:07 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:44:08.470613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:08.471232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:08.478645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:08.479157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:08.479612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:08.480347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:08.480836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:08.482582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:08.626010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:08.636098 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8e113a70-efe1-4715-8ec9-bc75fe95317c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.170559 Aug 29 11:44:08.636798 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3457/6876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:08 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:09.055347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-plugged", "status": "completed", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:09.067299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:09.067941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:09.068437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:09.083759 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Creating event network-vif-plugged:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h1-854121-10 Aug 29 11:44:09.090757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] Instance 27fc0188-4d31-4183-8252-d4fafd02d21c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:44:09.103389 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fc01856c-27eb-4f9a-83d9-75b95c99cd8f req-fed2746b-6927-4d27-9a91-57affe5a3a26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125299 Aug 29 11:44:09.104028 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3420/6877] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:44:09.657868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:09.658705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:09.666274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:09.666824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:09.667288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:09.668025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:09.668749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:09.669825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:09.815887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:09.826152 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bd70b9a-b47f-418b-aee5-cf4a0e5b9be0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.171204 Aug 29 11:44:09.826377 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3458/6878] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:09 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:10.848453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:10.849174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:10.855657 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:10.856644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:10.857080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:10.857939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:10.858399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:10.858825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:11.003302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:11.012307 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f989c897-8a2b-4a8e-b39f-9bb8da4e3ae9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.168818 Aug 29 11:44:11.013058 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3421/6879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:10 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:11.557673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-unplugged", "status": "completed", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:11.568910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:11.569414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:11.569902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:11.582959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Creating event network-vif-unplugged:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:44:11.588541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] Instance 27fc0188-4d31-4183-8252-d4fafd02d21c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:44:11.600404 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-79b02211-c735-4c00-b57c-427cacec1c07 req-34220504-64c7-413c-9e3c-a2909dd3044d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101440 Aug 29 11:44:11.601019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3459/6880] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:44:12.033825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:12.034452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:12.041489 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:12.042031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:12.042486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:12.043203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:12.044248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:12.044695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:12.264869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:12.273287 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-423a705e-b182-472d-946a-91218afbb2eb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.243437 Aug 29 11:44:12.273897 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3422/6881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:12 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:13.302982 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:13.304255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:13.316444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:13.317337 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:13.318125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:13.319416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:13.320267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:13.321076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:13.541873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:13.551953 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5834ff2e-6888-4632-b6dd-e2f77cbe1725 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.258786 Aug 29 11:44:13.552786 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3460/6882] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:13 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:13.630726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:13.656393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:13.657249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:13.658059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:13.681943 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Creating event network-changed:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:44:13.693673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] Instance 27fc0188-4d31-4183-8252-d4fafd02d21c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:44:13.715151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-26c241b8-fd23-4c68-aad2-3a8059af98e1 req-cd2d93fc-eaed-4c81-b1a2-bdd5cea30ed4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100232 Aug 29 11:44:13.717042 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3423/6883] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:44:14.587205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:14.587818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:14.596623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:14.597138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:14.597603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:14.598443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:14.598926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:14.599371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:14.758219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:14.773966 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44235b89-3fba-4a91-99d2-61e94869edcb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.190350 Aug 29 11:44:14.774941 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3461/6884] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:14 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:15.812146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:15.813232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:15.821168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:15.822039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:15.822555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:15.823366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:15.823950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:15.824452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:15.949062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:16.003762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:16.013005 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27698130-7bfa-4ba8-8cb8-7b86ed272ead tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.206343 Aug 29 11:44:16.014085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3424/6885] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:15 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:17.040706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:17.041915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:17.055224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:17.056121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:17.056972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:17.058289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:17.059611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:17.060463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:17.270798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:17.287391 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f1b09176-f905-4579-9143-ed1e18fb0564 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.254363 Aug 29 11:44:17.288397 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3462/6886] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:17 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:18.312232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:18.312995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:18.321211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:18.323500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:18.324254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:18.325511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:18.326337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:18.327169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:18.482992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:18.496690 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f70dde75-90c7-4408-bfc3-40ab2d23e6e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.189356 Aug 29 11:44:18.497660 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3425/6887] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:18 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:19.519228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:19.519869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:19.527361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:19.528097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:19.528590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:19.529369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:19.529985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:19.530519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:19.680348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:19.690055 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8d4f10e1-10c8-44a9-8939-791c84ac1a84 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.174782 Aug 29 11:44:19.690667 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3463/6888] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:19 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:44:20.711902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:20.712670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:20.720397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:20.720977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:20.721425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:20.722278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:20.722738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:20.723193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:20.868199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:20.878498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e53790ab-416e-44b5-8fca-5c4a939b8150 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.170523 Aug 29 11:44:20.879115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3426/6889] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:20 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:21.900423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:21.901275 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:21.909624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:21.910182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:21.910638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:21.911374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:21.911847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:21.912290 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:22.077874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:22.094362 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4f3317b5-5f33-4bd6-b2da-1c698765f408 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.197638 Aug 29 11:44:22.095469 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3464/6890] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:21 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:23.118492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:23.119509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:23.128056 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:23.128554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:23.128999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:23.129789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:23.130209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:23.130735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:23.295872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:23.304693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-19c848c1-8788-4249-895f-58eebef37ae0 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.190152 Aug 29 11:44:23.305289 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3427/6891] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:23 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:24.329652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:24.330775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:24.343128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:24.344443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:24.344992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:24.346032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:24.346879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:24.347451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:24.503884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:24.514151 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-67a9d5cb-44dc-471a-9221-4af925006bbe tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1723 microversion: 2.1 time: 0.191906 Aug 29 11:44:24.514755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3465/6892] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:24 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:25.537905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:25.538999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:25.548988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.549643 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.550328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:25.551160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.551754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.552301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:25.570883 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:25.712302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:25.723468 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b242d994-2baf-462a-a7be-eecf62cba4e3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1716 microversion: 2.1 time: 0.190594 Aug 29 11:44:25.724085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3428/6893] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:25 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1716 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:25.746827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:25.747466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:25.754917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.755420 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.755873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:25.756602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.757075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.757510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:25.944609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:25.961465 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-adef2a83-425d-4f94-ace9-5988655d742a tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1716 microversion: 2.1 time: 0.218607 Aug 29 11:44:25.962604 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3466/6894] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:25 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1716 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:25.985155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:25.986160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:25.993640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.994411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.994945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:25.995776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:25.997076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:25.997856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:26.160881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:26.171060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11761b5c-50c0-4225-a6ee-89598b45c5af tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1716 microversion: 2.1 time: 0.190018 Aug 29 11:44:26.171930 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3429/6895] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:25 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1716 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:26.194865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:26.195407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:26.202509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:26.203021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:26.203477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:26.204221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:26.204700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:26.205148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:26.244634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:44:26.277066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=100 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:26.337507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=34 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:26.364222 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-27041e81-2bf8-47d6-8d04-e59c2f03c0bb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 204 len: 0 microversion: 2.1 time: 0.173743 Aug 29 11:44:26.364922 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3467/6896] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:44:26 2022] DELETE /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:44:26.374800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:26.375433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:26.382283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:26.382786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:26.383240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:26.384009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:26.384471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:26.384903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:26.545886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:26.555826 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d907e4cc-4ed4-42b4-b772-4a6f7f8d39f1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1722 microversion: 2.1 time: 0.185634 Aug 29 11:44:26.556420 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3430/6897] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:26 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:27.440677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-plugged", "status": "completed", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:27.458426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:27.459294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:27.459826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:27.475691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] Creating event network-vif-plugged:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:44:27.483276 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f35f794b-7849-44c3-8f93-d214392c5791 req-bcb7cc8e-b1ed-4b5d-8454-61f9bfe6ad54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047142 Aug 29 11:44:27.484410 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3468/6898] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:44:27.579310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:27.581340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:27.585167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:27.593756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:27.594431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:27.594997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:27.596039 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:27.596621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:27.598188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:27.795769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:27.805205 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-76f4b557-e72d-44b6-88b7-39e304f67450 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1722 microversion: 2.1 time: 0.230469 Aug 29 11:44:27.805844 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3431/6899] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:27 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:28.832416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:28.833756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:28.842634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:28.843233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:28.843801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:28.844656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:28.845194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:28.845740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:28.957317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:28.976961 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bcb95d03-72cd-45e3-9745-017488fbb8a3 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1654 microversion: 2.1 time: 0.151021 Aug 29 11:44:28.977842 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3469/6900] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:28 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:29.225240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc0188-4d31-4183-8252-d4fafd02d21c", "name": "network-vif-deleted", "tag": "6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:29.243601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:29.244781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:29.245497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:29.264839 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] Creating event network-vif-deleted:6e0810b6-47e2-4fa4-a3fd-e8461c2ddd2c for instance 27fc0188-4d31-4183-8252-d4fafd02d21c on n-h2-854121-10 Aug 29 11:44:29.270749 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d75b22ad-4907-44ac-9354-afab3985834e req-db961d30-1a0a-4e52-be52-88c7fdb61672 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049440 Aug 29 11:44:29.271712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3432/6901] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:44:30.015922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:30.018033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:30.031230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:30.032382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:30.033315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:30.034852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:30.035871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:30.037150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:30.152233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:30.172469 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a84d54b5-f27d-4dfc-a660-648d39ae3fc1 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1369 microversion: 2.1 time: 0.161146 Aug 29 11:44:30.173588 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3470/6902] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:30 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:31.199347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:31.200952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:31.209300 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:31.209865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:31.210352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:31.211209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:31.211737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:31.212239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:31.311561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:31.323209 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4f286dae-e9dd-4b53-b746-f2020f6a0205 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1369 microversion: 2.1 time: 0.130609 Aug 29 11:44:31.324025 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3433/6903] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:31 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1369 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:32.349306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:32.350474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:32.360085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:32.360744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:32.361313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:32.362545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:32.363354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:32.364169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:32.459615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:32.469888 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff6eebf7-f29f-4cfc-8655-916d66893784 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1369 microversion: 2.1 time: 0.125496 Aug 29 11:44:32.484748 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3471/6904] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:32 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1369 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:33.493276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:33.494433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:33.504672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:33.505312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:33.505802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:33.506704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:33.507140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:33.507587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:33.580755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173c1b51471a48fcaba5fa8107b0a308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7e222466149ecae67be3c9cb899d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:33.591536 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c65187b0-dac8-4fe3-9deb-d1a161de0a6e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 200 len: 1369 microversion: 2.1 time: 0.102758 Aug 29 11:44:33.592159 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3434/6905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:33 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:34.613813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:34.614404 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:34.623633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:34.624350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:34.625085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:34.625973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:34.626467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:34.626996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:34.644301 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c HTTP/1.1 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '27fc0188-4d31-4183-8252-d4fafd02d21c'} Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:34.646623 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-26a526ea-387b-4fe5-8502-404d4802abbb tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 404 len: 111 microversion: 2.1 time: 0.039170 Aug 29 11:44:34.654324 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3472/6906] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:34 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:44:34.725461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:34.727820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:34.736505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:34.737010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:34.737460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:34.738230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:34.738702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:34.739261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:34.754781 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-volume_attachments HTTP/1.1 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '27fc0188-4d31-4183-8252-d4fafd02d21c'} Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:34.756611 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9a397bc2-dddb-4337-9b7e-88e226da8f3c tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036851 Aug 29 11:44:34.764732 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3435/6907] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:44:34 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:44:39.300140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.301005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.314457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.315202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.315968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.317108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.317897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.318555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.343211 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c HTTP/1.1 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '27fc0188-4d31-4183-8252-d4fafd02d21c'} Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.345072 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0fb3e2a-bce8-4ed6-a250-4f3062786a74 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 404 len: 111 microversion: 2.1 time: 0.052391 Aug 29 11:44:39.352680 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3473/6908] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:44:39 2022] DELETE /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.360041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.360938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 27fc0188-4d31-4183-8252-d4fafd02d21c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.370835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.372694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.373078 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.374035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.374672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.375334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.394788 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c HTTP/1.1 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '27fc0188-4d31-4183-8252-d4fafd02d21c'} Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.396832 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 27fc0188-4d31-4183-8252-d4fafd02d21c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-35eebc08-72b1-4fcd-8cb5-062608448cba tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c" status: 404 len: 111 microversion: 2.1 time: 0.046067 Aug 29 11:44:39.404482 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3436/6909] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:39 2022] GET /compute/v2.1/servers/27fc0188-4d31-4183-8252-d4fafd02d21c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:44:39.412079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.412881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.422698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.423582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.424240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.425164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.425751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.426653 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.445487 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf HTTP/1.1 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '6d85439a-3c87-4a84-9b4a-12343aeb85bf'} Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.448009 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-41a2c6f9-2737-4789-9663-a512fc33da87 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 404 len: 111 microversion: 2.1 time: 0.043002 Aug 29 11:44:39.455054 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3474/6910] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:44:39 2022] DELETE /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.462712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.463562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 6d85439a-3c87-4a84-9b4a-12343aeb85bf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.472530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.473267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.473863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.474744 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.475271 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.475821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.495257 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf HTTP/1.1 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '6d85439a-3c87-4a84-9b4a-12343aeb85bf'} Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.498808 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 6d85439a-3c87-4a84-9b4a-12343aeb85bf could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-77fd6489-00eb-4425-8b3e-b81ce42f723e tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf" status: 404 len: 111 microversion: 2.1 time: 0.042734 Aug 29 11:44:39.508671 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3437/6911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:39 2022] GET /compute/v2.1/servers/6d85439a-3c87-4a84-9b4a-12343aeb85bf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.516023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.516660 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.524975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.525592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.526176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.527500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.528599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.529272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.547556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 HTTP/1.1 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0'} Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.549295 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a151aa3c-f195-49bc-adb1-90bec1fec7b8 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 404 len: 111 microversion: 2.1 time: 0.042645 Aug 29 11:44:39.561348 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3475/6912] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:44:39 2022] DELETE /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.568274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.569523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.582099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.582994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.583834 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.585101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.586053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.586867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.615273 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 HTTP/1.1 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0'} Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.618200 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance 22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-50b82e8f-ce62-4788-80e7-eb609f861893 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0" status: 404 len: 111 microversion: 2.1 time: 0.059999 Aug 29 11:44:39.624911 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3438/6913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:39 2022] GET /compute/v2.1/servers/22bf7ed6-e6b9-4f01-9892-917e6c6ee8c0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.634997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.635929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.647409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.648349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.649298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.650770 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.651687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.653192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.684044 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 HTTP/1.1 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'bbfea663-f73b-46de-b413-30526b3317c0'} Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.687408 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-099684b6-fa37-41ad-93a1-c1a9e9530b85 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 404 len: 111 microversion: 2.1 time: 0.061873 Aug 29 11:44:39.697893 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3476/6914] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:44:39 2022] DELETE /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.702652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.703315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] [instance: bbfea663-f73b-46de-b413-30526b3317c0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:39.710393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.710944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.711665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.712305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:39.712775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:39.713356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:39.735423 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] HTTP exception thrown: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Request method failure captured: Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 HTTP/1.1 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKVLt_KaXW6Auzq487yyF3z5sOrSrnkxHpOlnnOazIEJU67Lrf-D_cxl2D1jqNsLEi8FbQSthlKDddwQvAZaBxpZBGxmNnsVtIuSYkiR2E3JglxUwbAxGB3Fb4xTbMObsh0PK2SCI2eeBaeLS0w2PUf9C9hqsbU6bXP3dzemtTOH2W8 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/18b7e222466149ecae67be3c9cb899d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 18b7e222466149ecae67be3c9cb899d2 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServerActionsTestJSON-932958904 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 173c1b51471a48fcaba5fa8107b0a308 Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServerActionsTestJSON-932958904-project Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'bbfea663-f73b-46de-b413-30526b3317c0'} Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:44:39.737044 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Returning 404 to user: Instance bbfea663-f73b-46de-b413-30526b3317c0 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9a3d7a0f-4544-4714-939d-9283ae209a3b tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0" status: 404 len: 111 microversion: 2.1 time: 0.041045 Aug 29 11:44:39.744584 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3439/6915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:39 2022] GET /compute/v2.1/servers/bbfea663-f73b-46de-b413-30526b3317c0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:44:39.755657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-275dab9d-2b28-43e9-ab0d-720a4612dda9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] Calling method '.version_select at 0x7f66c6ef1040>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:39.796505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-275dab9d-2b28-43e9-ab0d-720a4612dda9 tempest-ServerActionsTestJSON-932958904 tempest-ServerActionsTestJSON-932958904-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119231836" status: 202 len: 0 microversion: 2.1 time: 0.048351 Aug 29 11:44:39.797202 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3477/6916] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 29 11:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119231836 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:44:52.857425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=17 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:52.858297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=45 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:53.005168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1588070465", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "8e3b4fc6-a70d-446a-9406-7d2ae3829fa5"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:44:53.084887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] validate_networks() for [('8e3b4fc6-a70d-446a-9406-7d2ae3829fa5', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:44:53.556013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:44:53.556775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:44:53.558632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:44:53.559323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:44:53.559763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:44:53.575503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:53.576007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:53.576467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:53.577303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:53.577825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:53.578291 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:53.599143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Getting quotas for project e21dd36167e14898a3173f45a4c05560. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:44:53.606563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Getting quotas for user bb81858449b645ef8a74beb74b3405a4 and project e21dd36167e14898a3173f45a4c05560. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:44:53.624333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:44:53.626927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:44:53.682202 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5665e964-1fba-496f-9528-a09e35c54813 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831572 Aug 29 11:44:53.682918 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3440/6917] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:44:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:44:53.701607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e0f6548-e71f-4d8e-9483-916e31e211a7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:53.702764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e0f6548-e71f-4d8e-9483-916e31e211a7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:53.717445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:53.719262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:44:53.799464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e0f6548-e71f-4d8e-9483-916e31e211a7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:53.813779 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e0f6548-e71f-4d8e-9483-916e31e211a7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1217 microversion: 2.1 time: 0.122185 Aug 29 11:44:53.814881 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3478/6918] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:53 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:54.839764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-de023fa1-1584-4488-a3d3-2c43d3c8ccb7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:54.842303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-de023fa1-1584-4488-a3d3-2c43d3c8ccb7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:54.906892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-de023fa1-1584-4488-a3d3-2c43d3c8ccb7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:54.914947 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-de023fa1-1584-4488-a3d3-2c43d3c8ccb7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1217 microversion: 2.1 time: 0.082529 Aug 29 11:44:54.916686 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3441/6919] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:54 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:55.941935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a8680173-97b5-4ddc-a8e1-64262f88fcd7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:55.943228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a8680173-97b5-4ddc-a8e1-64262f88fcd7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:56.387435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a8680173-97b5-4ddc-a8e1-64262f88fcd7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:56.395236 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a8680173-97b5-4ddc-a8e1-64262f88fcd7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1217 microversion: 2.1 time: 0.459998 Aug 29 11:44:56.396018 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3479/6920] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:55 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1217 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:44:57.436334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:57.437518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:57.451666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:57.452554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:57.453351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:57.454695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:57.455560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:57.456367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:57.561095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:57.570162 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e38308f1-b792-412b-8537-fc226d99667f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1221 microversion: 2.1 time: 0.142378 Aug 29 11:44:57.571208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3442/6921] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:57 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:58.594842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:58.595822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:58.604119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:58.605556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:58.606057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:58.606821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:58.607307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:58.607759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:58.708521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:58.724543 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-add8b191-553e-4053-9bfa-324c8dcd59c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1269 microversion: 2.1 time: 0.134328 Aug 29 11:44:58.725777 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3480/6922] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:58 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:44:59.749547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:44:59.750444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:44:59.757613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:59.758407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:59.758677 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:59.759437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:44:59.759908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:44:59.760344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:44:59.965317 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:44:59.988450 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3affa592-d0c5-40ca-af55-6c5be9f2887a tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.239338 Aug 29 11:44:59.990308 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3443/6923] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:44:59 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:00.736033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c68da6-0f17-4ef2-8851-1e0a3ebc5010", "tag": "bf18a639-15ed-4d80-9040-81072fb4df01"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:00.762281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:00.763492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:00.764315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:00.788167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] Creating event network-changed:bf18a639-15ed-4d80-9040-81072fb4df01 for instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 on n-h1-854121-10 Aug 29 11:45:00.796338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-19048031-b833-481f-8a77-f878259a6ce4 req-5d301295-d1ea-4822-b588-9eb9db4a41cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069963 Aug 29 11:45:00.797690 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3481/6924] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:01.025333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:01.026333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:01.035579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:01.036237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:01.036806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:01.037867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:01.038408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:01.038908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:01.228894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:01.241464 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-378280b9-ea61-467b-b2c3-f04f334fcdca tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.219802 Aug 29 11:45:01.242747 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3444/6925] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:01 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:02.274596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:02.277287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:02.286493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:02.287673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:02.288584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:02.290052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:02.291033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:02.291943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:02.520012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:02.534013 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0c4247de-c5cc-44a0-b72c-ac6cd17bfc2f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.268129 Aug 29 11:45:02.534754 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3482/6926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:02 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:03.558926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:03.559764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:03.570343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:03.571268 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:03.571767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:03.572613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:03.573180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:03.574573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:03.592870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:03.756674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:03.766403 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-63078542-1143-4c77-b673-8ab24f164aaa tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.212007 Aug 29 11:45:03.767254 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3445/6927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:03 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:04.795808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:04.796763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:04.805142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:04.805648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:04.806135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:04.806868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:04.807339 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:04.808781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:04.987743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:04.998361 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-16207986-666a-433e-a841-dcfd1f725a94 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.209190 Aug 29 11:45:04.998980 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3483/6928] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:04 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:05.528890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c68da6-0f17-4ef2-8851-1e0a3ebc5010", "name": "network-vif-plugged", "status": "completed", "tag": "bf18a639-15ed-4d80-9040-81072fb4df01"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:05.537321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:05.547722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:05.548603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:05.549819 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:05.564693 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] Creating event network-vif-plugged:bf18a639-15ed-4d80-9040-81072fb4df01 for instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 on n-h1-854121-10 Aug 29 11:45:05.572421 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-eb439e1f-cc84-4a41-acd9-6ee99c506de0 req-fb0aa509-8f52-4ba6-bd0d-dbc4959bb493 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051807 Aug 29 11:45:05.573898 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3446/6929] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:06.020786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:06.021381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:06.030591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:06.031142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:06.031574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:06.032341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:06.032832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:06.033283 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:06.231235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:06.241629 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a97aef18-b5c9-4960-a6b8-db75605aea45 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1317 microversion: 2.1 time: 0.224850 Aug 29 11:45:06.242475 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3484/6930] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:06 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:07.279140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:07.279867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:07.287813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:07.288703 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:07.289221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:07.290266 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:07.290908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:07.291448 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:07.465144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:07.474437 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d9f3a1a7-eeb0-4ed0-8aa9-e4ab30a76692 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.201244 Aug 29 11:45:07.475081 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3447/6931] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:07 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:07.560980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-570735379", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "8e3b4fc6-a70d-446a-9406-7d2ae3829fa5"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:07.570985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:07.631472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] validate_networks() for [('8e3b4fc6-a70d-446a-9406-7d2ae3829fa5', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:45:08.160690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:45:08.161196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:45:08.161780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:45:08.162271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:45:08.162752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:45:08.175220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:08.177003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:08.178221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:08.179856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:08.180624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:08.181566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:08.206059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Getting quotas for project e21dd36167e14898a3173f45a4c05560. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:45:08.213048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Getting quotas for user bb81858449b645ef8a74beb74b3405a4 and project e21dd36167e14898a3173f45a4c05560. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:45:08.230581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:45:08.233133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:45:08.288786 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3685fd83-dc60-426b-aa78-bf024cc12f3f tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731409 Aug 29 11:45:08.289944 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3485/6932] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:45:08.308119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-10be3d94-3bb9-4251-82c9-9879e17c87b5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:08.310332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-10be3d94-3bb9-4251-82c9-9879e17c87b5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:08.395979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-10be3d94-3bb9-4251-82c9-9879e17c87b5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:08.410039 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-10be3d94-3bb9-4251-82c9-9879e17c87b5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1216 microversion: 2.1 time: 0.110176 Aug 29 11:45:08.411693 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3448/6933] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:08 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:09.439234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:09.440575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:09.456915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:09.541506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:09.558863 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ef26e7fc-30fe-4561-98f9-beba1f168cc6 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1268 microversion: 2.1 time: 0.124960 Aug 29 11:45:09.561809 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3486/6934] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:09 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:10.587172 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:10.588599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:10.605226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:10.607571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:10.608568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:10.610371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:10.611467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:10.612481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:10.911932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:10.921544 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51f82e40-c41b-434c-8603-8190efa9e6b3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.342588 Aug 29 11:45:10.922416 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3449/6935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:10 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:11.339934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5100f49-e539-4003-a211-615429c0c874", "tag": "c377bd49-0b67-4a36-b6f4-a92506bbe0a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:11.357419 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:11.357962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:11.358411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:11.378478 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] Creating event network-changed:c377bd49-0b67-4a36-b6f4-a92506bbe0a6 for instance d5100f49-e539-4003-a211-615429c0c874 on n-h2-854121-10 Aug 29 11:45:11.384618 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-47ce2ea6-9f55-4b83-a75a-07c65cc88c13 req-04156a29-647f-4273-87a8-0649ea7bd8f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049409 Aug 29 11:45:11.386119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3487/6936] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:11.948691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:11.949599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:11.956999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:11.957488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:11.958132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:11.959353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:11.959863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:11.960297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:12.138754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:12.147473 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f4290eb6-baa8-476d-a6da-7c2852fceda5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.203180 Aug 29 11:45:12.148168 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3450/6937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:11 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:13.178712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:13.180141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:13.192031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:13.192866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:13.193759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:13.195169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:13.196343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:13.197148 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:13.376123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:13.384959 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b54e47c-f5c0-4eff-9553-fb70233a5dab tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.216848 Aug 29 11:45:13.385603 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3488/6938] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:13 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:14.407979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:14.408721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:14.417218 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:14.417941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:14.418607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:14.419344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:14.419817 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:14.420260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:14.569316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:14.578179 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5014cbea-8c93-42f7-8f28-1a94dbeba564 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.175284 Aug 29 11:45:14.578788 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3451/6939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:14 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:15.600860 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:15.601729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:15.612604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:15.613352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:15.614140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:15.615105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:15.615733 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:15.616321 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:15.750405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5100f49-e539-4003-a211-615429c0c874", "name": "network-vif-plugged", "status": "completed", "tag": "c377bd49-0b67-4a36-b6f4-a92506bbe0a6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:15.774201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:15.775456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:15.777258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:15.793047 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] Creating event network-vif-plugged:c377bd49-0b67-4a36-b6f4-a92506bbe0a6 for instance d5100f49-e539-4003-a211-615429c0c874 on n-h2-854121-10 Aug 29 11:45:15.799337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-89c1de26-b9f5-4714-b014-4b7eae6f9feb req-a0062c2a-0fdc-4352-8b4b-080b803c403a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056063 Aug 29 11:45:15.799979 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3452/6940] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:15.851767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:15.864093 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-537f64db-f887-41be-9187-63e95d9e98db tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.268339 Aug 29 11:45:15.864894 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3489/6941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:15 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:16.888321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:16.889173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:16.896019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:16.896517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:16.896967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:16.897740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:16.898213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:16.898655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:17.093152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:17.102873 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e093b09e-dc25-41c8-926a-2fea9e1567a5 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1316 microversion: 2.1 time: 0.220492 Aug 29 11:45:17.103735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3453/6942] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:16 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:18.135745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:18.136641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:18.144537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.145083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.145544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.146317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.146796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.147244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.191586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:18.222125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:18.329075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:18.339691 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9e376910-7f68-47b2-8afd-345870c9d660 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1506 microversion: 2.1 time: 0.208292 Aug 29 11:45:18.340556 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3490/6943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:18 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:18.361146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:18.361999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:18.369685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.370779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.370779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.371366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.371835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.372274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.402753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:45:18.404971 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:18.500584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-150e0485-dd1e-45a0-b26a-ce259088b38b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 204 len: 0 microversion: 2.1 time: 0.143142 Aug 29 11:45:18.501197 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3454/6944] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:45:18 2022] DELETE /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:45:18.515704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:18.516906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:18.528720 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.529640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.530496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.531820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:18.532728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:18.533525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:18.726444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:18.736370 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f28a355d-3356-4803-8682-5e0c02a3848c tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1512 microversion: 2.1 time: 0.229198 Aug 29 11:45:18.736953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3491/6945] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:18 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:19.759965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:19.761303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:19.774650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:19.775553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:19.776329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:19.777333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:19.777999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:19.778550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:20.070867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:20.081060 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-064bd3c7-5357-4c1b-8e99-a915cb0c97c1 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 200 len: 1512 microversion: 2.1 time: 0.326046 Aug 29 11:45:20.081902 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3455/6946] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:19 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:20.465842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5100f49-e539-4003-a211-615429c0c874", "name": "network-vif-deleted", "tag": "c377bd49-0b67-4a36-b6f4-a92506bbe0a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:20.485399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:20.486309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:20.487083 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:20.511671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] Creating event network-vif-deleted:c377bd49-0b67-4a36-b6f4-a92506bbe0a6 for instance d5100f49-e539-4003-a211-615429c0c874 on n-h2-854121-10 Aug 29 11:45:20.522267 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-18d06e0b-cdf1-4110-84ab-1529169b534b req-ca7646e1-e178-4847-8209-c98bcbad1515 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066275 Aug 29 11:45:20.523988 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3492/6947] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:21.107414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:21.108252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.112011 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:45:21.112291 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 (ip 10.222.0.47) !!! Aug 29 11:45:21.123014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.124649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.125121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.125912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.126385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.126823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.144203 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 HTTP/1.1 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd5100f49-e539-4003-a211-615429c0c874'} Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.146000 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 404 to user: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-713a8c03-7d6b-4f47-a344-d366ae4691ce tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 404 len: 111 microversion: 2.1 time: 0.046788 Aug 29 11:45:21.154990 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3456/6948] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:21 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:45:21.164171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:21.165492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.178002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.178844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.179624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.180903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.181800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.183252 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.358694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:21.367248 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-202585e1-8ecb-431f-90dc-f2469ba3ef27 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.211048 Aug 29 11:45:21.367860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3493/6949] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:21 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:21.390450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:21.392841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: ffdccb2d-0142-4759-a842-83e1e48a760c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.398790 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/ffdccb2d-0142-4759-a842-83e1e48a760c/action HTTP/1.1 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 32 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: {"resize": {"flavorRef": "452"}} Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'ffdccb2d-0142-4759-a842-83e1e48a760c', 'body': {'resize': {'flavorRef': '452'}}} Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:45:21.400501 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 404 to user: Instance ffdccb2d-0142-4759-a842-83e1e48a760c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-67dcde6b-5714-40f2-80df-bfe0330e4f52 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "POST /compute/v2.1/servers/ffdccb2d-0142-4759-a842-83e1e48a760c/action" status: 404 len: 111 microversion: 2.1 time: 0.017494 Aug 29 11:45:21.405497 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3457/6950] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:45:21 2022] POST /compute/v2.1/servers/ffdccb2d-0142-4759-a842-83e1e48a760c/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:45:21.413109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:21.413928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.422257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.422791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.423237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.423984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.424473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.424919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.595175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:21.610614 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c906513b-21a1-4973-8941-c4a4ba232b4d tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.201368 Aug 29 11:45:21.611715 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3494/6951] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:21 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:21.633248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:21.633907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.642565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.643141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.643580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.644337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.644799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.645234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.796140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:21.804711 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3eaf2a42-7947-4ab0-ae54-b6bc41eb4563 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.175346 Aug 29 11:45:21.805310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3458/6952] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:21 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:21.827904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1043e4a2-7671-4c25-97d3-312ae8b551cf"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:21.830856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.837555 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.838303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.839368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.840496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.840925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.841382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.876207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:21.883544 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: request: POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action HTTP/1.1 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 65 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: {"resize": {"flavorRef": "1043e4a2-7671-4c25-97d3-312ae8b551cf"}} Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: exception: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '71c68da6-0f17-4ef2-8851-1e0a3ebc5010', 'body': {'resize': {'flavorRef': '1043e4a2-7671-4c25-97d3-312ae8b551cf'}}} Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:21.886457 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 400 to user: Flavor 1043e4a2-7671-4c25-97d3-312ae8b551cf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6520fb50-48ee-4fce-bb56-6a71457275e7 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action" status: 400 len: 107 microversion: 2.1 time: 0.065700 Aug 29 11:45:21.892777 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3495/6953] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:45:21 2022] POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 11:45:21.904188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:21.905361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:21.916709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.917588 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.918432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:21.919762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:21.920607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:21.921399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.098919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:22.109076 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cd226158-48d6-4c33-bd55-a2d6c1c1d554 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.213117 Aug 29 11:45:22.109990 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3459/6954] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:21 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:22.132810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.133484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.143536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.144185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.144814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.145617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.146258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.146801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.309751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:22.318297 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3a32a7cc-b98d-41a3-89eb-19fba5dbcf40 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.189587 Aug 29 11:45:22.318909 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3496/6955] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:22 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:45:22.345249 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-657cc2e3-f8aa-4690-8c4c-f1da532fd1e3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-657cc2e3-f8aa-4690-8c4c-f1da532fd1e3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: request: POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action HTTP/1.1 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 29 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: {"resize": {"flavorRef": ""}} Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '71c68da6-0f17-4ef2-8851-1e0a3ebc5010', 'body': {'resize': {'flavorRef': ''}}} Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise error Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi '' Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.352278 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-657cc2e3-f8aa-4690-8c4c-f1da532fd1e3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-657cc2e3-f8aa-4690-8c4c-f1da532fd1e3 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action" status: 400 len: 113 microversion: 2.1 time: 0.017679 Aug 29 11:45:22.360393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3460/6956] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:45:22 2022] POST /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010/action => generated 113 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 11:45:22.365955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.366753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.374971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.375495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.375957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.376710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.377186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.377640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.560719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:22.569266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40289ad0-5d04-4f7e-90cd-9ded67f137b4 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1507 microversion: 2.1 time: 0.208104 Aug 29 11:45:22.569910 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3497/6957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:22 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:22.595910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.596424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.604746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.605389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.605902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.606666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.607134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.607566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.623503 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 HTTP/1.1 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'd5100f49-e539-4003-a211-615429c0c874'} Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:45:22.625332 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 404 to user: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73bff44a-7d85-418d-b421-e65372137e06 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 404 len: 111 microversion: 2.1 time: 0.036865 Aug 29 11:45:22.632064 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3461/6958] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:45:22 2022] DELETE /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:45:22.639932 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.640514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: d5100f49-e539-4003-a211-615429c0c874] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.647753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.648359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.648863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.649763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.650311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.651387 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.668167 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 HTTP/1.1 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'd5100f49-e539-4003-a211-615429c0c874'} Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:22.670175 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 404 to user: Instance d5100f49-e539-4003-a211-615429c0c874 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5511a920-6342-4ee3-9b06-fcdb255b7505 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874" status: 404 len: 111 microversion: 2.1 time: 0.037141 Aug 29 11:45:22.676119 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3498/6959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:22 2022] GET /compute/v2.1/servers/d5100f49-e539-4003-a211-615429c0c874 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:45:22.682848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.683160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.690155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.690658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.691106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.691857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.692318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.692756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.698683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:22.726979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:45:22.821744 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-81bc0c22-9010-4688-8958-02e50c90d41b tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 204 len: 0 microversion: 2.1 time: 0.142088 Aug 29 11:45:22.823462 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3462/6960] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:45:22 2022] DELETE /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:45:22.836025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:22.837098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:22.848519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.849333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.850163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:22.851398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:22.852255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:22.853013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:23.036829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:23.048353 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-941c203f-02f2-44dc-9810-41fd5fc9cf62 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1513 microversion: 2.1 time: 0.219406 Aug 29 11:45:23.049392 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3499/6961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:22 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:24.084031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:24.084736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:24.087963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:24.099024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:24.099516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:24.099949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:24.100676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:24.101131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:24.101560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:24.283101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb81858449b645ef8a74beb74b3405a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21dd36167e14898a3173f45a4c05560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:45:24.293034 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a03b5ad8-67c9-4a96-91c4-af3e07489cb0 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 200 len: 1513 microversion: 2.1 time: 0.212963 Aug 29 11:45:24.294092 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3463/6962] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:24 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:45:24.732053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c68da6-0f17-4ef2-8851-1e0a3ebc5010", "name": "network-vif-deleted", "tag": "bf18a639-15ed-4d80-9040-81072fb4df01"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:45:24.742782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:24.745984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:24.746552 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:24.747215 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:24.758862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=99 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:45:24.762779 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] Creating event network-vif-deleted:bf18a639-15ed-4d80-9040-81072fb4df01 for instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 on n-h1-854121-10 Aug 29 11:45:24.769003 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-931bcc4b-05b6-4646-bb7a-b8d24372f934 req-65bbe08b-5628-44ce-9a0e-5462fe0a72c8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041164 Aug 29 11:45:24.770031 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3500/6963] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:45:25.319473 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:45:25.320155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] [instance: 71c68da6-0f17-4ef2-8851-1e0a3ebc5010] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:45:25.328888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:25.329186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:25.329653 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:25.330442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:45:25.330916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:45:25.331357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:45:25.347421 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] HTTP exception thrown: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Request method failure captured: Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 HTTP/1.1 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKa0UIrFFGbCQ3ehGPgJmRVdWHX2l3CHq-lX4mqkMt-EXXK6i_4AohhMAPB6Pw9wk58GoOcghmLhUyip0mKCYP9K-bViz_xWf59pf5WSNJS5wXzhfzO73xjyZl9P3W8BYMTJ_EC7BDqdhGt_tnDzBLABKDO5g9hp4E_-DTDBt9FpO0o Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e21dd36167e14898a3173f45a4c05560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e21dd36167e14898a3173f45a4c05560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: e21dd36167e14898a3173f45a4c05560 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1310918778 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: bb81858449b645ef8a74beb74b3405a4 Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-ServersNegativeTestJSON-1310918778-project Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '71c68da6-0f17-4ef2-8851-1e0a3ebc5010'} Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:45:25.349162 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] Returning 404 to user: Instance 71c68da6-0f17-4ef2-8851-1e0a3ebc5010 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f2c51a4d-c584-4b0f-b9db-6470ff03f731 tempest-ServersNegativeTestJSON-1310918778 tempest-ServersNegativeTestJSON-1310918778-project] 10.222.0.47 "GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010" status: 404 len: 111 microversion: 2.1 time: 0.035420 Aug 29 11:45:25.353210 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3464/6964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:45:25 2022] GET /compute/v2.1/servers/71c68da6-0f17-4ef2-8851-1e0a3ebc5010 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:46:10.490464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0d214eb3-1336-444f-aff9-6179223d430c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: .version_select at 0x7f66cb142790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1395651253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJsXFIcYJ0Ciul3w2uvMEnYNNqjbgkQuw5P4uA8oxig6vtjDh/DpBsRU6y4zdaNBYY95zTM9S2ISFflh/tcPNJbeQryDsHjn+LFvDLpKM//eo9IwcGRYOIFwwGzOGwjiQ=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:10.521273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0d214eb3-1336-444f-aff9-6179223d430c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:46:10.532839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0d214eb3-1336-444f-aff9-6179223d430c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:46:10.580789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0d214eb3-1336-444f-aff9-6179223d430c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.500296 Aug 29 11:46:10.581470 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3501/6965] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:46:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:46:10.648485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1388330292", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1395651253", "networks": [{"uuid": "119c6140-9156-4005-8b44-987025503089"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:10.659050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:10.659771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:10.730611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] validate_networks() for [('119c6140-9156-4005-8b44-987025503089', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:46:11.287362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:46:11.288179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:46:11.288890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:46:11.289425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:46:11.291474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:46:11.306329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:11.307012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:11.307568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:11.308455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:11.309275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:11.310127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:11.342308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:46:11.350556 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:46:11.369548 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:46:11.372282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:46:11.427382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b19222d9-d209-4867-8302-125c333790ad tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782763 Aug 29 11:46:11.433909 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3465/6966] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:46:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:46:11.451194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-79741732-0faf-4356-bf23-b3a85302faba tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:11.453033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-79741732-0faf-4356-bf23-b3a85302faba tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:11.568562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-79741732-0faf-4356-bf23-b3a85302faba tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:11.584050 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-79741732-0faf-4356-bf23-b3a85302faba tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1263 microversion: 2.1 time: 0.142614 Aug 29 11:46:11.589106 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3502/6967] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:11 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:12.608541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:12.609303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:12.615907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:12.616404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:12.616856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:12.617592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:12.618243 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:12.618695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:12.710555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:12.726941 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8678d316-cc29-4c2d-a40a-863954e6acef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1315 microversion: 2.1 time: 0.124040 Aug 29 11:46:12.728777 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3466/6968] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:12 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:13.758694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:13.759640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:13.767506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:13.768014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:13.768478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:13.769237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:13.769754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:13.770206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:13.858666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:13.879483 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44c120fc-efc5-4048-8966-81c8074e4a0d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1321 microversion: 2.1 time: 0.124368 Aug 29 11:46:13.881404 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3503/6969] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:13 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1321 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:46:14.904895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:14.906260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:14.917652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:14.918540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:14.919292 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:14.921363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:14.922144 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:14.922722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:15.143249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4cd0e8-e93b-458b-9755-424baaee80cf", "tag": "72a368cd-3d50-4a62-a4f7-28da2326c10e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:15.174530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:15.177096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:15.178508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:15.202846 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] Creating event network-changed:72a368cd-3d50-4a62-a4f7-28da2326c10e for instance 1b4cd0e8-e93b-458b-9755-424baaee80cf on n-h2-854121-10 Aug 29 11:46:15.214153 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3f577331-6d9a-48f3-a3ad-4b9f36cfa20d req-5439ac6b-eb01-4338-bad4-05451b3e843a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085254 Aug 29 11:46:15.215238 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3504/6970] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:15.236033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:15.253065 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ccf2e035-9498-40c4-9aff-5feb05399de2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.353579 Aug 29 11:46:15.265803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3467/6971] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:14 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:16.294618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:16.295432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:16.303930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:16.304432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:16.305126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:16.306638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:16.307264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:16.307582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:16.545887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:16.560373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eccb142a-2a03-43ec-98b4-aa6af1d8a8de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.270551 Aug 29 11:46:16.567717 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3505/6972] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:16 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:17.584272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:17.584972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:17.592751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:17.593256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:17.593727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:17.594482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:17.594945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:17.595413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:17.771113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:17.781737 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7fbe752f-a820-4084-8b81-766fe546bbee tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.201367 Aug 29 11:46:17.782356 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3468/6973] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:17 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:18.804010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:18.804699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:18.813905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:18.814478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:18.815024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:18.815946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:18.816484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:18.816980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:18.990630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:19.000902 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-13f3ce5a-b73d-4782-a4be-29d84d6e9687 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.201070 Aug 29 11:46:19.001515 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3506/6974] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:18 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:19.982983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4cd0e8-e93b-458b-9755-424baaee80cf", "name": "network-vif-plugged", "status": "completed", "tag": "72a368cd-3d50-4a62-a4f7-28da2326c10e"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:20.000440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:20.001154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:20.001745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:20.019220 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] Creating event network-vif-plugged:72a368cd-3d50-4a62-a4f7-28da2326c10e for instance 1b4cd0e8-e93b-458b-9755-424baaee80cf on n-h2-854121-10 Aug 29 11:46:20.028048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:20.029178 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1cba66e6-8623-4633-b2ed-38fc563f12fb req-0de1f331-5280-4495-97c2-4c68d87c9e48 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051427 Aug 29 11:46:20.030548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:20.030755 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3469/6975] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:20.040640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:20.042048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:20.042955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:20.044543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:20.045270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:20.046101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:20.327268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:20.336220 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-319d074e-0f03-4f17-9e42-21f7b2067fab tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.316211 Aug 29 11:46:20.337613 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3507/6976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:20 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:46:21.357227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:21.361914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:21.362512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:21.364616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:21.372098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:21.372598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:21.373050 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:21.373846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:21.374296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:21.374733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:21.585909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:21.595719 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5d8347d-b69a-4e0e-a244-6de2f0b39623 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1363 microversion: 2.1 time: 0.240402 Aug 29 11:46:21.596384 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3470/6977] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:21 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:46:22.621125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:22.621797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:22.624968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:22.632141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:22.632771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:22.633272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:22.634221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:22.635006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:22.635518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:22.792713 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:22.801881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-923e3a81-55a2-47e9-a36a-f19aaaa0e3a6 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1554 microversion: 2.1 time: 0.185954 Aug 29 11:46:22.802679 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3508/6978] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:22 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:22.826008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:22.826780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:22.834544 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:22.835037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:22.835483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:22.836374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:22.837480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:22.837953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:22.993167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:23.008125 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-113d663b-f63d-4819-87d0-c4ac4788122b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1554 microversion: 2.1 time: 0.186834 Aug 29 11:46:23.009210 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3471/6979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:22 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:24.778369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b42b01-5a89-47b8-964d-a4cc249fcd1c"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:24.781340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:24.789315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:24.790773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:24.791265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:24.792052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:24.792550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:24.793038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:25.090307 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ff9d4d3-3916-48ae-9535-f2d363fc6803 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316704 Aug 29 11:46:25.090986 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3509/6980] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:46:24 2022] POST /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:37.078774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:37.079714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:37.081421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:37.082158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=34 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:37.089439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:37.089976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:37.090425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:37.091163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:37.091628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:37.092059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:37.186938 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'services' on Instance uuid 1b4cd0e8-e93b-458b-9755-424baaee80cf {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:46:37.272185 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dd3fafc2-b276-4213-b567-e8d72fe30872 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments/85b42b01-5a89-47b8-964d-a4cc249fcd1c" status: 202 len: 0 microversion: 2.1 time: 0.197618 Aug 29 11:46:37.272989 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3472/6981] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:46:37 2022] DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments/85b42b01-5a89-47b8-964d-a4cc249fcd1c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:46:37.283597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:37.284937 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:46:37.294793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:37.298973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:37.311471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:37.312132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:37.312492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:37.313327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:37.313837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:37.314287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:37.380746 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9c41e014-be15-4ade-b2c8-a55161394ffc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100994 Aug 29 11:46:37.382243 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3510/6982] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:37 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:38.404943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:38.407476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:38.414840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:38.415342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:38.415936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:38.416719 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:38.417183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:38.417670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:38.454793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7ec67bcf-f496-43ea-ba74-062d76f59dff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055312 Aug 29 11:46:38.455302 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3473/6983] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:38 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:39.468311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:39.471188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:39.480622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:39.481141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:39.481606 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:39.482414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:39.482929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:39.483381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:39.521870 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f645869-c4ad-4097-afaa-b6277619c813 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058294 Aug 29 11:46:39.522527 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3511/6984] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:39 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:40.537689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:40.541738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:40.549946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:40.550562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:40.551178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:40.551979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:40.552511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:40.553005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:40.591680 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-66fdda3b-dd9f-4f06-aa4d-1b62e108a05c tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060118 Aug 29 11:46:40.592290 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3474/6985] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:40 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:41.607962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:41.610308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:41.619027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:41.619395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:41.619861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:41.620624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:41.621115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:41.621564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:41.659358 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2be800eb-b8b8-4414-801b-2ff05291bb56 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055659 Aug 29 11:46:41.659953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3512/6986] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:41 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:42.674637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:42.677982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:42.691140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:42.691959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:42.692705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:42.693735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:42.694206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:42.694912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:42.760640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d4a37860-8d2d-42f7-a906-b8baa94c9b65 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091183 Aug 29 11:46:42.761773 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3475/6987] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:46:42 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:46:42.778537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:42.779474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:42.793616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:42.794578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:42.795382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:42.796714 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:42.797592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:42.798469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:42.901380 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf is not attached to volume 85b42b01-5a89-47b8-964d-a4cc249fcd1c Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments/85b42b01-5a89-47b8-964d-a4cc249fcd1c HTTP/1.1 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf is not attached to volume 85b42b01-5a89-47b8-964d-a4cc249fcd1c Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '1b4cd0e8-e93b-458b-9755-424baaee80cf', 'id': '85b42b01-5a89-47b8-964d-a4cc249fcd1c'} Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 85b42b01-5a89-47b8-964d-a4cc249fcd1c. Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf is not attached to volume 85b42b01-5a89-47b8-964d-a4cc249fcd1c Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:46:42.914961 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf is not attached to volume 85b42b01-5a89-47b8-964d-a4cc249fcd1c Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf is not attached to volume 85b42b01-5a89-47b8-964d-a4cc249fcd1c {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df9d0cb8-5d32-49ab-a14e-8187e307f010 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments/85b42b01-5a89-47b8-964d-a4cc249fcd1c" status: 404 len: 154 microversion: 2.1 time: 0.147007 Aug 29 11:46:42.922939 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3513/6988] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:46:42 2022] DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf/os-volume_attachments/85b42b01-5a89-47b8-964d-a4cc249fcd1c => generated 154 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:46:46.475923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:46.476907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:46.485127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:46.485628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:46.486117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:46.486998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:46.487705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:46.487916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:46.523232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:46:46.624222 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-128f3be1-5a6a-47e1-b7af-e9e55404d191 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 204 len: 0 microversion: 2.1 time: 0.151660 Aug 29 11:46:46.625346 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3476/6989] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:46:46 2022] DELETE /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:46:46.637950 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:46.639022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:46.649343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:46.650127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:46.650600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:46.651402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:46.651866 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:46.652315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:46.850319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:46.865989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08acd06a-7880-4c59-bbf7-0451dd3af2d8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1560 microversion: 2.1 time: 0.233392 Aug 29 11:46:46.867190 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3514/6990] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:46 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:46:47.903197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:47.903931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:47.911682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:47.912179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:47.912618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:47.913347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:47.913850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:47.914344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:48.089888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:48.102449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b91bb16-5234-4504-9d0c-0379e74f50f7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1560 microversion: 2.1 time: 0.203567 Aug 29 11:46:48.103589 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3477/6991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:47 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:48.933274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4cd0e8-e93b-458b-9755-424baaee80cf", "name": "network-vif-deleted", "tag": "72a368cd-3d50-4a62-a4f7-28da2326c10e"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:48.953354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:48.954317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:48.955160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:48.981342 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] Creating event network-vif-deleted:72a368cd-3d50-4a62-a4f7-28da2326c10e for instance 1b4cd0e8-e93b-458b-9755-424baaee80cf on n-h2-854121-10 Aug 29 11:46:48.991330 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-56d2b381-dd12-42aa-9582-f0bcd99f61f0 req-23b7b291-f844-4b33-8167-aec9a5375ce2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064550 Aug 29 11:46:48.991825 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3515/6992] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:49.138345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:49.139129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:49.147121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:49.147623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:49.148071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:49.149346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:49.150062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:49.150562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:49.187582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:49.188009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:49.188328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:49.188798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'fault' on Instance uuid 1b4cd0e8-e93b-458b-9755-424baaee80cf {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:46:49.241735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:49.258505 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eaf07655-d340-4c97-b697-7cb24e022d4f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 200 len: 1353 microversion: 2.1 time: 0.123306 Aug 29 11:46:49.259712 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3478/6993] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:49 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 1353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:50.283558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:50.284383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 1b4cd0e8-e93b-458b-9755-424baaee80cf] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:50.292593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:50.293154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:50.293670 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:50.294622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:50.295154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:50.295682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:50.312209 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf HTTP/1.1 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '1b4cd0e8-e93b-458b-9755-424baaee80cf'} Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:46:50.314108 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance 1b4cd0e8-e93b-458b-9755-424baaee80cf could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d7a38f7-d6f6-47ae-aa0c-f6617ec6d56b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf" status: 404 len: 111 microversion: 2.1 time: 0.038442 Aug 29 11:46:50.321598 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3516/6994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:50 2022] GET /compute/v2.1/servers/1b4cd0e8-e93b-458b-9755-424baaee80cf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:46:50.329194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da43b35e-6200-48b4-a293-090c5a61eaf0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '.version_select at 0x7f66c6678550>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:50.356066 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da43b35e-6200-48b4-a293-090c5a61eaf0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1395651253" status: 202 len: 0 microversion: 2.1 time: 0.031843 Aug 29 11:46:50.356674 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3479/6995] 10.222.0.47 () {58 vars in 1278 bytes} [Mon Aug 29 11:46:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1395651253 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:46:50.375497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c051a492-5477-47c8-a6ea-a9074d0cda3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: .version_select at 0x7f66c6e8eee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-577995089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB8E1VSW9548PTdTkJex/WVifIP4fYp104VasMbg0VTJjeNy0A3WkoehKNUTxPYbku7IwuGlUC0kuaO1VjIpg/i3kASGzH+BfTbXXK8FoP7V9SANcHf/qztw8mHygyLQg=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:50.393978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c051a492-5477-47c8-a6ea-a9074d0cda3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:46:50.400835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-c051a492-5477-47c8-a6ea-a9074d0cda3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:46:50.428444 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c051a492-5477-47c8-a6ea-a9074d0cda3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056863 Aug 29 11:46:50.429074 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3517/6996] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:46:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:50.486540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1035092627", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-577995089", "networks": [{"uuid": "119c6140-9156-4005-8b44-987025503089"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:50.550438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] validate_networks() for [('119c6140-9156-4005-8b44-987025503089', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:46:51.181663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:46:51.182126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:46:51.182613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:46:51.183029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:46:51.183447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:46:51.193408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:51.193942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:51.194675 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:51.195422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:51.196261 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:51.196732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:51.216121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:46:51.222440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:46:51.238611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:46:51.241202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:46:51.296653 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-278c878b-6863-436c-889e-7d9e45c853de tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814720 Aug 29 11:46:51.297574 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3480/6997] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:46:51.314274 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01de0542-ed2b-4d72-874e-5f377d52d8e3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:51.315055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-01de0542-ed2b-4d72-874e-5f377d52d8e3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:51.391130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-01de0542-ed2b-4d72-874e-5f377d52d8e3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:51.399508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01de0542-ed2b-4d72-874e-5f377d52d8e3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1262 microversion: 2.1 time: 0.089425 Aug 29 11:46:51.400510 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3518/6998] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:51 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:52.426898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:52.428002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:52.439907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:52.440776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:52.441339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:52.442621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:52.443475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:52.444244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:52.587529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:52.602876 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-02d0929f-ddab-4bcc-b3d6-23a3b90b1d33 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1314 microversion: 2.1 time: 0.184290 Aug 29 11:46:52.604259 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3481/6999] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:52 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:46:53.632447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:53.634473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:53.645529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:53.646093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:53.646551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:53.647291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:53.647765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:53.648263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:53.916583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:53.932047 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b39ceef-5f9a-4ea3-892d-1f19778347b3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1362 microversion: 2.1 time: 0.304668 Aug 29 11:46:53.933367 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3519/7000] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:53 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:54.347668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9907921-be0b-4023-b65a-7a468f1ddb11", "tag": "a3ebcc95-301a-481d-9de2-3884a8f66d95"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:54.375756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:54.376680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:54.377322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:54.395985 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] Creating event network-changed:a3ebcc95-301a-481d-9de2-3884a8f66d95 for instance c9907921-be0b-4023-b65a-7a468f1ddb11 on n-h2-854121-10 Aug 29 11:46:54.404212 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-0b9a3040-0369-4cc9-b11f-a555bcb663fa req-cf1344ea-f4c2-488d-8465-570d0e57b756 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060583 Aug 29 11:46:54.405568 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3482/7001] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:46:54.954788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:54.955511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:54.963636 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:54.964142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:54.964596 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:54.965357 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:54.965940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:54.966389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:55.129380 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:55.138471 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6a2553eb-11a0-4201-aa10-9d9eb303b1c3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1362 microversion: 2.1 time: 0.187769 Aug 29 11:46:55.139087 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3520/7002] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:54 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:56.169534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:56.170903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:56.183451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:56.185148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:56.186016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:56.187347 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:56.188229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:56.189036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:56.482639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:56.496239 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3856be8a-90e1-4934-ab0b-0736fd1f70e7 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1362 microversion: 2.1 time: 0.337606 Aug 29 11:46:56.497742 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3483/7003] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:56 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:57.533463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:57.534279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:57.543790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:57.544454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:57.544921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:57.545669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:57.546187 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:57.546640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:57.700402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:57.709822 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-377ea327-7a6a-419a-b5be-40c1d9b67721 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1362 microversion: 2.1 time: 0.180577 Aug 29 11:46:57.711173 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3521/7004] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:57 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:58.156519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9907921-be0b-4023-b65a-7a468f1ddb11", "name": "network-vif-plugged", "status": "completed", "tag": "a3ebcc95-301a-481d-9de2-3884a8f66d95"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:46:58.189732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:58.190650 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:58.191469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:58.217167 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] Creating event network-vif-plugged:a3ebcc95-301a-481d-9de2-3884a8f66d95 for instance c9907921-be0b-4023-b65a-7a468f1ddb11 on n-h2-854121-10 Aug 29 11:46:58.225815 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b822e519-dcdb-42cd-936b-a66100d8668b req-8a428f00-50ed-456c-9176-c15b5a00fa78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073360 Aug 29 11:46:58.227534 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3484/7005] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:46:58.746264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:58.746848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:58.754609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:58.755161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:58.755624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:58.756391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:58.756884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:58.757417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:58.915003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:46:58.923671 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-46b1612c-f7ea-4255-ab4f-378f8d3c6153 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1362 microversion: 2.1 time: 0.182753 Aug 29 11:46:58.924275 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3522/7006] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:58 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:46:59.949950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:46:59.951336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:46:59.959490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:59.959987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:59.960924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:46:59.961873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:46:59.962407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:46:59.962889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:00.132472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:00.141517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-55a83008-ca6f-4d78-9acc-d0d0faffe7b5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1553 microversion: 2.1 time: 0.198156 Aug 29 11:47:00.142258 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3485/7007] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:46:59 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:00.167767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:00.168834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:00.177983 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:00.178648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:00.179864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:00.180721 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:00.181417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:00.182010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:00.375594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:00.384349 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0628d7a3-4f9e-4d04-b719-99dd254ed06e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1553 microversion: 2.1 time: 0.222833 Aug 29 11:47:00.384967 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3523/7008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:00 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:02.003576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b0d662d-0933-4d15-8214-b8602816a8d0"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:02.008833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:02.014870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:02.016160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:02.031152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:02.031152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:02.031456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:02.032731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:02.033602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:02.034435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:02.309459 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-400edeb6-9ca5-4122-bc6b-9c64900d18ff tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314666 Aug 29 11:47:02.310214 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3486/7009] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:47:01 2022] POST /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:14.251509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:14.252080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:14.255833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:14.256699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:14.258802 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=64 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:14.266086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:14.266604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:14.267065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:14.267810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:14.268288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:14.268731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:14.378692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'services' on Instance uuid c9907921-be0b-4023-b65a-7a468f1ddb11 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:47:14.466813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6fa541a1-0ee3-471b-b40c-9bc32bce524f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments/2b0d662d-0933-4d15-8214-b8602816a8d0" status: 202 len: 0 microversion: 2.1 time: 0.218775 Aug 29 11:47:14.467895 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3524/7010] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:47:14 2022] DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments/2b0d662d-0933-4d15-8214-b8602816a8d0 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:47:14.476462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:14.478089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:14.487949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:14.493217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:14.503937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:14.504381 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:14.505374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:14.506368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:14.507456 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:14.509206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:14.549570 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-adb3e233-10f0-4fc5-bbc8-6a95edbf213e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075560 Aug 29 11:47:14.550225 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3487/7011] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:14 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:47:15.566928 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:15.570437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:15.577482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:15.578216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:15.578865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:15.579734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:15.580331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:15.580899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:15.618021 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0e79f9f-77c4-41f4-a310-c8712606842b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056650 Aug 29 11:47:15.618612 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3525/7012] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:15 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:16.631766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:16.634739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:16.643429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:16.643925 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:16.644374 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:16.645107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:16.645564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:16.646042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:16.688272 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f42ce26-111d-4d59-9b2b-72d8b5034d59 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060670 Aug 29 11:47:16.689380 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3488/7013] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:16 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:47:17.706805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:17.709923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:17.717396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:17.717938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:17.718402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:17.719147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:17.719625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:17.720079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:17.753939 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-449b69f0-7207-4506-8129-6277623c5e51 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055009 Aug 29 11:47:17.754425 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3526/7014] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:17 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:18.766767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:18.769071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:18.776847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:18.777346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:18.777818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:18.778549 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:18.779013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:18.779444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:18.819461 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2f286cc-b9da-47ec-b86f-215881ffd13e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056284 Aug 29 11:47:18.820391 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3489/7015] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:18 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:19.832213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:19.834547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:19.841648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:19.842182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:19.842633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:19.843352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:19.843819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:19.844257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:19.878261 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f9ae08ad-6e62-423a-ba23-cc0e24f84919 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050016 Aug 29 11:47:19.878849 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3527/7016] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:19 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:47:19.889948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:19.890627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:19.898563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:19.899167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:19.899608 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:19.900332 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:19.900784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:19.901212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:19.988949 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 is not attached to volume 2b0d662d-0933-4d15-8214-b8602816a8d0 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments/2b0d662d-0933-4d15-8214-b8602816a8d0 HTTP/1.1 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 is not attached to volume 2b0d662d-0933-4d15-8214-b8602816a8d0 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': 'c9907921-be0b-4023-b65a-7a468f1ddb11', 'id': '2b0d662d-0933-4d15-8214-b8602816a8d0'} Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2b0d662d-0933-4d15-8214-b8602816a8d0. Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 is not attached to volume 2b0d662d-0933-4d15-8214-b8602816a8d0 Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:47:19.991159 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 is not attached to volume 2b0d662d-0933-4d15-8214-b8602816a8d0 Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 is not attached to volume 2b0d662d-0933-4d15-8214-b8602816a8d0 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af356a24-404f-434d-b229-6a520d5199db tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments/2b0d662d-0933-4d15-8214-b8602816a8d0" status: 404 len: 154 microversion: 2.1 time: 0.107061 Aug 29 11:47:19.995337 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3490/7017] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:47:19 2022] DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11/os-volume_attachments/2b0d662d-0933-4d15-8214-b8602816a8d0 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:47:23.422138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:23.422903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:23.430549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:23.431063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:23.431524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:23.432289 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:23.432885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:23.433328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:23.467047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:47:23.560305 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-919f56d0-e72e-4aae-a79b-7aa1ff741699 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 204 len: 0 microversion: 2.1 time: 0.141332 Aug 29 11:47:23.560305 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3528/7018] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:47:23 2022] DELETE /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 11:47:23.571813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:23.572731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:23.585685 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:23.586554 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:23.587353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:23.588656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:23.589509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:23.590312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:23.773565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:23.782518 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64c453d5-3fb0-4545-96aa-6fde32b3a88e tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1559 microversion: 2.1 time: 0.216945 Aug 29 11:47:23.783126 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3491/7019] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:23 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:24.805784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:24.806417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:24.813861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:24.814369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:24.814825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:24.815558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:24.816030 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:24.816474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:24.984976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:24.998989 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3f516588-94ad-4546-8bf5-3043a9e523f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1559 microversion: 2.1 time: 0.197534 Aug 29 11:47:25.000091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3529/7020] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:24 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:47:25.551344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9907921-be0b-4023-b65a-7a468f1ddb11", "name": "network-vif-deleted", "tag": "a3ebcc95-301a-481d-9de2-3884a8f66d95"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:25.566902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:25.567390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:25.567840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:25.582539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] Creating event network-vif-deleted:a3ebcc95-301a-481d-9de2-3884a8f66d95 for instance c9907921-be0b-4023-b65a-7a468f1ddb11 on n-h2-854121-10 Aug 29 11:47:25.589263 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-95a66cba-966d-445f-9be4-4a1b5e0c056b req-e0278196-66e8-4237-8f78-77683ecb70fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041884 Aug 29 11:47:25.589999 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3492/7021] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:26.026969 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:26.027920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:26.040120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:26.040997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:26.041842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:26.043180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:26.043743 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:26.044443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:26.111394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:26.112205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:26.113021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:26.113909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'fault' on Instance uuid c9907921-be0b-4023-b65a-7a468f1ddb11 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:47:26.180561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:26.193466 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c32c1c35-4966-472f-8f17-0aad75608709 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 200 len: 1352 microversion: 2.1 time: 0.174368 Aug 29 11:47:26.194761 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3530/7022] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:26 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 1352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:27.218070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:27.218795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: c9907921-be0b-4023-b65a-7a468f1ddb11] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:27.226555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:27.227335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:27.227788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:27.228540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:27.229023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:27.229437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:27.245910 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 HTTP/1.1 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'c9907921-be0b-4023-b65a-7a468f1ddb11'} Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:47:27.247524 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance c9907921-be0b-4023-b65a-7a468f1ddb11 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-53888d8b-2298-45d4-8e8d-d0156e4d7120 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11" status: 404 len: 111 microversion: 2.1 time: 0.036236 Aug 29 11:47:27.255948 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3493/7023] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:27 2022] GET /compute/v2.1/servers/c9907921-be0b-4023-b65a-7a468f1ddb11 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:47:27.262640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-557439a9-526f-4b7d-9a7c-2b7eaf99cbd8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '.version_select at 0x7f66c5901c10>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:27.287649 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-557439a9-526f-4b7d-9a7c-2b7eaf99cbd8 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-577995089" status: 202 len: 0 microversion: 2.1 time: 0.032650 Aug 29 11:47:27.289390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3531/7024] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:47:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-577995089 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:47:27.311569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-37550895-1e28-4b38-8a4f-92b9a2d5a15f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: .version_select at 0x7f66cb0e6f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-256594224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM4WHhgjO9rLkeCR71UIlPPehN8Uf3GT+gUostg20z0mf+yChVuNhR0dl4LKTU75pu18DCCByMoqHqlYAPq5juBiMuwl11bnppJlhExoSf5wCf4tX4JoXEs8jFaPDpKvQ=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:27.330015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-37550895-1e28-4b38-8a4f-92b9a2d5a15f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:47:27.337217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-37550895-1e28-4b38-8a4f-92b9a2d5a15f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:47:27.367362 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-37550895-1e28-4b38-8a4f-92b9a2d5a15f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.059623 Aug 29 11:47:27.368009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3494/7025] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:47:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:27.424692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-949242466", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-256594224", "networks": [{"uuid": "119c6140-9156-4005-8b44-987025503089"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:27.499976 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] validate_networks() for [('119c6140-9156-4005-8b44-987025503089', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:47:27.977184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:47:27.977730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:47:27.978257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:47:27.978703 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:47:27.979188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:47:27.989446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:27.989984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:27.990448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:27.991806 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:27.992818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:27.992968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:28.012591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:47:28.018832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Getting quotas for user b9948839945d4e468f3537e5186746af and project 595b6e07232840168d92ea4c81ef60ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:47:28.033873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:47:28.036341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:47:28.092519 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-91e16ff1-eaa9-4c53-bffe-22ce7cca1e3b tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671389 Aug 29 11:47:28.093934 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3532/7026] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:47:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:47:28.111577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3b604908-b6e9-4f15-82a0-ac6b7dbddb46 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:28.112158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3b604908-b6e9-4f15-82a0-ac6b7dbddb46 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:28.199595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3b604908-b6e9-4f15-82a0-ac6b7dbddb46 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:28.208818 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3b604908-b6e9-4f15-82a0-ac6b7dbddb46 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1261 microversion: 2.1 time: 0.101848 Aug 29 11:47:28.210381 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3495/7027] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:28 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:47:29.233367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:29.234914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:29.242291 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:29.242605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:29.242986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:29.243759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:29.244251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:29.244704 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:29.391807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:29.409760 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e7159232-524c-440f-a9a4-103877507099 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1313 microversion: 2.1 time: 0.181123 Aug 29 11:47:29.432352 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3533/7028] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:29 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:47:30.448902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:30.449525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:30.456807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:30.457281 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:30.457739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:30.458450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:30.458906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:30.459329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:30.715937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:30.731558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d69a608-650d-4d00-ad04-63277878fedd tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.286198 Aug 29 11:47:30.732689 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3496/7029] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:30 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:31.075120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f1787a-7595-444d-bcbe-ece4a6411f15", "tag": "2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:31.097756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:31.098322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:31.098761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:31.114147 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] Creating event network-changed:2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2 for instance 45f1787a-7595-444d-bcbe-ece4a6411f15 on n-h2-854121-10 Aug 29 11:47:31.120776 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1faebff6-11c7-4d89-b20b-afd71ffeb933 req-cfd29f40-0bde-48d9-afa5-5f48302169bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057293 Aug 29 11:47:31.121418 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3534/7030] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:31.764287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:31.764950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:31.772491 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:31.773325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:31.773636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:31.774325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:31.774806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:31.775248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:31.932397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:31.941206 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34ad76a1-9b75-475b-b79f-ec603325f1fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.180797 Aug 29 11:47:31.941912 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3497/7031] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:31 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:32.964647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:32.965366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:32.972079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:32.972586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:32.973037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:32.973809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:32.974287 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:32.974727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:33.149245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:33.159003 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58fe516f-0104-4c86-80aa-7c24d32b9179 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.199648 Aug 29 11:47:33.159704 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3535/7032] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:32 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:34.182185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:34.182885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:34.190390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:34.190940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:34.191437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:34.192248 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:34.192840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:34.193316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:34.364194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:34.373166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-418ba600-6faa-402d-a018-36e1e502ce82 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.195314 Aug 29 11:47:34.373806 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3498/7033] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:34 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:35.394751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:35.395364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:35.403687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:35.404197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:35.404663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:35.405409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:35.405934 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:35.406383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:35.562171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:35.572509 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03f00173-9a71-488c-8a57-116c77268840 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.181886 Aug 29 11:47:35.573128 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3536/7034] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:35 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:36.594947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:36.595494 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:36.603644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:36.604134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:36.604580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:36.605301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:36.605788 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:36.606220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:36.765147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:36.775434 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-337b1556-dcda-4b5d-b599-3df5369c5876 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.184266 Aug 29 11:47:36.776185 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3499/7035] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:36 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:37.797562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:37.798246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:37.805865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:37.806506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:37.807077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:37.807916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:37.808497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:37.809041 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:37.957493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:37.966381 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19d6f08a-3120-47c2-a3cc-4b8e431dc6a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.172805 Aug 29 11:47:37.967007 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3537/7036] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:37 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:38.273985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f1787a-7595-444d-bcbe-ece4a6411f15", "name": "network-vif-plugged", "status": "completed", "tag": "2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:38.281664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:38.292224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:38.292940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:38.293771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:38.310527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] Creating event network-vif-plugged:2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2 for instance 45f1787a-7595-444d-bcbe-ece4a6411f15 on n-h2-854121-10 Aug 29 11:47:38.318276 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6ee2f574-5a0c-46cc-83d7-f064f745df3e req-0faab327-2185-4660-8045-1af6b307faa2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049438 Aug 29 11:47:38.320304 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3500/7037] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:38.992360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:38.993058 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:38.995333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:38.996046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:39.003761 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:39.004276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:39.004735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:39.005478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:39.005981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:39.007043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:39.155195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:39.164497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8587dd4f-9a06-4104-8d48-236b11ea437f tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1361 microversion: 2.1 time: 0.178764 Aug 29 11:47:39.165111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3538/7038] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:38 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:40.206870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:40.208171 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:40.217605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:40.218132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:40.218586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:40.219312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:40.219776 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:40.220468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:40.373158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:40.382519 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-234f5381-ae5e-444b-b429-d617bdd7646d tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1552 microversion: 2.1 time: 0.184408 Aug 29 11:47:40.383132 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3501/7039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:40 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:40.403497 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:40.404135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:40.411751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:40.412284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:40.412901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:40.413617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:40.414119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:40.414561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:40.844926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:47:40.854160 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e8cf16d-be1b-4f30-9aad-b52b7b1d51c9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1552 microversion: 2.1 time: 0.454561 Aug 29 11:47:40.854752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3539/7040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:47:40 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1552 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:47:42.434030 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1e42739-1d02-442c-8844-6a69e190ed8b"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:47:42.436503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:42.445135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:42.445630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:42.446106 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:42.446860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:42.447319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:42.447772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:42.744306 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1645dd1f-2d7c-40b9-b779-cd0a975b14cf tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "POST /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314228 Aug 29 11:47:42.745226 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3502/7041] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:47:42 2022] POST /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:47:54.758508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:54.759277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:54.761898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:54.762617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:54.769048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:54.769570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:54.770065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:54.770830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:54.771889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:54.772306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:54.881751 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'services' on Instance uuid 45f1787a-7595-444d-bcbe-ece4a6411f15 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:47:54.963102 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd99f1ca-f60a-4e7f-b513-d2f75198746a tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments/a1e42739-1d02-442c-8844-6a69e190ed8b" status: 202 len: 0 microversion: 2.1 time: 0.209622 Aug 29 11:47:54.963944 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3540/7042] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:47:54 2022] DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments/a1e42739-1d02-442c-8844-6a69e190ed8b => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:47:54.971197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:54.972020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:47:54.977580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:54.979953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:54.987499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:54.988134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:54.988581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:54.989319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:54.989802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:54.990357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:55.033944 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-11844929-fb4c-494a-a90e-131a35e8b580 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064074 Aug 29 11:47:55.035317 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3503/7043] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:54 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:56.057487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:56.061966 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:56.070391 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:56.070914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:56.071382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:56.072150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:56.072638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:56.073096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:56.111789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db9b842a-97a0-4ec1-9aa2-8b37f3b1c7b2 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064497 Aug 29 11:47:56.112587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3541/7044] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:56 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:57.129203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:57.133833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:57.147349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:57.148215 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:57.148939 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:57.150127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:57.150995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:57.151768 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:57.216337 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-854fb344-7fe2-4068-a2c5-47a0ca5796f0 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094294 Aug 29 11:47:57.217467 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3504/7045] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:57 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:58.233210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:58.235910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:58.248047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:58.249006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:58.249868 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:58.251471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:58.252362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:58.253238 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:58.300189 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48a9e6d4-42e9-4764-b266-be96cff25e58 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071896 Aug 29 11:47:58.300812 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3542/7046] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:58 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:47:59.314401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:47:59.316863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:47:59.325530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:59.326070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:59.326523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:59.327260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:47:59.327726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:47:59.328166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:47:59.363879 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b113d0f-4e0f-481c-b8f0-d898b25e80a9 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053648 Aug 29 11:47:59.364489 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3505/7047] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:47:59 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:48:00.378485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:00.381327 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:00.389052 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:00.389563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:00.390063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:00.390823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:00.391302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:00.391755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:00.433226 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cb0adc5f-5a54-460e-9249-f990cf201d11 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059192 Aug 29 11:48:00.433802 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3543/7048] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:48:00 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:48:00.447197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:00.448001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:00.454918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:00.455412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:00.455859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:00.456590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:00.457049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:00.457484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:00.545527 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 is not attached to volume a1e42739-1d02-442c-8844-6a69e190ed8b Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments/a1e42739-1d02-442c-8844-6a69e190ed8b HTTP/1.1 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 is not attached to volume a1e42739-1d02-442c-8844-6a69e190ed8b Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '45f1787a-7595-444d-bcbe-ece4a6411f15', 'id': 'a1e42739-1d02-442c-8844-6a69e190ed8b'} Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1e42739-1d02-442c-8844-6a69e190ed8b. Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 is not attached to volume a1e42739-1d02-442c-8844-6a69e190ed8b Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:48:00.547402 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 is not attached to volume a1e42739-1d02-442c-8844-6a69e190ed8b Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 is not attached to volume a1e42739-1d02-442c-8844-6a69e190ed8b {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28e21e71-359c-4b9a-a5bd-02421ea792ef tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments/a1e42739-1d02-442c-8844-6a69e190ed8b" status: 404 len: 154 microversion: 2.1 time: 0.106933 Aug 29 11:48:00.554443 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3506/7049] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:48:00 2022] DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15/os-volume_attachments/a1e42739-1d02-442c-8844-6a69e190ed8b => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:48:04.002029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:04.002582 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:04.010163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:04.010684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:04.011142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:04.011886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:04.012367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:04.012817 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:04.044347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:48:04.150217 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-361cc740-1dd6-4e6c-92fa-c4feefbf8fd3 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 204 len: 0 microversion: 2.1 time: 0.151929 Aug 29 11:48:04.150951 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3544/7050] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:48:03 2022] DELETE /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:48:04.160302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:04.160943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:04.169451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:04.170007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:04.170467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:04.171221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:04.171765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:04.172201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:04.339896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:04.355146 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d292de6c-5f33-4d1b-aba5-5b7337ee70a5 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1558 microversion: 2.1 time: 0.198397 Aug 29 11:48:04.356224 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3507/7051] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:04 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:05.393807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:05.394436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:05.403063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:05.403569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:05.404027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:05.404753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:05.405229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:05.405668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:05.567808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:05.577145 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bff00e91-1e7f-4a02-9296-1116e1c769bc tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1558 microversion: 2.1 time: 0.188056 Aug 29 11:48:05.577765 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3545/7052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:05 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:06.262500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f1787a-7595-444d-bcbe-ece4a6411f15", "name": "network-vif-deleted", "tag": "2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:48:06.282502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:06.283405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:06.284210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:06.307857 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] Creating event network-vif-deleted:2ed6ca62-51b8-4e23-ad87-3d5f411d0cb2 for instance 45f1787a-7595-444d-bcbe-ece4a6411f15 on n-h2-854121-10 Aug 29 11:48:06.317425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-8f345728-5b2e-48ee-ae9a-33a332bdfe0e req-7c0c98c7-33e7-46af-9939-0d033b24e300 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062032 Aug 29 11:48:06.319394 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3508/7053] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:48:06.600567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:06.601548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:06.612510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:06.613117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:06.613659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:06.614537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:06.615253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:06.615840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:06.667793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:06.668687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:06.669640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:06.671571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lazy-loading 'fault' on Instance uuid 45f1787a-7595-444d-bcbe-ece4a6411f15 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:48:06.737901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9948839945d4e468f3537e5186746af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595b6e07232840168d92ea4c81ef60ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:06.749934 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6be09927-b4c4-447d-88b2-e3e83ff5a094 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 200 len: 1351 microversion: 2.1 time: 0.153976 Aug 29 11:48:06.750686 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3546/7054] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:06 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:07.779995 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:07.780721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] [instance: 45f1787a-7595-444d-bcbe-ece4a6411f15] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:07.789408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:07.790330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:07.791147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:07.792495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:07.793358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:07.793999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:07.810923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] HTTP exception thrown: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Request method failure captured: Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 HTTP/1.1 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKb7Jlo_SU6Kyvj8b83RBOiDmWlyzWSJLeDt_sZomDQwwaaWFarEu7TiFLHoaXvOHDnsNl3Pzz2GcOOgorl44PWVFSgZtd4wPUswuP9NjcP6XrLuzYgtrfDdoFiAk5KLjru3NB1Ntne3Kmjdu5P5aVE6Zf8_-qlZc3zsnAKeaQQMonA Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/595b6e07232840168d92ea4c81ef60ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 595b6e07232840168d92ea4c81ef60ff Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-16328688 Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: b9948839945d4e468f3537e5186746af Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestEncryptedCinderVolumes-16328688-project Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '45f1787a-7595-444d-bcbe-ece4a6411f15'} Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:48:07.812889 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Returning 404 to user: Instance 45f1787a-7595-444d-bcbe-ece4a6411f15 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1e523a63-aaf6-4b49-9087-b3398122ac14 tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15" status: 404 len: 111 microversion: 2.1 time: 0.040365 Aug 29 11:48:07.821492 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3509/7055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:07 2022] GET /compute/v2.1/servers/45f1787a-7595-444d-bcbe-ece4a6411f15 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:48:07.827970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3255432f-868c-4744-8e35-aa2b058110fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] Calling method '.version_select at 0x7f66c71f5940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:07.852919 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3255432f-868c-4744-8e35-aa2b058110fb tempest-TestEncryptedCinderVolumes-16328688 tempest-TestEncryptedCinderVolumes-16328688-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-256594224" status: 202 len: 0 microversion: 2.1 time: 0.029250 Aug 29 11:48:07.853531 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3547/7056] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 29 11:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-256594224 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:48:41.622139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27d3f769-b12f-4ba7-a0fb-6b3baff609c5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: .version_select at 0x7f66c5db1ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-186645120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlDXhPLYiYSIN60THOYYmsZwLkvPb0M+pzNsU665rcnamfThmW2ZRWmx3NSxEkhl++mLtEzgT4YvIceEWAR8rSo8B7hlgQ5BVVpVsaQFM4cTp4196qPtv0E3U+iyGQaQA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:48:41.628399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:41.629040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=34 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:41.642699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27d3f769-b12f-4ba7-a0fb-6b3baff609c5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:48:41.649179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-27d3f769-b12f-4ba7-a0fb-6b3baff609c5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for user 8b517eaada314816b515eb7cad89b04d and project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:48:41.678427 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27d3f769-b12f-4ba7-a0fb-6b3baff609c5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060587 Aug 29 11:48:41.679054 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3510/7057] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:48:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:48:41.732781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:41.733945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:41.739301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-607826438", "imageRef": "8eb4b94e-cfb5-4fd5-9750-44b73723c7d9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-186645120", "networks": [{"uuid": "4cbaee84-d422-4758-891d-16a27e3e2ad6"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:48:41.940490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] validate_networks() for [('4cbaee84-d422-4758-891d-16a27e3e2ad6', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:48:42.386853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:48:42.387288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:48:42.387779 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:48:42.388201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:48:42.388646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:48:42.398739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:42.399242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:42.399987 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:42.400768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:42.401244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:42.401687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:42.423844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:48:42.434554 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for user 8b517eaada314816b515eb7cad89b04d and project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:48:42.460615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:48:42.465062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8eb4b94e-cfb5-4fd5-9750-44b73723c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:48:42.540346 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-844b54d8-9627-43db-b92c-5a686ab2806d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809729 Aug 29 11:48:42.540905 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3548/7058] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:48:42.561344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ff8bc4ea-b79b-4dc0-8f39-83448c0223f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:42.562479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ff8bc4ea-b79b-4dc0-8f39-83448c0223f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:42.776303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ff8bc4ea-b79b-4dc0-8f39-83448c0223f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:42.790510 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ff8bc4ea-b79b-4dc0-8f39-83448c0223f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1257 microversion: 2.1 time: 0.237448 Aug 29 11:48:42.791247 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3511/7059] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:42 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1257 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:43.815438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:43.817730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:43.830049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:43.831137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:43.832994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:43.834484 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:43.835504 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:43.837364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:43.987233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:44.002942 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0b1851f0-8a42-4c47-a832-99ef00230d62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1317 microversion: 2.1 time: 0.193606 Aug 29 11:48:44.005313 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3549/7060] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:43 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:48:45.034890 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:45.036286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:45.060814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:45.062011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:45.064848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:45.067153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:45.070001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:45.070670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:45.654680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:45.685294 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b8610422-d2d0-4467-94f6-2162afd12ae3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.656317 Aug 29 11:48:45.716992 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3512/7061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:45 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:46.727899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:46.729820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:46.759712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:46.771036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:46.772077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:46.773426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:46.774421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:46.775768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:47.046759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:47.058995 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-78f597f1-d7be-46c0-bf4c-81007781cb9e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.337899 Aug 29 11:48:47.061102 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3550/7062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:46 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:47.085903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:48:47.098803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:47.099704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:47.100406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:47.119802 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] Creating event network-changed:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:48:47.128095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-11d626f8-3fb4-44ee-b561-650f248541b3 req-4ba8038c-aacb-409a-8ed3-0bad9c791fa3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174722 Aug 29 11:48:47.129481 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3513/7063] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:48:48.091685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:48.094511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:48.109405 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:48.110177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:48.110671 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:48.112231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:48.113210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:48.114199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:48.294307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:48.315708 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2ca73797-0dc0-4b1f-9d1a-9bedb54e2bf6 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.237180 Aug 29 11:48:48.316945 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3551/7064] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:48 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:49.348497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:49.349516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:49.358424 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:49.359422 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:49.360130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:49.360965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:49.361658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:49.362471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:49.576420 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:49.585637 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be05f8b2-3631-438a-9f48-b0a07ca80499 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.242814 Aug 29 11:48:49.586685 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3514/7065] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:49 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:48:50.606511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:50.607173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:50.615413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:50.616015 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:50.616489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:50.617265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:50.617775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:50.618232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:50.806663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:50.822062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7323e9b1-c32a-4eeb-af05-da93fb292573 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.218884 Aug 29 11:48:50.823704 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3552/7066] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:50 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:51.844765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:51.845433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:51.853403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:51.853941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:51.854378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:51.855089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:51.855543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:51.856051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:52.040010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:52.050219 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b6d1a1a8-6bdf-47d3-b3a6-b680f4037e09 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.209512 Aug 29 11:48:52.052073 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3515/7067] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:51 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:53.072675 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:53.073412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:53.076882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:53.078150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:53.089735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:53.090644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:53.091453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:53.092825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:53.093724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:53.094261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:53.283527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:53.299001 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-19b54f89-6f92-4bcf-8277-0c6d389a9281 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.229874 Aug 29 11:48:53.300092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3553/7068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:53 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:54.335823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:54.336618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:54.339002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:48:54.346690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:54.347439 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:54.347999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:54.349121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:54.349739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:54.350278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:54.526792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:54.535463 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ffe0136f-b248-405f-8c10-c467f302a419 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.203736 Aug 29 11:48:54.536443 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3516/7069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:54 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:55.558431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:55.559119 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:55.568360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:55.568994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:55.569468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:55.570267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:55.570754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:55.571232 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:55.732269 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:55.741207 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-552f4745-9d83-4b5a-8afa-0342595284d5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.186780 Aug 29 11:48:55.741822 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3554/7070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:55 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:48:56.763806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:56.764479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:56.772569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:56.773062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:56.773520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:56.774272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:56.774729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:56.775158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:56.949132 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:56.964583 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-96198acf-ea5f-45e8-b1bb-cc9208be5bd9 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.204997 Aug 29 11:48:56.965406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3517/7071] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:56 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:57.990628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:57.991383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:57.999351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:57.999855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:58.000309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:58.001211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:58.001784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:58.002319 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:58.184150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:58.194795 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c6b6efd-57dd-4c12-a258-58ced517e6c8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.210230 Aug 29 11:48:58.195473 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3555/7072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:57 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:48:58.551857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "name": "network-vif-plugged", "status": "completed", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:48:58.573419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:58.574342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:58.575124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:58.598757 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] Creating event network-vif-plugged:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:48:58.608381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ade0990e-8a16-405d-9ba3-844211592654 req-13af0235-b629-4021-8486-bd2c6665f967 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064036 Aug 29 11:48:58.610021 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3518/7073] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:48:59.232992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:48:59.234201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:48:59.246705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:59.247483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:59.248259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:59.249491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:48:59.250364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:48:59.251146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:48:59.421270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:48:59.436238 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d2d1826-caa6-4a58-b49e-fa47e9c25bd2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1357 microversion: 2.1 time: 0.210473 Aug 29 11:48:59.437210 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3556/7074] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:48:59 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:49:00.472210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:00.472979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:00.480187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.480684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.481129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.481898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.482369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.482799 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.646224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:00.655347 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-20bd8a90-3341-48c0-9f84-28dc4e114a70 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1547 microversion: 2.1 time: 0.188542 Aug 29 11:49:00.655970 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3519/7075] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:49:00 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:49:00.684347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:00.685057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:00.694626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.695305 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.695862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.696706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.697285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.697893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.868065 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:00.877149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7fe7ef65-a49b-4bf7-9b53-abf02979e35e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1547 microversion: 2.1 time: 0.204482 Aug 29 11:49:00.877903 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3557/7076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:49:00 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:49:00.899483 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:00.904524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:00.905329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Searching by: {'deleted': False, 'project_id': '0545aba904bd4986aa5b7479fee72d0e'} {{(pid=128682) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 11:49:00.912336 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.912826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.913272 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.914054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:00.914514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:00.914953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:00.947323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.multi_cell_list [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 11:49:00.979746 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89e9905e-0232-4ce4-b0a7-0b05caab064e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.085072 Aug 29 11:49:00.980836 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3520/7077] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 11:49:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:49:00.996045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:00.996682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:01.003248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:01.003897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:01.004352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:01.005091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:01.005564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:01.006038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:01.156230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:01.166590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-82fde9ee-5218-4d6b-bea3-58824aeb454d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1547 microversion: 2.1 time: 0.174334 Aug 29 11:49:01.167212 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3558/7078] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:49:00 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:49:02.907868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e093e33c-0127-464a-8024-0159ee3bbbc0"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:49:02.910822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:02.918191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:02.918693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:02.919143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:02.919882 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:02.920348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:02.920784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:03.226900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5c8ebe13-56e6-454f-8cf4-d6c8826d984e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323367 Aug 29 11:49:03.227585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3521/7079] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:49:02 2022] POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:49:17.696395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:17.697068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:17.700164 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:49:17.700964 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=62 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:49:17.710348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:17.710918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:17.711524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:17.712462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:17.713009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:17.713516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:17.871911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:17.881742 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-158a381b-9a84-45dd-81d0-917c9e7a1345 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1593 microversion: 2.1 time: 0.190835 Aug 29 11:49:17.883025 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3559/7080] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:49:17 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1593 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:49:20.266385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:49:20.269509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:49:20.271469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:49:20.400502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:49:20.419967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:20.420857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:20.421918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:20.445561 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] Creating event network-changed:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:49:20.456974 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-b3f0149b-a4f2-460c-be13-366203cf9ec3 req-e6307d1e-0117-4678-b375-4ac0f0abbb6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193749 Aug 29 11:49:20.462198 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3522/7081] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:49:21.656708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1976423971"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:49:21.657797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:21.669233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:21.670307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:21.670920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:21.671872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:21.672507 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:21.673158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:21.855280 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Adding security group 37d72dc4-b697-49bc-97f7-306ae6f4f2d4 to port cc84380f-d51a-4ab5-bec4-7122e2834ea8 Aug 29 11:49:22.245373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90d3f0fe-911f-4fbd-9083-026de4d70c62 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action" status: 202 len: 0 microversion: 2.1 time: 0.593555 Aug 29 11:49:22.246719 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3560/7082] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:49:21 2022] POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:49:22.257325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:49:22.258241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:49:22.265302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:22.266430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:22.267008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:22.267906 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:22.268496 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:22.269909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:22.451114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:49:22.461838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d2eaef9a-8ed5-489e-b49f-1536089770ac tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1759 microversion: 2.1 time: 0.210699 Aug 29 11:49:22.475543 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3523/7083] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:49:22 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:49:22.481107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:49:22.499471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:49:22.500293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:49:22.500924 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:49:22.515063 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] Creating event network-changed:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:49:22.531820 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-37ed92b7-5016-481e-b0fe-0c5fcd3d6836 req-165396ed-f2c9-4293-93bf-2e818df2331e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058241 Aug 29 11:49:22.532447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3561/7084] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:51:00.193672 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 11:51:00.194560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:51:00.195227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=8 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:51:00.196992 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 11:51:00.201227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:51:00.203729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:51:00.212998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:00.213507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:00.214041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:00.214732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:00.215196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:00.215635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:00.310891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-efeb4bf1-4d89-4438-8d4b-d68417f48011 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action" status: 202 len: 0 microversion: 2.1 time: 0.118744 Aug 29 11:51:00.311873 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3524/7085] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:51:00 2022] POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:51:00.323486 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:51:00.324609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:51:00.326023 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=12 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:51:00.328973 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 11:51:00.331314 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:51:00.331569 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a (ip 10.222.0.47) !!! Aug 29 11:51:00.342315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:51:00.343839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:51:00.355614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:00.356273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:00.356749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:00.357537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:00.358068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:00.358522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:00.601307 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:51:00.617066 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-762ebdfb-8612-46a2-97af-726680caaaec tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1761 microversion: 2.1 time: 0.297735 Aug 29 11:51:00.619548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3562/7086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:51:00 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1761 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:51:01.645912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:51:01.646790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:51:01.655728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:01.656220 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:01.656784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:01.657513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:51:01.658002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:51:01.658429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:51:01.662581 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40266. Aug 29 11:51:01.857110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:51:01.866478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9312b0ee-19b0-458d-8c81-789706845a98 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1759 microversion: 2.1 time: 0.226617 Aug 29 11:51:01.867089 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3525/7087] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:51:01 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:14.597502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:14.598628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:14.605593 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1976423971"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:14.606445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:14.618920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:14.619559 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:14.620089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:14.620965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:14.621576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:14.622107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:14.629158 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40286. Aug 29 11:52:14.798681 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.network.security_group_api [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Removing security group 37d72dc4-b697-49bc-97f7-306ae6f4f2d4 from port cc84380f-d51a-4ab5-bec4-7122e2834ea8 Aug 29 11:52:15.199907 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5d47a314-1a4d-44a8-8420-6f7ee4e1007e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action" status: 202 len: 0 microversion: 2.1 time: 0.605000 Aug 29 11:52:15.206381 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3563/7088] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:52:14 2022] POST /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:52:15.206683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:15.207404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:15.211560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:15.237124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:15.238328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:15.238812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:15.256520 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] Creating event network-changed:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:52:15.262814 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-d8788678-da23-4629-bbc6-78c42b1dd2ed req-754210d2-6c31-42f3-afcb-f8b0f8f8cff2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058130 Aug 29 11:52:15.263484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3526/7089] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:16.866897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:16.867509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:16.875447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:16.875967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:16.876543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:16.877300 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:16.877838 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:16.878302 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:16.978718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lazy-loading 'services' on Instance uuid 16453b42-88d2-466e-970b-73db7a19163a {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:52:17.087006 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 11:52:17.288499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:17.301216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:17.302247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:17.303040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:17.325188 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] Creating event network-changed:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:52:17.337441 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-26a5dca1-00cf-42d0-8d11-8f3965aab851 req-7bd73002-052b-4376-b4ff-e763addf666b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054769 Aug 29 11:52:17.339137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3527/7090] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:18.099232 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40314. Aug 29 11:52:18.112143 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-51bf64a1-f85c-46f0-95f8-525c3c8dc1d7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments/e093e33c-0127-464a-8024-0159ee3bbbc0" status: 202 len: 0 microversion: 2.1 time: 1.250155 Aug 29 11:52:18.117558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3564/7091] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:52:16 2022] DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments/e093e33c-0127-464a-8024-0159ee3bbbc0 => generated 0 bytes in 1256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:52:18.135732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:18.146025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:18.168197 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:18.169841 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:18.171754 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:18.173872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:18.176314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:18.179573 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:18.225768 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2da71de5-a86a-451d-acfb-34ba0c8fe93e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106237 Aug 29 11:52:18.226266 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3528/7092] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:18 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:19.242556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:19.245669 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:19.258176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:19.258945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:19.259665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:19.260558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:19.261151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:19.261731 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:19.300809 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-83fe6224-33b6-4047-aa1b-d99172a5669b tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064946 Aug 29 11:52:19.301458 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3565/7093] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:19 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:52:20.318436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:20.321223 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:20.331212 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:20.331901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:20.332467 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:20.333298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:20.333930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:20.334469 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:20.385985 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9aacdf26-14c3-4d30-8cc3-89eaba48daa0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072461 Aug 29 11:52:20.388213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3529/7094] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:20 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:52:21.405949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:21.410348 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:21.425799 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:21.426853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:21.427698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:21.429098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:21.430394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:21.431246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:21.491149 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ec492d4b-1940-475c-802c-e2066bb1c040 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093430 Aug 29 11:52:21.492161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3566/7095] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:21 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:22.508311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:22.512227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:22.521014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:22.521515 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:22.522011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:22.522769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:22.523415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:22.524026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:22.560300 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42fac2bd-1376-46cd-a414-db30e0249e49 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057055 Aug 29 11:52:22.562063 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3530/7096] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:22 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:23.574855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:23.579371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:23.587666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:23.588227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:23.588730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:23.589608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:23.590135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:23.590672 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:23.627508 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-92cdc1db-5142-47fa-9a84-d926a58b824c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056991 Aug 29 11:52:23.628136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3567/7097] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:52:23 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 11:52:23.644700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:23.645444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:23.653567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:23.654013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:23.654507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:23.655893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:23.656405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:23.656901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:23.763831 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] HTTP exception thrown: Instance 16453b42-88d2-466e-970b-73db7a19163a is not attached to volume e093e33c-0127-464a-8024-0159ee3bbbc0 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Request method failure captured: Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: request: DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments/e093e33c-0127-464a-8024-0159ee3bbbc0 HTTP/1.1 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKeIOeYqwMPASrVmtUmCpfHj9XZ7l8VEqJdeJdvu6vPxCJw-oygGBSc6yv7FU6-O5sFbjMpY7BTIylv4ByCRDZeA0jir8Lq3GCkmVprCY3u84RI9TfYQwlxBj-mhoeEO1G2CwWTlccMy7kJVUQqakpQCK20Kx54ZtGSh1uYq2aDkU6Q Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b517eaada314816b515eb7cad89b04d Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 16453b42-88d2-466e-970b-73db7a19163a is not attached to volume e093e33c-0127-464a-8024-0159ee3bbbc0 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'server_id': '16453b42-88d2-466e-970b-73db7a19163a', 'id': 'e093e33c-0127-464a-8024-0159ee3bbbc0'} Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e093e33c-0127-464a-8024-0159ee3bbbc0. Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16453b42-88d2-466e-970b-73db7a19163a is not attached to volume e093e33c-0127-464a-8024-0159ee3bbbc0 Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:52:23.766648 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16453b42-88d2-466e-970b-73db7a19163a is not attached to volume e093e33c-0127-464a-8024-0159ee3bbbc0 Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Returning 404 to user: Instance 16453b42-88d2-466e-970b-73db7a19163a is not attached to volume e093e33c-0127-464a-8024-0159ee3bbbc0 {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-210a2313-20c0-4db1-99e2-068c9d148e68 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments/e093e33c-0127-464a-8024-0159ee3bbbc0" status: 404 len: 154 microversion: 2.1 time: 0.128667 Aug 29 11:52:23.772163 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3531/7098] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:52:23 2022] DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a/os-volume_attachments/e093e33c-0127-464a-8024-0159ee3bbbc0 => generated 154 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:52:27.128712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:27.129579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:27.137527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:27.138226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:27.138758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:27.140781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:27.141301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:27.141785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:27.175920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:52:27.276247 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4818d8d8-924a-4c6a-88d6-880429e84e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 204 len: 0 microversion: 2.1 time: 0.152425 Aug 29 11:52:27.277223 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3568/7099] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:52:27 2022] DELETE /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:52:27.287607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:27.288316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:27.298893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:27.299435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:27.299953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:27.300704 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:27.301345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:27.301885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:27.531772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:27.542015 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3f383b75-3e2a-4d31-8ef0-ce46ba2172b4 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1553 microversion: 2.1 time: 0.258499 Aug 29 11:52:27.542794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3532/7100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:27 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:28.566478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:28.567481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:28.576189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:28.576747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:28.577210 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:28.578004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:28.578538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:28.579004 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:28.758611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:28.769577 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-69bef9a9-e058-4ffb-a11d-31ac25acb3a7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1553 microversion: 2.1 time: 0.208656 Aug 29 11:52:28.770225 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3569/7101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:28 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:29.472615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16453b42-88d2-466e-970b-73db7a19163a", "name": "network-vif-deleted", "tag": "cc84380f-d51a-4ab5-bec4-7122e2834ea8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:29.493022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:29.493780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:29.494232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:29.508042 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] Creating event network-vif-deleted:cc84380f-d51a-4ab5-bec4-7122e2834ea8 for instance 16453b42-88d2-466e-970b-73db7a19163a on n-h1-854121-10 Aug 29 11:52:29.514029 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2f5dee36-12c8-4077-9383-a02aeb9e3aca req-9d194a98-b671-47e3-8b18-c3b8ff3507d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049388 Aug 29 11:52:29.515377 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3533/7102] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:29.796712 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:29.797859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:29.809414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:29.810628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:29.812239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:29.813957 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:29.814962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:29.816133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:29.873378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:29.874633 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:29.875247 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:29.876097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lazy-loading 'fault' on Instance uuid 16453b42-88d2-466e-970b-73db7a19163a {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:52:29.931384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:29.947705 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d1a85d0c-5873-4be8-ad8d-d81e68006d41 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 200 len: 1347 microversion: 2.1 time: 0.156656 Aug 29 11:52:29.949136 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3570/7103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:29 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 1347 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:30.975135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:30.975909 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 16453b42-88d2-466e-970b-73db7a19163a] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:30.988087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:30.989007 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:30.990069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:30.991436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:30.992323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:30.993090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:31.026909 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] HTTP exception thrown: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Request method failure captured: Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a HTTP/1.1 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKeIOeYqwMPASrVmtUmCpfHj9XZ7l8VEqJdeJdvu6vPxCJw-oygGBSc6yv7FU6-O5sFbjMpY7BTIylv4ByCRDZeA0jir8Lq3GCkmVprCY3u84RI9TfYQwlxBj-mhoeEO1G2CwWTlccMy7kJVUQqakpQCK20Kx54ZtGSh1uYq2aDkU6Q Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 8b517eaada314816b515eb7cad89b04d Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '16453b42-88d2-466e-970b-73db7a19163a'} Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:52:31.031173 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Returning 404 to user: Instance 16453b42-88d2-466e-970b-73db7a19163a could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a870ca87-df23-43f4-9207-5f8361cec797 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a" status: 404 len: 111 microversion: 2.1 time: 0.063950 Aug 29 11:52:31.035425 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3534/7104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:30 2022] GET /compute/v2.1/servers/16453b42-88d2-466e-970b-73db7a19163a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:52:31.044540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c83b5d52-7d48-43da-9236-36d7b582f27c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '.version_select at 0x7f66c5f8e940>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:31.079771 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c83b5d52-7d48-43da-9236-36d7b582f27c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186645120" status: 202 len: 0 microversion: 2.1 time: 0.039250 Aug 29 11:52:31.080376 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3571/7105] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 29 11:52:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186645120 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:52:41.989091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d8809ef7-ba76-4aac-934e-e46cfa6726f7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: .version_select at 0x7f66c5d9c700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1808383934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+dzAQ5C36x7TICIa0OQxVNggemhSdTbWtwNXQoHzb+24ym1qCPoNzCyaC1iB8VYxSHgB+0GRyLEz6l3Hc9Hn/qgbZGEiJNcxxvj+bHEVYe3TX3q4zmXwJ7Mym6w/BK1Q=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:41.997609 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:52:41.997908 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.47) !!! Aug 29 11:52:42.000916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=18 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:42.001779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=38 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:42.024970 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d8809ef7-ba76-4aac-934e-e46cfa6726f7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:52:42.032617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d8809ef7-ba76-4aac-934e-e46cfa6726f7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for user 8b517eaada314816b515eb7cad89b04d and project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:52:42.069622 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d8809ef7-ba76-4aac-934e-e46cfa6726f7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.086940 Aug 29 11:52:42.072051 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3535/7106] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:52:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:42.130594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:42.132884 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:42.139406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1403555383", "imageRef": "8d41d9be-4e0a-4795-944e-2be8a0bcfc5b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1808383934", "networks": [{"uuid": "4cbaee84-d422-4758-891d-16a27e3e2ad6"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:42.217822 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] validate_networks() for [('4cbaee84-d422-4758-891d-16a27e3e2ad6', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:52:43.074888 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:52:43.075355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:52:43.075882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:52:43.076371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:52:43.077538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:52:43.087992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:43.088752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:43.089315 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:43.090295 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:43.091000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:43.091663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:43.120847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:52:43.133571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Getting quotas for user 8b517eaada314816b515eb7cad89b04d and project 0545aba904bd4986aa5b7479fee72d0e. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:52:43.159452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:52:43.163781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d41d9be-4e0a-4795-944e-2be8a0bcfc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:52:43.241631 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-40de8ca4-db9b-4d5c-b1ee-54f8e5d52c8d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112908 Aug 29 11:52:43.242896 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3572/7107] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:52:43.261893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6bb7e882-2e1c-4910-8092-1480bca942f8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:43.262670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6bb7e882-2e1c-4910-8092-1480bca942f8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:43.342295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6bb7e882-2e1c-4910-8092-1480bca942f8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:43.356674 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6bb7e882-2e1c-4910-8092-1480bca942f8 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1259 microversion: 2.1 time: 0.101206 Aug 29 11:52:43.357635 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3536/7108] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:43 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1259 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:44.393645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:44.394452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:44.406102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:44.412618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:44.413285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:44.414768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:44.415658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:44.416532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:44.632120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:44.652641 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2d435def-3835-4079-8e91-82be3a57e604 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1311 microversion: 2.1 time: 0.264328 Aug 29 11:52:44.654322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3573/7109] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:44 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:45.693852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:45.698055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:45.734553 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:45.736285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:45.738048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:45.739814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:45.741488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:45.742572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:46.161035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:46.177560 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-630901b2-dfab-426e-a5b7-32b1c12c2504 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.493285 Aug 29 11:52:46.178722 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3537/7110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:45 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:47.214710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:47.217195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:47.233048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:47.234613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:47.235778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:47.237511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:47.239944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:47.241151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:47.324174 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:47.354589 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:47.355600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:47.356963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:47.382659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] Creating event network-changed:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:52:47.392721 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-e8e95d55-af1c-45eb-8eb9-304a74cb5fb4 req-836e8772-7dac-4c86-9a9c-b44f6c307a70 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079080 Aug 29 11:52:47.394828 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3538/7111] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:52:47.567890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:47.580364 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0f6ac06a-be42-4817-b32d-814da7e56017 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.374867 Aug 29 11:52:47.581300 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3574/7112] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:47 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:48.609380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:48.612097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:48.626999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:48.627926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:48.628743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:48.630128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:48.631561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:48.631831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:48.929876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:48.972329 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d83a0899-3000-413a-8430-6137c1c81e01 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.370145 Aug 29 11:52:48.999310 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3539/7113] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:48 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:50.016557 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:50.017940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:50.034063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:50.035156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:50.036098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:50.037632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:50.039326 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:50.046900 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:50.321477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:50.332685 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2a490070-48ac-4495-8401-c151cc4c3fb0 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.329171 Aug 29 11:52:50.333860 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3575/7114] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:50 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:51.365454 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:51.366928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:51.385947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:51.389609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:51.390700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:51.392510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:51.393482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:51.394684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:51.670690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:51.689091 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f45274c-c2fd-4db8-b9cd-a2dc1065ddd3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.335980 Aug 29 11:52:51.691447 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3540/7115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:51 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:52.713332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:52.714118 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:52.722872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:52.723400 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:52.723870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:52.724701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:52.725181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:52.725629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:52.908477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:52.925310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ffb18541-95d2-4ab3-ae53-9b31dab16506 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.215861 Aug 29 11:52:52.926492 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3576/7116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:52 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:53.959199 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:53.960057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:53.963385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:53.970522 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:53.971018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:53.971457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:53.972181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:53.972642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:53.973073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:54.133986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:54.143068 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64842a3a-2577-4522-b9a9-e02c3f740bed tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.187589 Aug 29 11:52:54.143264 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3541/7117] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:53 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:55.165601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:55.166318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:55.168384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:55.169082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:52:55.177349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:55.177889 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:55.178347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:55.179077 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:55.179550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:55.179997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:55.390207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:55.399480 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-266cc3f9-0d05-4b0c-94fe-cdd8ab87b6b3 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.238427 Aug 29 11:52:55.400091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3577/7118] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:55 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:56.435891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:56.436919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:56.446534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:56.447191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:56.447743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:56.448623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:56.449186 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:56.449789 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:56.614107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:56.623837 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-62374367-24a6-48a0-8c24-9bcd71bcd29e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.192049 Aug 29 11:52:56.624585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3542/7119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:56 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:52:57.647485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:57.647485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:57.655529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:57.656048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:57.656514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:57.657277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:57.657777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:57.658220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:57.818265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:57.828794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4ad5222a-e1e6-4cd0-aeec-18c49d34d240 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.186469 Aug 29 11:52:57.829426 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3578/7120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:57 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:58.850707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:52:58.851753 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:52:58.860298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:58.860790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:58.861230 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:58.861988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:58.862445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:58.862876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:59.019409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:52:59.028494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da443590-8bd7-482d-9d5e-e578d40798a1 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.182263 Aug 29 11:52:59.029106 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3543/7121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:52:58 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:52:59.855352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "name": "network-vif-plugged", "status": "completed", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:52:59.867644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:52:59.868502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:52:59.869235 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:52:59.882615 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] Creating event network-vif-plugged:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:52:59.888493 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-073fdc96-d5b8-4f9e-b3b9-195f1a987b48 req-dbd6d018-50c5-48ae-be54-1d978ee7d44d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139393 Aug 29 11:52:59.889558 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3579/7122] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:53:00.052866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:00.053504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:00.060614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:00.061798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:00.062236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:00.063262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:00.063729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:00.064162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:00.226716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:00.236603 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-224a1058-b866-40be-9c27-7cc80cacfb2f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1359 microversion: 2.1 time: 0.189108 Aug 29 11:53:00.237261 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3544/7123] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:00 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:01.260832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:01.261533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:01.269617 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.270240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.270697 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.271446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.271923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.272368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.429846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:01.439825 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-792fecc0-2ed9-4f53-a19d-0852e7fef659 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1549 microversion: 2.1 time: 0.184316 Aug 29 11:53:01.440435 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3580/7124] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:01 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:01.462396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:01.463073 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:01.471069 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.471717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.472107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.472838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.473303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.473769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.626997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:01.636481 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-64d67b7d-3b32-43e6-9935-6b12e5c0d58d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1549 microversion: 2.1 time: 0.178110 Aug 29 11:53:01.637095 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3545/7125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:01 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:01.673664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:01.679008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:01.679832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Searching by: {'deleted': False, 'project_id': '0545aba904bd4986aa5b7479fee72d0e'} {{(pid=128681) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 11:53:01.685852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.686376 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.686842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.687625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.688107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.688565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.716523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.multi_cell_list [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 11:53:01.750762 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-460f6aaf-c772-4e1b-ad59-fda3aa8b3ff7 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.081273 Aug 29 11:53:01.751378 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3581/7126] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 29 11:53:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:53:01.763304 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:01.764526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:01.771442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.771958 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.772419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.773165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:01.773630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:01.774109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:01.942428 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:01.952098 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a41cedb-afc7-4211-ab7d-35c2416cd838 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1549 microversion: 2.1 time: 0.192194 Aug 29 11:53:01.953216 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3546/7127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:01 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:53:04.761991 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f3502f-fc96-4927-a9c3-8ec5336f05d5"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:53:04.765452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:04.773143 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:04.773659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:04.774156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:04.775085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:04.775567 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:04.776013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:05.190829 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5af32b63-e241-46eb-bf34-36f9ea82d694 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432883 Aug 29 11:53:05.191999 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3582/7128] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 29 11:53:04 2022] POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:53:17.282670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:17.283308 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:17.286609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:17.287352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=56 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:17.295966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:17.296780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:17.297236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:17.298020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:17.298485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:17.298918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:17.561526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:17.575745 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cb1f7eb1-c996-445a-b39a-be6826f53c00 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1595 microversion: 2.1 time: 0.297070 Aug 29 11:53:17.577233 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3547/7129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:17 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1595 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:20.110974 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:20.113147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:20.114272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:20.123848 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:53:20.147681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:20.149008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:20.150169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:20.175941 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] Creating event network-changed:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:53:20.186162 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-827f19ad-9af2-45bd-83c0-2df8a8a20dbf req-398aad09-d6aa-4a89-8d4f-bb8a3c614bdf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078073 Aug 29 11:53:20.187732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3583/7130] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:53:21.651992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-188439040"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:53:21.652993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:21.664154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:21.665145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:21.666085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:21.667525 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:21.668358 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:21.669187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:21.859095 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.security_group_api [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Adding security group 964ca298-4f5f-435a-be41-db4a7a1af18d to port d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 Aug 29 11:53:22.292331 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27586728-38b8-4c7d-88ca-dbb54fc9a611 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action" status: 202 len: 0 microversion: 2.1 time: 0.647071 Aug 29 11:53:22.296293 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3548/7131] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:53:21 2022] POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:53:22.304323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:22.305797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:22.307840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:53:22.319517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:22.320557 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:22.321348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:22.327152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:22.328056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:22.328466 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:22.329402 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:22.329909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:22.330360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:22.339177 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] Creating event network-changed:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:53:22.346315 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-a775b9d8-aa50-47bb-a25d-10307149182e req-5bee92e1-65ef-4ef6-8ff5-3e1e4ea4f583 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044246 Aug 29 11:53:22.347106 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3549/7132] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:53:22.780194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:22.792271 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ccb23b01-0f44-4796-939d-04e36a300a93 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1760 microversion: 2.1 time: 0.494356 Aug 29 11:53:22.793085 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3584/7133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:22 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1760 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:53:35.849360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:35.850209 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:35.981342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:53:35.986412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:35.997572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:35.999615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:36.000406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:36.001729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:36.002595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:36.003387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:36.132374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2a9a4571-9dc5-495e-810e-b759cca7e82e tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action" status: 202 len: 0 microversion: 2.1 time: 0.284680 Aug 29 11:53:36.132951 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3550/7134] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:53:35 2022] POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:53:36.142996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:36.143873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:36.146869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:36.147614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:53:36.155268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:36.155972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:36.156418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:36.157174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:36.157641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:36.158140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:36.419613 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:36.436303 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6475cc20-f15b-4e4f-9284-d4e25548d8eb tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1752 microversion: 2.1 time: 0.296945 Aug 29 11:53:36.437336 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3585/7135] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:36 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1752 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:37.460247 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:37.461070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:37.468870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:37.469368 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:37.469853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:37.470640 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:37.471103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:37.471535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:37.659221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:37.669539 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27376776-f3e2-4b94-aea2-0ec0994f5968 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.214321 Aug 29 11:53:37.670903 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3551/7136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:37 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:38.694759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:38.695698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:38.706332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:38.707013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:38.708000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:38.708849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:38.709415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:38.710089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:38.921177 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:38.930408 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-afbf66b6-ebbe-4327-93ea-12efd1cf435f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.241019 Aug 29 11:53:38.931029 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3586/7137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:38 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:39.954968 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:39.955661 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:39.963530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:39.964032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:39.964481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:39.965210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:39.965673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:39.966141 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:40.141999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:40.158371 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-be2298a2-f45f-4fb9-ab84-5c15596f2772 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.207098 Aug 29 11:53:40.159615 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3552/7138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:39 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:53:41.194499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:41.195137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:41.204233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:41.204886 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:41.205641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:41.206634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:41.207170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:41.207774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:41.411510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:41.421161 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b63abab3-1768-4232-bd41-1cdd90686484 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.230910 Aug 29 11:53:41.421804 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3587/7139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:41 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:53:42.443263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:42.443912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:42.452348 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:42.452849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:42.453298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:42.454067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:42.454529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:42.454987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:42.699440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:42.708868 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-decb5b32-9f6b-4bde-9edc-90460e81655d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.269878 Aug 29 11:53:42.709544 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3553/7140] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:42 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:43.731603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:43.733393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:43.740941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:43.741449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:43.741939 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:43.742678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:43.743165 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:43.743608 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:44.014625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:44.024371 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f55bdac-23a3-4226-ba74-321abcd9400a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.296710 Aug 29 11:53:44.025091 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3588/7141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:43 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:53:45.050311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:45.051354 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:45.060397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:45.061242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:45.062046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:45.063229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:45.063942 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:45.064586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:45.256157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:45.266264 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8bc7e742-ea6f-4fc8-a661-7db5326f7b3a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.220542 Aug 29 11:53:45.267483 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3554/7142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:45 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:46.292345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:46.293399 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:46.305795 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:46.306692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:46.307480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:46.308787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:46.309622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:46.311393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:46.491757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:46.504834 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3383225b-0b37-4612-8810-08efd27db8f5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.220046 Aug 29 11:53:46.506045 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3589/7143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:46 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:47.528477 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:47.529977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:47.537364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:47.537899 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:47.538350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:47.539094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:47.539560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:47.540001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:47.710783 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:47.721644 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-817f4d15-6c99-4e3f-8cf1-f3aa0ec1040c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.197460 Aug 29 11:53:47.722380 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3555/7144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:47 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:48.748438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:48.749920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:48.762915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:48.764244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:48.765081 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:48.766565 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:48.767449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:48.768253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:48.964519 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:48.975361 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-143ee3d1-71e0-4c4c-91d9-ced22f47d280 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.234481 Aug 29 11:53:48.975976 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3590/7145] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:48 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:50.002937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:50.003632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:50.011270 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:50.011811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:50.012290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:50.013872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:50.014429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:50.014904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:50.185745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:50.196025 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bbaf8c9d-4d8d-4500-af56-eb39a9d614dd tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.197054 Aug 29 11:53:50.196656 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3556/7146] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:49 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:51.219647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:51.220343 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:51.228854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:51.229516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:51.230182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:51.231126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:51.232479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:51.233109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:51.493333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:51.505447 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-94d709bf-7576-4972-aa51-63874943881c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.290516 Aug 29 11:53:51.506182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3591/7147] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:51 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:52.528898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:52.529599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:52.537539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:52.538071 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:52.538807 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:52.539567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:52.540037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:52.540626 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:52.744107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:52.761022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-314a4cb9-e97b-4398-bf32-48076599ef1f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1757 microversion: 2.1 time: 0.235761 Aug 29 11:53:52.762174 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3557/7148] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:52 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:53:53.798961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:53:53.799859 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:53:53.806988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:53.807667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:53.808233 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:53.809245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:53:53.809826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:53:53.811192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:53:54.009189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:53:54.019522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97aef6bc-7e76-4d4a-9c83-1ed4cc1011e2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1760 microversion: 2.1 time: 0.225684 Aug 29 11:53:54.020150 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3592/7149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:53:53 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1760 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:54:24.829066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-188439040"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:54:24.830016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:24.834492 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:24.835707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:24.850804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:24.851665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:24.852356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:24.853445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:24.854278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:24.854991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:25.052506 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.network.security_group_api [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Removing security group 964ca298-4f5f-435a-be41-db4a7a1af18d from port d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 Aug 29 11:54:25.439084 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-42040ebc-f64d-485b-bb95-2c159bd67b58 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action" status: 202 len: 0 microversion: 2.1 time: 0.618556 Aug 29 11:54:25.445495 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3558/7150] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:54:24 2022] POST /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:54:25.453603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:25.454768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=48 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:25.520947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:54:25.534317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:25.535214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:25.536086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:25.554171 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] Creating event network-changed:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:54:25.567533 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0b00e63d-4abd-4916-baac-8c7c51a434ee req-8230e424-7af3-45ad-805d-72b2b51930d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120127 Aug 29 11:54:25.568452 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3593/7151] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:54:26.929794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:26.930564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:26.942568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:26.943327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:26.944115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:26.945228 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:26.945966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:26.946529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:27.000168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:54:27.011085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:27.011595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:27.012043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:27.025516 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] Creating event network-changed:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:54:27.032165 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-11921dc1-30d7-4146-9d0d-314e33154de4 req-b136be0b-becb-4951-a504-69d79e1c9160 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106802 Aug 29 11:54:27.032810 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3594/7152] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:54:27.078387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lazy-loading 'services' on Instance uuid 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:54:27.187615 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43dd757a-3bf9-4522-ac81-18bde37fcc5c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments/55f3502f-fc96-4927-a9c3-8ec5336f05d5" status: 202 len: 0 microversion: 2.1 time: 0.265857 Aug 29 11:54:27.188471 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3559/7153] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:54:26 2022] DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments/55f3502f-fc96-4927-a9c3-8ec5336f05d5 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:54:27.199781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:27.203310 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:27.211498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:27.212237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:27.212746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:27.213732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:27.214378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:27.214961 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:27.265830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d127e24-a57d-4417-aca4-de1294843f4f tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070944 Aug 29 11:54:27.266762 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3595/7154] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:27 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:54:28.281583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:28.284631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:28.291707 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:28.292310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:28.293008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:28.294055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:28.294944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:28.295474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:28.333676 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-818380fa-5f7c-41c6-bec2-e9b9d6fb1a9c tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058593 Aug 29 11:54:28.334429 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3560/7155] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:28 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:54:29.348634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:29.351258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:29.359583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:29.360101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:29.360566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:29.361316 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:29.361841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:29.362294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:29.408336 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5993db3f-8692-4598-b71b-1cf9dcf103fa tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064539 Aug 29 11:54:29.409447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3596/7156] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:29 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:54:30.427601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:30.431820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:30.445187 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:30.446116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:30.446924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:30.448245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:30.449079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:30.450559 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:30.511828 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4347765f-b6a1-49cd-81a7-591d5fbaad55 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092284 Aug 29 11:54:30.514137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3561/7157] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:30 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:54:31.526830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:31.529955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:31.537896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:31.538517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:31.538907 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:31.539667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:31.540145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:31.540599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:31.578556 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b83122c-8858-4e24-bd2b-69cde7719e76 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055913 Aug 29 11:54:31.579455 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3597/7158] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:31 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:54:32.593331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:32.595660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:32.602980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:32.603571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:32.604068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:32.604907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:32.605583 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:32.606177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:32.644256 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a66b472e-5542-42ba-a573-f113a2af1837 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056406 Aug 29 11:54:32.644929 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3562/7159] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 29 11:54:32 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 11:54:32.657664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:32.658545 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:32.666548 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:32.667074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:32.667536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:32.668285 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:32.669036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:32.669899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:32.758219 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] HTTP exception thrown: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 is not attached to volume 55f3502f-fc96-4927-a9c3-8ec5336f05d5 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Request method failure captured: Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: request: DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments/55f3502f-fc96-4927-a9c3-8ec5336f05d5 HTTP/1.1 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKeIOeYqwMPASrVmtUmCpfHj9XZ7l8VEqJdeJdvu6vPxCJw-oygGBSc6yv7FU6-O5sFbjMpY7BTIylv4ByCRDZeA0jir8Lq3GCkmVprCY3u84RI9TfYQwlxBj-mhoeEO1G2CwWTlccMy7kJVUQqakpQCK20Kx54ZtGSh1uYq2aDkU6Q Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b517eaada314816b515eb7cad89b04d Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 is not attached to volume 55f3502f-fc96-4927-a9c3-8ec5336f05d5 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'server_id': '37b7e4a4-fe14-4ec7-971d-5e8baa6346c4', 'id': '55f3502f-fc96-4927-a9c3-8ec5336f05d5'} Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 55f3502f-fc96-4927-a9c3-8ec5336f05d5. Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 is not attached to volume 55f3502f-fc96-4927-a9c3-8ec5336f05d5 Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:54:32.760001 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 is not attached to volume 55f3502f-fc96-4927-a9c3-8ec5336f05d5 Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Returning 404 to user: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 is not attached to volume 55f3502f-fc96-4927-a9c3-8ec5336f05d5 {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-86cac510-378c-4279-865a-797cacac72f2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments/55f3502f-fc96-4927-a9c3-8ec5336f05d5" status: 404 len: 154 microversion: 2.1 time: 0.108900 Aug 29 11:54:32.768850 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3598/7160] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 29 11:54:32 2022] DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4/os-volume_attachments/55f3502f-fc96-4927-a9c3-8ec5336f05d5 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:54:36.091206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:36.092063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:36.099872 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:36.100371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:36.100849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:36.101670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:36.102193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:36.102695 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:36.136794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:54:36.276152 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b1a305dc-bc9d-4dd0-b253-5acfa67eff2d tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 204 len: 0 microversion: 2.1 time: 0.188885 Aug 29 11:54:36.277267 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3563/7161] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:54:36 2022] DELETE /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:54:36.287452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:36.288114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:36.297745 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:36.298156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:36.298604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:36.300333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:36.300333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:36.300333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:36.476019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:54:36.487519 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4639e1b5-d097-440d-981a-87fd3598879a tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1555 microversion: 2.1 time: 0.203935 Aug 29 11:54:36.488303 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3599/7162] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:54:36 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:54:37.511710 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:37.513128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:37.520735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:37.521285 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:37.521822 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:37.522585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:37.523103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:37.523674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:37.679231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:54:37.688773 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2d1d440b-6a94-4e8a-be1b-be94e60d3ee5 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1555 microversion: 2.1 time: 0.181670 Aug 29 11:54:37.689373 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3564/7163] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:54:37 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:54:38.460508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b7e4a4-fe14-4ec7-971d-5e8baa6346c4", "name": "network-vif-deleted", "tag": "d63d3dd0-a2a6-4afe-a01e-edd2a46783a6"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:54:38.480930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:38.482273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:38.482998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:38.501608 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] Creating event network-vif-deleted:d63d3dd0-a2a6-4afe-a01e-edd2a46783a6 for instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 on n-h2-854121-10 Aug 29 11:54:38.508257 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4bc55214-4c14-4de2-97ec-cafaf03dd9ec req-d49d3ab8-3d30-40e1-be37-3b8336ada60e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052113 Aug 29 11:54:38.509062 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3600/7164] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:54:38.715357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:38.716712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:38.728502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:38.729411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:38.730155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:38.732245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:38.733063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:38.733856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:38.777746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:38.778857 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:38.779421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:38.779987 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lazy-loading 'fault' on Instance uuid 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:54:38.845934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b517eaada314816b515eb7cad89b04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0545aba904bd4986aa5b7479fee72d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:54:38.858715 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-736f78b2-1856-4b8b-81a3-2da04cfa83a2 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 200 len: 1349 microversion: 2.1 time: 0.150670 Aug 29 11:54:38.859720 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3565/7165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:54:38 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 1349 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:54:39.891560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:39.892308 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] [instance: 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:54:39.899576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:39.900098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:39.900560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:39.901318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:54:39.901832 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:54:39.902284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:54:39.921390 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] HTTP exception thrown: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Request method failure captured: Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 HTTP/1.1 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKeIOeYqwMPASrVmtUmCpfHj9XZ7l8VEqJdeJdvu6vPxCJw-oygGBSc6yv7FU6-O5sFbjMpY7BTIylv4ByCRDZeA0jir8Lq3GCkmVprCY3u84RI9TfYQwlxBj-mhoeEO1G2CwWTlccMy7kJVUQqakpQCK20Kx54ZtGSh1uYq2aDkU6Q Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0545aba904bd4986aa5b7479fee72d0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 0545aba904bd4986aa5b7479fee72d0e Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestMinimumBasicScenario-305852115 Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: 8b517eaada314816b515eb7cad89b04d Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestMinimumBasicScenario-305852115-project Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '37b7e4a4-fe14-4ec7-971d-5e8baa6346c4'} Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:54:39.923155 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Returning 404 to user: Instance 37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a23f796a-aed8-46a9-b608-faf3ed7a4290 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4" status: 404 len: 111 microversion: 2.1 time: 0.039180 Aug 29 11:54:39.931790 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3601/7166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:54:39 2022] GET /compute/v2.1/servers/37b7e4a4-fe14-4ec7-971d-5e8baa6346c4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 11:54:39.939402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0f11f38c-fa88-4589-af85-26a53ad0e951 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] Calling method '.version_select at 0x7f66c5cb4af0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:54:39.970993 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0f11f38c-fa88-4589-af85-26a53ad0e951 tempest-TestMinimumBasicScenario-305852115 tempest-TestMinimumBasicScenario-305852115-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1808383934" status: 202 len: 0 microversion: 2.1 time: 0.038705 Aug 29 11:54:39.972050 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3566/7167] 10.222.0.47 () {58 vars in 1272 bytes} [Mon Aug 29 11:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1808383934 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:54:52.627296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:52.628047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=38 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:54:52.841520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0913836e-39f2-49c3-b557-b34e2bca4e24 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: .version_select at 0x7f66c403edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1824882643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEO71I5Nsp9AB/cZ/bVHwkAsVqnnwU70jZH+ZY0P5JvpOfUCY7Pk8gFd943Zb8xb7SFtesYJJXPUzDGVCc7g6vZ7WRgQWMajCSHtSUnA9PSbqUSE8RYf4Qxxt6wG50+Vhw=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:54:52.859460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0913836e-39f2-49c3-b557-b34e2bca4e24 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:54:52.865569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-0913836e-39f2-49c3-b557-b34e2bca4e24 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:54:52.895742 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0913836e-39f2-49c3-b557-b34e2bca4e24 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.274021 Aug 29 11:54:52.896512 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3602/7168] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:54:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:55:00.718311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-682476312", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "a804307d-0155-47b1-ad6d-a2f17b75b8e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1824882643", "security_groups": [{"name": "tempest-secgroup-smoke-550559252"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:00.743616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:00.745540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:00.991025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] validate_networks() for [('a804307d-0155-47b1-ad6d-a2f17b75b8e5', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:55:01.679100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:55:01.679835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:55:01.680632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:55:01.681350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:55:01.682136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:55:01.699886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:01.700749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:01.701508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:01.702708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:01.703410 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:01.704342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:01.740963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:55:01.753739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:55:01.776260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:55:01.782084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:55:01.860937 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-89f586ca-b901-4ff7-8a3d-8e18fb9d3504 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.150747 Aug 29 11:55:01.877477 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3567/7169] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:55:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:55:01.897229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a62a6326-a918-4166-8dd4-50d45f098b76 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:01.898689 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a62a6326-a918-4166-8dd4-50d45f098b76 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:02.026220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a62a6326-a918-4166-8dd4-50d45f098b76 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:02.039522 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a62a6326-a918-4166-8dd4-50d45f098b76 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1266 microversion: 2.1 time: 0.150078 Aug 29 11:55:02.040631 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3603/7170] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:01 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:03.089312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:03.091363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:03.116992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:03.119480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:03.120419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:03.123180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:03.123180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:03.124045 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:03.240400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:03.251801 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fa5f1872-6a7f-4f08-86da-d8c5c2c273ef tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1318 microversion: 2.1 time: 0.174793 Aug 29 11:55:03.252684 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3568/7171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:03 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:04.282064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:04.283727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:04.298279 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:04.299324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:04.300304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:04.302139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:04.303239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:04.304701 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:04.418292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:04.433626 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a68e1e2-ab01-4c66-b177-5e9b9f0ff946 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1324 microversion: 2.1 time: 0.160941 Aug 29 11:55:04.435833 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3604/7172] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:04 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:05.445996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c9a7b6-9de9-46ef-a064-50743f69ff8c", "tag": "ffa5c76d-3b87-4d0d-b793-3371b192cb4f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:05.463526 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:05.466201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:05.469564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:05.470654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:05.471514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:05.483539 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:05.484747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:05.485638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:05.486782 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:05.487651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:05.488455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:05.501244 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] Creating event network-changed:ffa5c76d-3b87-4d0d-b793-3371b192cb4f for instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c on n-h2-854121-10 Aug 29 11:55:05.510393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-55017e4e-9da9-4a11-ab87-69bd38edf457 req-177d203f-5949-4391-8c4c-2326c44ec9d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071865 Aug 29 11:55:05.511528 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3569/7173] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:55:05.751587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:05.760505 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-03bb0cda-729b-4fe0-93ad-b8ac065e0d2f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1391 microversion: 2.1 time: 0.306753 Aug 29 11:55:05.761382 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3605/7174] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:05 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:06.796244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:06.796963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:06.804275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:06.804824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:06.805321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:06.806140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:06.806646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:06.807202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:07.067438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:07.077518 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-45933431-31a5-4414-bc82-e69cecd3ff68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1391 microversion: 2.1 time: 0.288148 Aug 29 11:55:07.078458 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3570/7175] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:06 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:08.113273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:08.114649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:08.124823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:08.125356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:08.126556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:08.126708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:08.127090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:08.127546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:08.311511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:08.320847 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ae7f792a-9d19-4bf4-966d-548aff390f3c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1391 microversion: 2.1 time: 0.212842 Aug 29 11:55:08.321775 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3606/7176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:08 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1391 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:09.358328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:09.358976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:09.367471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:09.368025 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:09.368516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:09.369407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:09.370003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:09.370587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:09.533262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:09.542604 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-998a6e5d-ad92-4210-9538-6cb4582b6995 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1391 microversion: 2.1 time: 0.189850 Aug 29 11:55:09.543794 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3571/7177] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:09 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:10.357123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c9a7b6-9de9-46ef-a064-50743f69ff8c", "name": "network-vif-plugged", "status": "completed", "tag": "ffa5c76d-3b87-4d0d-b793-3371b192cb4f"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:10.373829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:10.374478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:10.375013 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:10.390789 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] Creating event network-vif-plugged:ffa5c76d-3b87-4d0d-b793-3371b192cb4f for instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c on n-h2-854121-10 Aug 29 11:55:10.396507 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-804d416f-d0c3-43e5-8ca7-934d254d53b2 req-92292b4c-0148-4267-bc5e-13f043e2545e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044139 Aug 29 11:55:10.397331 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3607/7178] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:55:10.579414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:10.580096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:10.591070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:10.592089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:10.592926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:10.594341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:10.595192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:10.595972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:10.769998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:10.779979 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6671b4a-2c49-43e8-b3b6-3c6d0796d505 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1391 microversion: 2.1 time: 0.204439 Aug 29 11:55:10.780593 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3572/7179] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:10 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:11.803175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:11.803940 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:11.812481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:11.813005 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:11.813486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:11.814246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:11.814730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:11.815176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:11.969963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:11.986048 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ce75f2e7-fe29-44fe-b29f-37c21c85633a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1563 microversion: 2.1 time: 0.188084 Aug 29 11:55:11.986898 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3608/7180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:11 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:12.009602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:12.010425 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:12.014409 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:12.015396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:12.023459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:12.023963 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:12.024415 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:12.025167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:12.025859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:12.026217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:12.192452 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:12.207652 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3a51a610-e595-4712-87db-c9817cc20329 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1563 microversion: 2.1 time: 0.202265 Aug 29 11:55:12.208775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3573/7181] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:12 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:14.536627 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c9a7b6-9de9-46ef-a064-50743f69ff8c", "tag": "ffa5c76d-3b87-4d0d-b793-3371b192cb4f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:14.546785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:14.547676 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:14.550386 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:14.564042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:14.564911 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:14.565731 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:14.573377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:14.574908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:14.575742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:14.577167 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:14.578009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:14.578786 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:14.604667 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] Creating event network-changed:ffa5c76d-3b87-4d0d-b793-3371b192cb4f for instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c on n-h2-854121-10 Aug 29 11:55:14.618962 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-6847e36e-12c1-45f1-81a3-0ed53de90829 req-9bbdbe49-df3f-4874-8b64-645da15a62a3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086309 Aug 29 11:55:14.620230 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3574/7182] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:55:14.883047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:14.899139 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3c828b4c-da5f-4b79-ba9a-739b6685d184 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1563 microversion: 2.1 time: 0.372813 Aug 29 11:55:14.906788 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3609/7183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:14 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1563 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:36.304891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:36.307352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:36.310475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:36.311177 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=36 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:36.318156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:36.318688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:36.319138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:36.319922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:36.320414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:36.320896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:36.380466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-54ac0f9a-4fe6-48b5-937d-fc35a626d8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action" status: 200 len: 24566 microversion: 2.1 time: 0.080540 Aug 29 11:55:36.381160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3575/7184] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:55:36 2022] POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action => generated 24566 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:55:47.449663 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:47.450650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:47.453060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:47.453980 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=32 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:47.462740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:47.463268 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:47.463736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:47.464516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:47.465003 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:47.465449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:47.559940 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-afe5f851-b11e-472f-8e75-f5ca9ad69255 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action" status: 202 len: 0 microversion: 2.1 time: 0.115556 Aug 29 11:55:47.561139 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3610/7185] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:55:47 2022] POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 11:55:47.572299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:47.573487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:47.579504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:47.579893 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:55:47.593175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:47.593722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:47.594221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:47.595019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:47.595502 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:47.595922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:47.786445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:47.801176 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-736c7ead-08bc-4fa7-9a6a-3637e7b689c7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1687 microversion: 2.1 time: 0.233657 Aug 29 11:55:47.802403 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3576/7186] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:47 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:48.829262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:48.830390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:48.838256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:48.838920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:48.839508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:48.840682 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:48.841648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:48.842155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:49.008240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:49.018087 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-07a91a86-7b71-49f9-a2b2-e5b8723fea02 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1667 microversion: 2.1 time: 0.196034 Aug 29 11:55:49.018698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3611/7187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:48 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1667 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:55:50.133889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:50.136470 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:50.144238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.144801 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.145363 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.146329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.146795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.147339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.204698 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e29b7f3c-acda-4223-80dd-5310275aa50b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action" status: 200 len: 32641 microversion: 2.1 time: 0.074590 Aug 29 11:55:50.206137 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3577/7188] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:55:50 2022] POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action => generated 32641 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:55:50.220267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:50.220893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:50.228433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.228951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.229407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.230923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.231744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.232205 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.328001 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4b9250dd-5176-46af-855d-6d47eed687ec tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action" status: 202 len: 0 microversion: 2.1 time: 0.111485 Aug 29 11:55:50.328575 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3612/7189] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:55:50 2022] POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:55:50.339079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:50.341068 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:50.354460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.356796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.357326 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.358122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:50.358606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:50.359041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:50.518722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:50.530357 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fff9165e-fbdd-48f2-be20-e89ff044c8f8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1674 microversion: 2.1 time: 0.196575 Aug 29 11:55:50.531631 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3578/7190] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:50 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:51.557367 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:51.558993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:51.566679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:51.567253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:51.567892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:51.568773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:51.569329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:51.570050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:51.738715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:51.753049 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b394c65b-f389-4091-a062-4404a47ef582 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1682 microversion: 2.1 time: 0.200730 Aug 29 11:55:51.753994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3613/7191] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:51 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:51.889654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:51.891930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:51.899666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:51.900170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:51.900612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:51.901342 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:51.901897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:51.902813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:51.968494 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d8f4144-ec96-4c24-889d-db5cf9a5c7e1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action" status: 200 len: 38413 microversion: 2.1 time: 0.083653 Aug 29 11:55:51.969381 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3579/7192] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:55:51 2022] POST /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c/action => generated 38413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:55:53.158719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:53.159775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:53.162417 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c9a7b6-9de9-46ef-a064-50743f69ff8c", "tag": "ffa5c76d-3b87-4d0d-b793-3371b192cb4f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:53.175461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:53.176881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:53.178105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:53.180549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:53.181885 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:53.183839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:53.184255 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:53.184934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:53.185725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:53.204250 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] Creating event network-changed:ffa5c76d-3b87-4d0d-b793-3371b192cb4f for instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c on n-h2-854121-10 Aug 29 11:55:53.213666 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-9edea920-a018-4fa6-a3ac-d0b0f3169a96 req-3c026985-3ae0-4366-8a38-f24070ca478d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061604 Aug 29 11:55:53.215087 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3580/7193] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:55:53.237933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:55:53.403310 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f4785009-e3cc-4e39-a928-35b765063fda tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 204 len: 0 microversion: 2.1 time: 0.252284 Aug 29 11:55:53.404701 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3614/7194] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:55:53 2022] DELETE /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:55:53.416900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:53.418917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:53.434229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:53.435238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:53.438149 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:53.443351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:53.445067 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:53.446114 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:53.659646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:53.670564 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e79fa75-0d13-48b9-bc5d-2084d81e5b71 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1688 microversion: 2.1 time: 0.260046 Aug 29 11:55:53.671406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3581/7195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:53 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1688 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:54.697099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:54.698411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:54.707949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:54.708612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:54.709178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:54.710103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:54.710744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:54.711324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:55.035796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:55.048657 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbfd40c9-6b7b-4e44-82bb-74d3a8fcf009 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1688 microversion: 2.1 time: 0.356991 Aug 29 11:55:55.049680 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3615/7196] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:54 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1688 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:55.547555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c9a7b6-9de9-46ef-a064-50743f69ff8c", "name": "network-vif-deleted", "tag": "ffa5c76d-3b87-4d0d-b793-3371b192cb4f"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:55:55.565770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:55.566895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:55.568214 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:55.595686 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] Creating event network-vif-deleted:ffa5c76d-3b87-4d0d-b793-3371b192cb4f for instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c on n-h2-854121-10 Aug 29 11:55:55.606584 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-30cf5f54-63f3-4a77-9e78-77af95b07bbd req-fbd3c78f-fe95-4a32-8b38-e69a5e56afb4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064894 Aug 29 11:55:55.607968 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3582/7197] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:55:56.075055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:56.075851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:56.083394 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:56.083913 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:56.084382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:56.085149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:56.085643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:56.086130 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:56.152261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:56.152954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:56.153823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:56.154830 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lazy-loading 'fault' on Instance uuid a4c9a7b6-9de9-46ef-a064-50743f69ff8c {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:55:56.208775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:55:56.218712 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-695e98d8-9e2f-4b03-b754-f401104fe09d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 200 len: 1356 microversion: 2.1 time: 0.149181 Aug 29 11:55:56.219219 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3616/7198] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:56 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:55:57.242948 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:55:57.243660 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a4c9a7b6-9de9-46ef-a064-50743f69ff8c] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:55:57.253265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:57.253792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:57.254240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:57.255047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:55:57.255518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:55:57.255954 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:55:57.272735 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] HTTP exception thrown: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Request method failure captured: Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c HTTP/1.1 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKkLEmdnA0xMF-NdPOv0FhV0FW-2hWnGx89xD61lzT4Ysf9JBvfY2kgJadn6ZJPMOMlC4mWIQSLtjxL0tOUooX_m-7eThhiK-nuxDtKZqmSeVM5ExwnlXdmQaSDXpDzHG1z6VgXcPUf3IF3gYOndLzbo_J5Nh2tHEIr1vuajsgtA9s4 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f10ac2093cdc444cb2f2cdde61f4257e Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a4c9a7b6-9de9-46ef-a064-50743f69ff8c'} Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:55:57.274697 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Returning 404 to user: Instance a4c9a7b6-9de9-46ef-a064-50743f69ff8c could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-184baaaf-eb2d-4795-b180-0b6b6bc438f4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c" status: 404 len: 111 microversion: 2.1 time: 0.038281 Aug 29 11:55:57.281032 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3583/7199] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:55:57 2022] GET /compute/v2.1/servers/a4c9a7b6-9de9-46ef-a064-50743f69ff8c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:56:01.534189 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-df04a6c3-253e-477a-9fc0-4bb433ba1371 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '.version_select at 0x7f66c7c2e310>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:01.561518 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-df04a6c3-253e-477a-9fc0-4bb433ba1371 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1824882643" status: 202 len: 0 microversion: 2.1 time: 0.031199 Aug 29 11:56:01.562067 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3617/7200] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 11:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1824882643 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:56:01.594950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1a027a54-4829-40b3-aa65-11a78682fb03 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: .version_select at 0x7f66c5c038b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-819477458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNecq/21UlPM5CHYCd0OSbJi2TF6dw3e8dPqdVTTZittN37CDoYg7ck3IKJAc8G/AMOD8DqXtGIyek1zwhFzuButQSitSN0z67wruWIqzSgs5Epel53jKlILHd9hvkXylA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:01.618109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1a027a54-4829-40b3-aa65-11a78682fb03 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:56:01.624743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1a027a54-4829-40b3-aa65-11a78682fb03 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:56:01.651053 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1a027a54-4829-40b3-aa65-11a78682fb03 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060192 Aug 29 11:56:01.652251 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3584/7201] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:56:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:56:09.063263 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:56:09.063730 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 11:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 29 11:56:09.067768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:09.076159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1577468590", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "93fd090c-1c2c-4600-86db-838f5d8788d6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-819477458", "security_groups": [{"name": "tempest-secgroup-smoke-1980663230"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:09.326303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] validate_networks() for [('93fd090c-1c2c-4600-86db-838f5d8788d6', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:56:10.022927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:56:10.023837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:56:10.024469 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:56:10.025182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:56:10.025956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:56:10.038117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:10.038785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:10.039304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:10.040174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:10.040854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:10.041414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:10.068057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:56:10.076446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:56:10.094435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:56:10.097347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:56:10.153645 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b2cef30e-61a4-4585-a49d-1c5db069467e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093119 Aug 29 11:56:10.156115 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3618/7202] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:56:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 11:56:10.167747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:10.174775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-27a8a552-0ed5-4a2a-a57c-3c99fa7409da tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:10.175902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-27a8a552-0ed5-4a2a-a57c-3c99fa7409da tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:10.277388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-27a8a552-0ed5-4a2a-a57c-3c99fa7409da tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:10.285585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-27a8a552-0ed5-4a2a-a57c-3c99fa7409da tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1266 microversion: 2.1 time: 0.121856 Aug 29 11:56:10.286316 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3585/7203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:10 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:56:11.321151 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:11.323517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:11.335492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:11.336590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:11.337747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:11.339668 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:11.340356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:11.341096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:11.451992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:11.471341 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b5ccf6cd-dbcc-4b8c-97ae-b842a19f2260 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1318 microversion: 2.1 time: 0.157726 Aug 29 11:56:11.471341 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3619/7204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:11 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:56:12.518613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:12.520571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:12.536182 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:12.544805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:12.545694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:12.547486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:12.548700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:12.549487 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:12.831694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:12.870756 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-462e04b4-2895-4e67-9eb3-bc81977b4f5d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.349761 Aug 29 11:56:12.875982 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3586/7205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:12 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:13.570157 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34c2767-4487-401e-8a0f-16341cf1cac0", "tag": "593f3114-8021-43e8-aeed-c710d4a1e73a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:13.588286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:13.589137 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:13.590220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:13.608184 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] Creating event network-changed:593f3114-8021-43e8-aeed-c710d4a1e73a for instance a34c2767-4487-401e-8a0f-16341cf1cac0 on n-h2-854121-10 Aug 29 11:56:13.614813 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-4a3386b3-3cec-444d-8891-0d0aa64c84ec req-eeb0d384-19f7-4388-aa92-49ef185b12a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052163 Aug 29 11:56:13.615709 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3620/7206] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:56:13.897745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:13.898403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:13.907146 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:13.907962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:13.908421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:13.909159 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:13.909635 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:13.910121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:14.094897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:14.103466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3878e6b7-4e5e-48c7-901e-27e744f9c46f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.210239 Aug 29 11:56:14.104077 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3587/7207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:13 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:15.143914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:15.145294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:15.158584 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:15.159544 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:15.160371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:15.161801 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:15.162674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:15.163472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:15.383887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:15.393992 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9129c694-7106-495e-8a59-06423f4719a7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.260762 Aug 29 11:56:15.407377 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3621/7208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:15 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:16.418160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:16.419407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:16.431663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:16.433121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:16.433940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:16.435289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:16.436147 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:16.436892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:16.654576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:16.664136 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4512315e-b408-4527-9b65-e4e20908f8a1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.252751 Aug 29 11:56:16.664618 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3588/7209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:16 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:17.697738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:17.699695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:17.702854 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:17.709931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:17.710479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:17.710946 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:17.711742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:17.712259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:17.712719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:17.883499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:17.895091 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2e049962-91fa-46cc-a2d5-99c3ff5b241d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.201631 Aug 29 11:56:17.895738 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3622/7210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:17 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:18.639994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34c2767-4487-401e-8a0f-16341cf1cac0", "name": "network-vif-plugged", "status": "completed", "tag": "593f3114-8021-43e8-aeed-c710d4a1e73a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:18.646339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:18.658671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:18.659560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:18.660346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:18.684832 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] Creating event network-vif-plugged:593f3114-8021-43e8-aeed-c710d4a1e73a for instance a34c2767-4487-401e-8a0f-16341cf1cac0 on n-h2-854121-10 Aug 29 11:56:18.695027 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-f384c6e3-a3c3-432f-8164-6d2ee9b7ef73 req-c975eeb4-1bef-43d2-bf55-c7fa1f105b40 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059785 Aug 29 11:56:18.696160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3589/7211] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:56:18.929495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:18.930381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:18.939331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:18.939727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:18.940183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:18.941198 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:18.941673 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:18.942147 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:19.116517 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:19.131734 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bf4cb007-da00-4a39-9f3f-0baf97af6361 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1392 microversion: 2.1 time: 0.206334 Aug 29 11:56:19.132763 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3623/7212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:18 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:20.162204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:20.163547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:20.176204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:20.177070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:20.177897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:20.179150 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:20.179982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:20.180756 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:20.286679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:20.365257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:20.375353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b090163d-3bed-49ed-8ca3-0ce350b27383 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1565 microversion: 2.1 time: 0.223872 Aug 29 11:56:20.375978 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3590/7213] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:20 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:20.397185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:20.398158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:20.402788 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:20.403621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:20.411265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:20.411823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:20.412412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:20.413336 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:20.413923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:20.414421 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:20.602375 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:20.612210 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d629f059-e93c-420c-a96a-394d8285543d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1565 microversion: 2.1 time: 0.218883 Aug 29 11:56:20.612929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3624/7214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:20 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:23.686471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34c2767-4487-401e-8a0f-16341cf1cac0", "tag": "593f3114-8021-43e8-aeed-c710d4a1e73a"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:23.688792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:23.691134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:23.706629 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:23.708512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:23.709297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:23.710588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:23.711460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:23.712062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:23.712400 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:23.713111 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:23.714687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:23.734555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] Creating event network-changed:593f3114-8021-43e8-aeed-c710d4a1e73a for instance a34c2767-4487-401e-8a0f-16341cf1cac0 on n-h2-854121-10 Aug 29 11:56:23.741268 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-0fa67d71-3305-41c4-befc-a072a51dd6ec req-f358ea71-923b-4445-8d2b-f1222f2ce012 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058948 Aug 29 11:56:23.743145 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3625/7215] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:56:23.944842 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:23.958140 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9a9871eb-bcdf-462c-a273-d758a19f8a91 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1565 microversion: 2.1 time: 0.280951 Aug 29 11:56:23.959665 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3591/7216] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:23 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1565 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:44.335248 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:44.337811 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:44.341048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=7 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:44.341750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:44.349035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:44.349561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:44.350056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:44.350823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:44.351296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:44.351747 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:44.412723 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1b401963-44f8-4280-9b86-913fc9c78576 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action" status: 200 len: 24571 microversion: 2.1 time: 0.082334 Aug 29 11:56:44.424534 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3626/7217] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:56:44 2022] POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 11:56:55.493982 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:56:55.497362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:55.500105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=5 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:55.500884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:55.508188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:55.508696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:55.509137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:55.510032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:55.510818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:55.510945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:55.601163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c256b745-ef31-43a1-b4ec-c07e1a410864 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action" status: 202 len: 0 microversion: 2.1 time: 0.110713 Aug 29 11:56:55.602233 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3592/7218] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:56:55 2022] POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:56:55.612723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:55.613985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:55.617516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:55.618644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:56:55.628692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:55.629481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:55.630102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:55.630977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:55.631698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:55.632487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:55.796341 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:55.805881 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-699a1b3d-d1bb-4c0c-b31a-38d94bc256ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1675 microversion: 2.1 time: 0.198052 Aug 29 11:56:55.807315 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3627/7219] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:55 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:56:56.836961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:56.837674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:56.845178 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:56.845743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:56.846200 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:56.846940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:56.847405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:56.847844 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:57.001421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:57.010880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d0258f29-1a2a-44ac-bbf9-6ae62155570b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.179280 Aug 29 11:56:57.011630 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3593/7220] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:56 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:56:58.034803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:58.035716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:58.044897 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:58.045514 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:58.046102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:58.046938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:58.047536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:58.048045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:58.217437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:58.226428 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-974dce94-2e8f-4c36-8db9-1105391c6c99 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.195677 Aug 29 11:56:58.227019 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3628/7221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:58 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:56:59.250887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:56:59.251542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:56:59.260325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:59.261233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:59.262101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:59.263017 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:56:59.263534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:56:59.264049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:56:59.462142 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:56:59.472552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29bc5abf-66dc-48d7-9608-13a5b8b14036 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.226002 Aug 29 11:56:59.473466 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3594/7222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:56:59 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:57:00.497320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:00.498109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:00.505989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:00.506481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:00.506938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:00.507691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:00.508273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:00.508728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:00.672475 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:00.681165 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9228f34e-10bf-4e4e-9589-889c0d0da18f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.189108 Aug 29 11:57:00.682338 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3629/7223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:00 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:01.719208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:01.719947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:01.726868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:01.727372 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:01.727806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:01.728616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:01.729670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:01.730387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:01.909976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:01.919612 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f533b2e1-d176-4352-b026-f109a274f8c0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.204412 Aug 29 11:57:01.920250 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3595/7224] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:01 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:02.942952 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:02.944027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:02.952312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:02.952841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:02.953311 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:02.954099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:02.954598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:02.955053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:03.125425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:03.133945 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0983dde2-2488-4463-bded-adf107973c2b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.195345 Aug 29 11:57:03.135271 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3630/7225] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:02 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:57:04.158886 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:04.159659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:04.168134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:04.168688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:04.169173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:04.169990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:04.170535 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:04.171021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:04.328785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:04.338532 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f6762bee-0a20-4f99-a54b-bbd554206a45 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.184505 Aug 29 11:57:04.339386 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3596/7226] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:04 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:05.361844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:05.362473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:05.370711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:05.371258 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:05.371719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:05.372467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:05.372944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:05.373393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:05.529967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:05.538946 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e1d8ce8-d138-45d6-bea9-d01c924fa3d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.181162 Aug 29 11:57:05.539570 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3631/7227] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:05 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:06.561313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:06.562029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:06.570245 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:06.570743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:06.571183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:06.571905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:06.572983 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:06.573721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:06.736225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:06.745948 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ee0291e7-dcbc-453e-a759-fc3e637c00de tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.189114 Aug 29 11:57:06.746563 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3597/7228] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:06 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:07.785632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:07.786869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:07.797288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:07.797825 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:07.798309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:07.799062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:07.799540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:07.799978 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:07.951458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:07.959921 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3ea9aab8-56ae-4eea-b7d9-24656c3371df tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.182005 Aug 29 11:57:07.960593 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3632/7229] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:07 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:08.983306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:08.984195 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:08.991392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:08.991869 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:08.992314 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:08.993046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:08.993509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:08.993991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:09.170163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:09.180449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-28d3b31e-d6de-4cab-a743-64b3bc16347b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.201155 Aug 29 11:57:09.181140 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3598/7230] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:08 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:10.203607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:10.204362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:10.212446 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:10.213477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:10.214695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:10.215464 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:10.215959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:10.216460 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:10.371576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:10.386838 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-820a4c64-a991-41c3-b0da-76fe5fb405aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.186793 Aug 29 11:57:10.387854 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3633/7231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:10 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:11.421299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:11.422037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:11.429476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:11.429998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:11.430444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:11.431175 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:11.431902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:11.432446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:11.590600 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:11.599518 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-17507a6e-fc56-4211-9286-09ebfd3426ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1680 microversion: 2.1 time: 0.182187 Aug 29 11:57:11.600115 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3599/7232] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:11 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:12.621587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:12.622241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:12.629944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:12.630465 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:12.630930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:12.631684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:12.632174 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:12.632626 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:12.792837 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:12.808446 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c1e344fc-63c9-4000-94e2-e85b94ad9ba3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1683 microversion: 2.1 time: 0.191248 Aug 29 11:57:12.809349 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3634/7233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:12 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:37.043449 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:57:37.046059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:37.048758 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:57:37.049505 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:57:37.057246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:37.057806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:37.058391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:37.059168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:37.059662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:37.060098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:37.126299 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5b0fd00-9800-44c4-96e7-4309459e622e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action" status: 200 len: 68918 microversion: 2.1 time: 0.086848 Aug 29 11:57:37.126904 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3600/7234] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:57:37 2022] POST /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0/action => generated 68918 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 11:57:45.185002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:45.185933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:45.189434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34c2767-4487-401e-8a0f-16341cf1cac0", "tag": "593f3114-8021-43e8-aeed-c710d4a1e73a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:57:45.194765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=16 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:57:45.196091 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=48 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:57:45.205010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:45.205752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:45.207170 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:45.209025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:45.209776 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:45.210450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:45.213814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:45.214878 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:45.215781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:45.242994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] Creating event network-changed:593f3114-8021-43e8-aeed-c710d4a1e73a for instance a34c2767-4487-401e-8a0f-16341cf1cac0 on n-h2-854121-10 Aug 29 11:57:45.254595 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4de5ceca-191e-47be-802d-bd234585fe73 req-9e42a9eb-6a80-4631-861b-a3c2e18bf95b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073223 Aug 29 11:57:45.256769 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3601/7235] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:57:45.275214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:57:45.420497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-eccbbd1b-c2d0-4c18-8e06-27986c1947ba tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 204 len: 0 microversion: 2.1 time: 0.241571 Aug 29 11:57:45.421905 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3635/7236] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:57:45 2022] DELETE /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:57:45.436064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:45.438047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:45.454257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:45.456941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:45.458307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:45.459709 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:45.460850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:45.461619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:45.684780 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:45.693969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b06ed914-0b37-42ea-a429-321d8616849a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1689 microversion: 2.1 time: 0.266882 Aug 29 11:57:45.694917 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3602/7237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:45 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:46.719600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:46.720444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:46.728691 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:46.729537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:46.730029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:46.730794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:46.731276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:46.731723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:46.932541 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:46.942564 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-db074dc3-0051-480d-ae32-10690a866947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1689 microversion: 2.1 time: 0.227988 Aug 29 11:57:46.943285 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3636/7238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:46 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:47.489504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34c2767-4487-401e-8a0f-16341cf1cac0", "name": "network-vif-deleted", "tag": "593f3114-8021-43e8-aeed-c710d4a1e73a"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:57:47.502580 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:47.503042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:47.503613 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:47.518548 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] Creating event network-vif-deleted:593f3114-8021-43e8-aeed-c710d4a1e73a for instance a34c2767-4487-401e-8a0f-16341cf1cac0 on n-h2-854121-10 Aug 29 11:57:47.530082 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-c08c0d27-0d0d-41c1-bd11-02756c3e2ffb req-356aad19-7fcd-4862-897e-215ba87b3ed3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043895 Aug 29 11:57:47.531133 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3603/7239] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:57:47.983299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:47.984735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:47.996648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:47.997378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:47.997988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:47.998877 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:47.999521 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:48.000051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:48.039581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:48.040010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:48.040529 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:48.041231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lazy-loading 'fault' on Instance uuid a34c2767-4487-401e-8a0f-16341cf1cac0 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 11:57:48.101312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:57:48.112498 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-30c2741e-922d-4f35-ad01-70d801a056d5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 200 len: 1356 microversion: 2.1 time: 0.137347 Aug 29 11:57:48.113182 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3637/7240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:47 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 1356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:57:49.138472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:49.140060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: a34c2767-4487-401e-8a0f-16341cf1cac0] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:57:49.148581 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:49.149094 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:49.150129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:49.151102 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:57:49.151362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:57:49.151804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:57:49.168819 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] HTTP exception thrown: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Request method failure captured: Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 HTTP/1.1 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKkLEmdnA0xMF-NdPOv0FhV0FW-2hWnGx89xD61lzT4Ysf9JBvfY2kgJadn6ZJPMOMlC4mWIQSLtjxL0tOUooX_m-7eThhiK-nuxDtKZqmSeVM5ExwnlXdmQaSDXpDzHG1z6VgXcPUf3IF3gYOndLzbo_J5Nh2tHEIr1vuajsgtA9s4 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f10ac2093cdc444cb2f2cdde61f4257e Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a34c2767-4487-401e-8a0f-16341cf1cac0'} Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:57:49.170619 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Returning 404 to user: Instance a34c2767-4487-401e-8a0f-16341cf1cac0 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-da26bc0f-d85c-49b9-8103-dee6bdcdc33b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0" status: 404 len: 111 microversion: 2.1 time: 0.039488 Aug 29 11:57:49.178213 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3604/7241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:57:49 2022] GET /compute/v2.1/servers/a34c2767-4487-401e-8a0f-16341cf1cac0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:57:53.481294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b644cc7a-7bb3-4678-95e0-d8124ab5b2e9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '.version_select at 0x7f66c5a41f70>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:57:53.514046 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b644cc7a-7bb3-4678-95e0-d8124ab5b2e9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-819477458" status: 202 len: 0 microversion: 2.1 time: 0.051939 Aug 29 11:57:53.515407 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3638/7242] 10.222.0.47 () {58 vars in 1281 bytes} [Mon Aug 29 11:57:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-819477458 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:57:53.553396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1884949f-6de5-493d-ba0f-c04c2e6a5947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: .version_select at 0x7f66c7625820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1826028815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp6PpVCLNA9VFXk0qKjO1rXLyFtZweqH7yT9icktzJI7iExgdlrzHeA2b8ZZ52Rvwv3CTJgELvQut5tcfsw2t8CqmICkPKoIGSUnau6qsfasM/lRuiAnxSr4+ZhsjHc2g=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:57:53.582123 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 11:57:53.582322 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 11:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.47) !!! Aug 29 11:57:53.606921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1884949f-6de5-493d-ba0f-c04c2e6a5947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:57:53.617435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-1884949f-6de5-493d-ba0f-c04c2e6a5947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:57:53.654838 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1884949f-6de5-493d-ba0f-c04c2e6a5947 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.106956 Aug 29 11:57:53.655581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3605/7243] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:57:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:58:01.853752 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:01.865470 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-357463422", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "ccfab609-32d4-4322-9aa4-8617c5f3219f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1826028815", "security_groups": [{"name": "tempest-secgroup-smoke-1343068680"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:02.155100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] validate_networks() for [('ccfab609-32d4-4322-9aa4-8617c5f3219f', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:58:02.838896 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:58:02.839479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:58:02.840359 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:58:02.841807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:58:02.842524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:58:02.855968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:02.857061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:02.857061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:02.857748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:02.858355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:02.858814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:02.883169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:58:02.892349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:58:02.909847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:58:02.912959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:58:02.992590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48e46920-27c4-49aa-bc67-1ad99f5a526a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.144665 Aug 29 11:58:02.994695 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3639/7244] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:58:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:58:03.015847 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3d8ddba1-a8d6-407c-a5a8-95eab0207148 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:03.018058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3d8ddba1-a8d6-407c-a5a8-95eab0207148 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:03.029503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=16 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:03.157333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3d8ddba1-a8d6-407c-a5a8-95eab0207148 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:03.179610 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3d8ddba1-a8d6-407c-a5a8-95eab0207148 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1266 microversion: 2.1 time: 0.171540 Aug 29 11:58:03.192352 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3606/7245] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:03 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:04.226057 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:04.227549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:04.240547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:04.241996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:04.243406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:04.245176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:04.246223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:04.247145 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:04.394093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:04.410338 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-96647904-a2db-498f-8ddd-b040d3c59d6e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1318 microversion: 2.1 time: 0.194263 Aug 29 11:58:04.411060 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3640/7246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:04 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:05.438771 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:05.440036 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:05.456962 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:05.468523 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:05.469413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:05.470668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:05.472474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:05.473063 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:05.750116 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:05.760893 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ae4ece4d-b77e-4741-9d38-ab965b27349b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.331261 Aug 29 11:58:05.761795 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3607/7247] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:05 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:06.463093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:06.480809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:06.482127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:06.483074 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:06.498300 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] Creating event network-changed:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h2-854121-10 Aug 29 11:58:06.503784 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-9f178ec0-577b-4d6c-8825-4b6aa74c546b req-dd7769a7-b665-4228-89cb-d84e5d5432b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047559 Aug 29 11:58:06.504491 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3641/7248] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:58:06.792738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:06.793462 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:06.804782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:06.806226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:06.807051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:06.808366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:06.809237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:06.810098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:07.162534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:07.171880 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2b0bd2bc-6e92-43fb-80f4-10464edb6ca6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.385198 Aug 29 11:58:07.172486 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3608/7249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:06 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:08.202162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:08.203538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:08.216384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:08.217334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:08.218259 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:08.219383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:08.220558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:08.221384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:08.501340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:08.512552 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e444de6-2573-4541-9289-4d6b7d60e403 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.321682 Aug 29 11:58:08.513660 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3642/7250] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:08 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:09.541782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:09.543014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:09.547931 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:09.562639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:09.563565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:09.564395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:09.565999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:09.566870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:09.567611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:09.800551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:09.810486 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-47dd1166-23c3-4ebd-87d8-4976058d1a4c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.276805 Aug 29 11:58:09.812484 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3609/7251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:09 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:10.834715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:10.835409 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:10.844223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:10.844780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:10.845257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:10.846193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:10.846764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:10.847272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:11.016418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:11.026085 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a25c0e5-aaaa-4d0c-91d1-96bf6b812c72 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.195920 Aug 29 11:58:11.026817 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3643/7252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:10 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:11.465466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "name": "network-vif-plugged", "status": "completed", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:11.476447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:11.476988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:11.478301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:11.492339 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] Creating event network-vif-plugged:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h2-854121-10 Aug 29 11:58:11.498989 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-09fc6903-cebc-443d-86f5-b5892ebe7da0 req-a26e8b5a-8c7c-4206-97b2-c9b6e9467c0d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153015 Aug 29 11:58:11.499845 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3610/7253] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:58:12.048781 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:12.049629 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:12.059570 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:12.060096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:12.060574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:12.061328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:12.061841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:12.062293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:12.219370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:12.228934 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-910396ec-23fb-4940-b248-f8b431ee1e12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1392 microversion: 2.1 time: 0.185032 Aug 29 11:58:12.229533 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3644/7254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:12 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:13.247796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:13.252590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:13.253320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:13.261908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:13.262331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:13.262919 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:13.263680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:13.264179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:13.264623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:13.446718 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:13.456929 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cf20576a-7087-462d-b3bb-f66c71c64fbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1564 microversion: 2.1 time: 0.210812 Aug 29 11:58:13.457594 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3611/7255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:13 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:13.480462 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:13.481140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:13.484063 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:13.484835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:13.493331 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:13.494647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:13.495271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:13.496281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:13.496771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:13.497226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:13.668213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:13.676642 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bd85669f-e8a2-44d6-8f49-07d55296da6a tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1564 microversion: 2.1 time: 0.201617 Aug 29 11:58:13.677342 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3645/7256] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:13 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1564 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:15.832763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:15.840688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:15.841310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:15.847277 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:15.850038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:15.850496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:15.851296 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:15.852732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:15.854081 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:15.855075 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:15.856430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:15.858160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:15.858160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:15.866727 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] Creating event network-changed:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h2-854121-10 Aug 29 11:58:15.872751 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-19ea2d81-d9e5-4fd8-9770-d7b285d772ed req-b7aaa749-6211-40fe-be7e-1907dce8223c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043799 Aug 29 11:58:15.873619 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3646/7257] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:58:16.134977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:16.155227 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-029291cd-be26-4932-a514-6f88d652f4ea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1564 microversion: 2.1 time: 0.331630 Aug 29 11:58:16.156431 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3612/7258] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:15 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1564 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:36.934193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:36.937072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:36.940892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:36.948208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:36.948735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:36.949202 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:36.949989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:36.950471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:36.950933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:37.008882 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c0222b19-27c3-4d9b-b443-52ab428c051f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action" status: 200 len: 24564 microversion: 2.1 time: 0.078954 Aug 29 11:58:37.009691 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3647/7259] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:58:36 2022] POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action => generated 24564 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 11:58:43.439516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:43.442762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:43.446013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:43.446943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:58:43.453013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:43.453508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:43.454083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:43.454824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:43.455302 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:43.455735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:43.504287 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:43.513582 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128682) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 11:58:43.522101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:58:43.522659 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:58:43.523143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:58:43.524321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:58:43.524804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:58:43.603472 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-37731918-5bb2-4e64-9d14-6f0c51410713 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action" status: 202 len: 0 microversion: 2.1 time: 0.168155 Aug 29 11:58:43.604232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3613/7260] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:58:43 2022] POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:58:43.619237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:43.621053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:43.636192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:43.636922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:43.637540 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:43.638839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:43.640029 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:43.641032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:43.962774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:43.976019 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-98087ad2-5617-4539-9f4c-4ac2ce3c717c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1692 microversion: 2.1 time: 0.365515 Aug 29 11:58:43.989732 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3648/7261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:43 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:45.000539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:45.001384 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:45.015233 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:45.015902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:45.016458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:45.017295 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:45.017904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:45.018441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:45.339258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:45.349741 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-032213e1-c87c-43e3-a69e-3686001aaddf tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1692 microversion: 2.1 time: 0.353237 Aug 29 11:58:45.350469 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3614/7262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:44 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1692 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:46.384028 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:46.386183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:46.397276 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:46.398134 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:46.399876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:46.401778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:46.402569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:46.403364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:46.604163 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:46.615555 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1850a2c3-8724-4a2e-bf23-94b827e35ea6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1692 microversion: 2.1 time: 0.236816 Aug 29 11:58:46.616325 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3649/7263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:46 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:47.639023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:47.639762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:47.647265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:47.647887 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:47.649105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:47.650536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:47.651371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:47.652136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:47.812318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:47.821465 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7317d72b-a28a-443a-97b1-ae9642f8c261 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.186495 Aug 29 11:58:47.822128 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3615/7264] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:47 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:48.844107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:48.844807 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:48.852784 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:48.853318 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:48.853942 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:48.854707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:48.855192 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:48.855654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:49.012212 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:49.027654 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-625b371c-693f-4ce2-8c16-225f5c269a25 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.187325 Aug 29 11:58:49.028720 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3650/7265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:48 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:50.056010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:50.056732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:50.064649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:50.065275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:50.066057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:50.066903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:50.067486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:50.067961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:50.264378 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:50.274104 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-18220bec-fa91-4cab-bef7-65c1dd820347 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.222023 Aug 29 11:58:50.275152 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3616/7266] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:50 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:51.298700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:51.299351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:51.308417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:51.308933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:51.309392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:51.310175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:51.310654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:51.311104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:51.468612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:51.477443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dc2d587f-3f8d-43b7-a1e6-e414bf8832a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.182428 Aug 29 11:58:51.478092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3651/7267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:51 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:52.500323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:52.501026 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:52.508967 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:52.509479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:52.509981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:52.510723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:52.511194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:52.511639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:52.669423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:52.684377 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b0a53abf-4dcd-4a3d-bbd7-452c28cbece2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.187744 Aug 29 11:58:52.685440 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3617/7268] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:52 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:58:53.709131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:53.709783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:53.718200 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:53.718724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:53.719193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:53.719954 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:53.720444 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:53.720898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:53.916820 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:53.927495 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d0957c23-f477-43c2-9761-b486ab71301e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.222885 Aug 29 11:58:53.928111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3652/7269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:53 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:54.951463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:54.952074 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:54.960550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:54.961853 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:54.962670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:54.963486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:54.964003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:54.964482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:55.122437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:55.131491 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9f32e00e-c309-47cd-9d7d-74a46a49c916 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.184329 Aug 29 11:58:55.132189 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3618/7270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:54 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:56.154677 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:56.155477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:56.165211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:56.165956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:56.166477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:56.167355 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:56.168301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:56.168912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:56.334798 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:56.343843 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c6f0363a-a388-4a02-b2fb-44d3aac2512c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.193238 Aug 29 11:58:56.344531 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3653/7271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:56 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:57.368889 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:57.369828 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:57.379012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:57.379691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:57.380316 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:57.381158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:57.381741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:57.382279 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:57.554029 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:57.565994 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-830db81f-35e2-4124-95e8-688a7ff61a12 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1697 microversion: 2.1 time: 0.200950 Aug 29 11:58:57.566602 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3619/7272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:57 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:58.593451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:58.594853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:58.603826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:58.604502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:58.605062 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:58.605997 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:58.606581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:58.607175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:58.838417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:58:58.856872 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0932e56c-5f17-441d-a11b-0e19b92a1d5e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1696 microversion: 2.1 time: 0.270714 Aug 29 11:58:58.858181 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3654/7273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:58 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:58:59.061591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "name": "network-vif-unplugged", "status": "completed", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:58:59.086715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:59.087051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:59.087558 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:59.105892 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Creating event network-vif-unplugged:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h1-854121-10 Aug 29 11:58:59.112904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:58:59.129143 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-865c8e58-e8d6-4617-8611-91b817d1caf2 req-691eaf62-48d1-451e-85ee-7782ef08e482 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074460 Aug 29 11:58:59.130085 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3620/7274] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:58:59.895563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:58:59.896490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:58:59.905012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:59.905528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:59.906022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:58:59.906890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:58:59.907392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:58:59.907843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:00.148926 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:00.162062 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d1256aec-99e1-495a-8d9c-a2029bd041d1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1696 microversion: 2.1 time: 0.270193 Aug 29 11:59:00.163092 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3655/7275] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:58:59 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:01.151061 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:01.161823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:01.162310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:01.162746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:01.177326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Creating event network-changed:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h1-854121-10 Aug 29 11:59:01.184431 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-10', 'n-h1-854121-10'} {{(pid=128682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 11:59:01.189914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:01.191097 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:01.199953 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5d9b347e-6cb2-4e5d-a656-ac85f0c9012f req-9e4b4601-9727-4e7b-b7aa-a9c7da61c1ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054072 Aug 29 11:59:01.200824 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3621/7276] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:59:01.202632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:01.203635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:01.204594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:01.206123 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:01.206973 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:01.207759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:01.466338 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:01.482172 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-efd6883b-a564-4316-b075-5434878c82a9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1694 microversion: 2.1 time: 0.297054 Aug 29 11:59:01.482880 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3656/7277] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:01 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:02.523618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:02.524728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:02.533419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.534365 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.535022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:02.535916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.536593 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.537105 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:02.736634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:02.746080 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-cbcb9aac-9267-43e7-ab86-eaad607f6789 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1691 microversion: 2.1 time: 0.230831 Aug 29 11:59:02.746775 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3622/7278] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:02 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:02.771278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:02.771943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:02.779634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.780031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.780490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:02.781231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.781740 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.782180 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:02.855064 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00785357-c47a-458b-8067-e6a730ccbf6b tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action" status: 204 len: 0 microversion: 2.1 time: 0.087199 Aug 29 11:59:02.856253 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3657/7279] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:59:02 2022] POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:59:02.865815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:02.867745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:02.874331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.874824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.875267 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:02.875984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:02.876440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:02.876870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:03.157790 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:03.178273 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe05e633-e216-4a38-8137-042b01ac8137 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1691 microversion: 2.1 time: 0.316271 Aug 29 11:59:03.183615 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3623/7280] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:02 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1691 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:03.205850 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:03.207101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:03.216347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:03.217239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:03.217930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:03.218979 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:03.219592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:03.220153 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:03.600206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:03.611806 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3271d0cb-daec-4908-aba2-d5718646b01c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1691 microversion: 2.1 time: 0.411382 Aug 29 11:59:03.612927 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3658/7281] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:03 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1691 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:04.642051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:04.643096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:04.653944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:04.654877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:04.655654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:04.657511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:04.658423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:04.659246 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:04.854929 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:04.863499 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-941463a2-6fe3-4f9f-b9bb-8cace49763be tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1683 microversion: 2.1 time: 0.227298 Aug 29 11:59:04.864119 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3624/7282] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:04 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:05.653053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "name": "network-vif-plugged", "status": "completed", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:05.672368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:05.673237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:05.674084 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:05.699086 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] Creating event network-vif-plugged:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h1-854121-10 Aug 29 11:59:05.709193 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-fc942a29-9cba-4789-992e-103233c2b68f req-445445f8-ed55-4c28-a7c7-0e5bd019a1f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060238 Aug 29 11:59:05.710204 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3659/7283] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:59:27.105313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:27.107825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:27.111232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=28 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:27.111956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:27.122519 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:27.123386 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:27.124166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:27.125445 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:27.126298 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:27.127089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:27.204358 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1f9cf022-6497-495c-954c-c1efd7219d33 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action" status: 200 len: 24576 microversion: 2.1 time: 0.103072 Aug 29 11:59:27.205320 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3625/7284] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 11:59:27 2022] POST /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e/action => generated 24576 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 11:59:34.495796 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:34.498769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:34.504456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=27 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:34.505863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:34.520146 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:34.521021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:34.521831 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:34.523230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:34.524197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:34.524923 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:34.579783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 11:59:34.624262 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:34.637552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:34.638455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:34.638912 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:34.656000 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] Creating event network-changed:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h1-854121-10 Aug 29 11:59:34.663526 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ebe453af-1281-4809-bf0a-49b5588705c2 req-0595137b-4529-40f0-9926-383067b968cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165884 Aug 29 11:59:34.665136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3626/7285] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:59:34.714395 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-447b9e4f-188f-458d-9868-f0d418b4f468 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 204 len: 0 microversion: 2.1 time: 0.225581 Aug 29 11:59:34.719165 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3660/7286] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 11:59:34 2022] DELETE /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 11:59:34.731140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:34.732423 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:34.745947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:34.747362 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:34.748700 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:34.750437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:34.751447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:34.752335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:34.999615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:35.008840 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c8bb9c0-f689-41c9-8e2f-e5c4ef13e36c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1689 microversion: 2.1 time: 0.287379 Aug 29 11:59:35.009555 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3627/7287] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:34 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1689 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:36.043356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:36.045129 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:36.059093 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:36.060109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:36.060965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:36.062449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:36.063347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:36.064178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:36.365525 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:36.385229 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c8b1e99e-8128-45c0-a459-59d5ead39536 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 200 len: 1689 microversion: 2.1 time: 0.350987 Aug 29 11:59:36.387230 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3661/7288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:36 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 1689 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:36.749888 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa290e2-d762-425a-bb09-8c96e7d9d39e", "name": "network-vif-deleted", "tag": "905c1dcc-6105-408f-9f67-89e0a3ac2ab2"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:36.760877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:36.761385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:36.761871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:36.777632 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] Creating event network-vif-deleted:905c1dcc-6105-408f-9f67-89e0a3ac2ab2 for instance cfa290e2-d762-425a-bb09-8c96e7d9d39e on n-h1-854121-10 Aug 29 11:59:36.783153 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-5e241b76-a687-4e1b-ae3a-29528bff91f9 req-c85ddc54-5c19-4b76-bd26-27fdd7e5707f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107067 Aug 29 11:59:36.783803 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3628/7289] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:59:37.413546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:37.414303 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: cfa290e2-d762-425a-bb09-8c96e7d9d39e] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:37.423197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:37.423852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:37.424401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:37.425270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:37.425892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:37.426398 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:37.443528 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] HTTP exception thrown: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Request method failure captured: Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e HTTP/1.1 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDKkLEmdnA0xMF-NdPOv0FhV0FW-2hWnGx89xD61lzT4Ysf9JBvfY2kgJadn6ZJPMOMlC4mWIQSLtjxL0tOUooX_m-7eThhiK-nuxDtKZqmSeVM5ExwnlXdmQaSDXpDzHG1z6VgXcPUf3IF3gYOndLzbo_J5Nh2tHEIr1vuajsgtA9s4 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: f10ac2093cdc444cb2f2cdde61f4257e Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'cfa290e2-d762-425a-bb09-8c96e7d9d39e'} Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:59:37.445999 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Returning 404 to user: Instance cfa290e2-d762-425a-bb09-8c96e7d9d39e could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e02c0b01-0087-4dde-9e50-0d8c34d85c92 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e" status: 404 len: 111 microversion: 2.1 time: 0.039210 Aug 29 11:59:37.455317 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3662/7290] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:37 2022] GET /compute/v2.1/servers/cfa290e2-d762-425a-bb09-8c96e7d9d39e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 11:59:41.684957 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d487517d-3c4c-4e89-9fb8-144287e90814 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '.version_select at 0x7f66c711b9d0>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:41.719659 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d487517d-3c4c-4e89-9fb8-144287e90814 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826028815" status: 202 len: 0 microversion: 2.1 time: 0.040950 Aug 29 11:59:41.720659 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3629/7291] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 11:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826028815 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 11:59:41.758414 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5946cf74-f052-4882-bb0f-42cdfdbb0e86 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: .version_select at 0x7f66c5b775e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1025682781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP18ctHhgJtKmtp2Ptk9ENrGIRiSTlRcQTTK8AtUTfItxOR8odfqnFz/a2MAMaNbAW+GWKgLriv8jKOL/pPsbw11GySnqRdw3IuP3Bd3Gi/4br7Y47VGpC77RX17h23UMA=="}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:41.790049 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5946cf74-f052-4882-bb0f-42cdfdbb0e86 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:59:41.800903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-5946cf74-f052-4882-bb0f-42cdfdbb0e86 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:59:41.837200 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5946cf74-f052-4882-bb0f-42cdfdbb0e86 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.087054 Aug 29 11:59:41.847088 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3663/7292] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 11:59:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 11:59:49.593391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-460113584", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "b74998a8-1846-4c88-a7c8-80408fa9c011"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1025682781", "security_groups": [{"name": "tempest-secgroup-smoke-450092415"}]}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:49.616257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=14 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:50.282110 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.network.neutron [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] validate_networks() for [('b74998a8-1846-4c88-a7c8-80408fa9c011', None, None, None, None, None)] {{(pid=128682) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 11:59:50.945993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 11:59:50.946896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 11:59:50.946896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 11:59:50.947607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 11:59:50.947773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.virt.hardware [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 11:59:50.957727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:50.958234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:50.958745 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:50.959683 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:50.960463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:50.961231 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:50.985202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 11:59:50.992226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 11:59:51.008732 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Going to run 1 instances... {{(pid=128682) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 11:59:51.012815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 11:59:51.089101 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dfa86fd3-9c10-4262-9c3c-f0bfcfae61fc tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.500341 Aug 29 11:59:51.090515 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3630/7293] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 11:59:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 11:59:51.109755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:51.115035 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-be780951-8b27-442a-8e42-9eceff93f30c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:51.116038 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-be780951-8b27-442a-8e42-9eceff93f30c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:51.240453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-be780951-8b27-442a-8e42-9eceff93f30c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:51.252559 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-be780951-8b27-442a-8e42-9eceff93f30c tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1266 microversion: 2.1 time: 0.143784 Aug 29 11:59:51.253607 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3664/7294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:51 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:52.293846 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:52.294809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:52.306726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:52.307538 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:52.308092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:52.308936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:52.309510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:52.310089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:52.409978 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:52.422613 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b317dde-94de-405f-beaf-c6a626ccc8e8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1318 microversion: 2.1 time: 0.136904 Aug 29 11:59:52.423593 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3631/7295] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:52 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:53.461183 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:53.464641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:53.484527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:53.485388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:53.486115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:53.488418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:53.488956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:53.489428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:53.641965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:53.669571 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9adb9597-b38a-4988-acbd-a7846c192757 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1324 microversion: 2.1 time: 0.212538 Aug 29 11:59:53.670979 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3665/7296] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:53 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:54.714193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:54.715152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:54.722943 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:54.723547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:54.723994 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:54.724722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:54.725785 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:54.726241 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:54.968636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:55.011283 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-827520d5-59f7-44b5-bd25-530bba144382 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.302110 Aug 29 11:59:55.024598 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3632/7297] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:54 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:55.047445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83091e88-2c60-4c8c-a7d4-56c46154baf6", "tag": "25307eff-cc43-4d22-9121-f5d1b92400ff"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 11:59:55.068492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:55.070350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:55.070814 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:55.086770 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] Creating event network-changed:25307eff-cc43-4d22-9121-f5d1b92400ff for instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 on n-h2-854121-10 Aug 29 11:59:55.093392 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-6c1dc63c-6752-458a-8642-b832c819faad req-bef679d0-47a0-4ba7-a926-483304838fd8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050258 Aug 29 11:59:55.094070 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3666/7298] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 11:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 11:59:56.060201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:56.060818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:56.068276 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:56.069436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:56.070057 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:56.070827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:56.071512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:56.072250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:56.259421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:56.268142 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba960c81-2933-4360-81d1-9db31bf8e7a4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.214743 Aug 29 11:59:56.268951 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3633/7299] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:56 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:57.306857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:57.308054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:57.316463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:57.317154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:57.317906 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:57.318862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:57.319485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:57.320025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:57.485882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:57.496030 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e1ce2665-0f29-4b3b-8c74-6bb21cdf89ad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.197130 Aug 29 11:59:57.496865 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3667/7300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:57 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 11:59:58.521165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:58.521902 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:58.524810 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 11:59:58.530848 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:58.531352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:58.531803 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:58.532542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:58.533019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:58.533465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:58.713684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 11:59:58.721918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e4dda87d-b7d3-43e3-9da3-a6e01d2eeb88 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.204818 Aug 29 11:59:58.722536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3634/7301] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:58 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 11:59:59.749783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 11:59:59.751572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 11:59:59.766361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:59.767644 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:59.768882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 11:59:59.770175 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 11:59:59.771226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 11:59:59.772230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:00.012416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:00.025747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83091e88-2c60-4c8c-a7d4-56c46154baf6", "name": "network-vif-plugged", "status": "completed", "tag": "25307eff-cc43-4d22-9121-f5d1b92400ff"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:00.029190 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b8cb1ca3-54ae-4ea2-8e18-33cd4ea8a4b4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.286509 Aug 29 12:00:00.030424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3668/7302] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 11:59:59 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:00.047346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:00.048479 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:00.050060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:00.070393 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] Creating event network-vif-plugged:25307eff-cc43-4d22-9121-f5d1b92400ff for instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 on n-h2-854121-10 Aug 29 12:00:00.077382 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-31687be9-b1cf-4a31-bfd0-72c524496234 req-4de161fa-561e-4b18-b457-10c28e7cdfe0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059312 Aug 29 12:00:00.078551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3635/7303] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:00:01.066566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:01.067362 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:01.074575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:01.075082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:01.075536 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:01.076282 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:01.076756 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:01.077201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:01.241139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:01.248371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:01.252166 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4a356ec9-9436-4e37-9f26-ba144dd32ada tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1391 microversion: 2.1 time: 0.189776 Aug 29 12:00:01.253073 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3669/7304] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:01 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:02.274567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:02.275392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:02.280701 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:02.281434 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:02.290198 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:02.290693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:02.291135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:02.291858 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:02.292323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:02.292748 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:02.517764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:02.527540 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-228443dd-5435-4a38-876c-c7ccaec8ff07 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1563 microversion: 2.1 time: 0.255779 Aug 29 12:00:02.528141 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3636/7305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:02 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:02.549509 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:02.550407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:02.559424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:02.560032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:02.560618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:02.561424 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:02.561999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:02.562493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:02.724262 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:02.733662 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ffe11e7f-56be-4109-9cf6-5234cba4d214 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1563 microversion: 2.1 time: 0.188101 Aug 29 12:00:02.734322 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3670/7306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:02 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:04.725845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83091e88-2c60-4c8c-a7d4-56c46154baf6", "tag": "25307eff-cc43-4d22-9121-f5d1b92400ff"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:04.726944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:04.727555 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:04.732006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:04.742181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:04.742531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:04.743143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:04.743630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:04.743904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:04.744920 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:04.745119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:04.745923 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:04.746717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:04.767293 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] Creating event network-changed:25307eff-cc43-4d22-9121-f5d1b92400ff for instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 on n-h2-854121-10 Aug 29 12:00:04.777544 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-00c08c59-e38b-4a8e-b7a9-5e7636394059 req-c7a17154-97a7-408c-aeea-4adad2825bf6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055743 Aug 29 12:00:04.779013 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3671/7307] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:00:05.541694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:05.555783 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c099f127-697d-44b7-931b-ca4e0cdab0d0 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1563 microversion: 2.1 time: 0.837716 Aug 29 12:00:05.560880 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3637/7308] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:04 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1563 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:00:24.872408 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=34 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:24.878236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:24.881354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:24.888922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:24.889440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:24.889962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:24.890708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:24.891197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:24.891640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:24.948931 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a7436f22-e461-4f94-8862-47d3eb53c328 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action" status: 200 len: 24570 microversion: 2.1 time: 0.078493 Aug 29 12:00:24.949693 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3672/7309] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:00:24 2022] POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 12:00:35.986560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:35.991510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:35.992130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=40 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:35.999806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:36.000312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:36.000757 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:36.028827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Going to try to stop instance {{(pid=128682) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 12:00:36.081284 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-519733e0-8c93-404a-8a10-042215c0452f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action" status: 202 len: 0 microversion: 2.1 time: 0.101483 Aug 29 12:00:36.082058 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3638/7310] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:00:35 2022] POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:00:36.097361 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:36.098883 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:36.106632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:36.107483 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:00:36.115261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:36.116031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:36.116578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:36.118017 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:36.118852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:36.119426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:36.281047 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:36.291105 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8db60f89-7583-4b98-8052-b56dde055736 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.202148 Aug 29 12:00:36.291796 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3673/7311] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:36 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:37.316956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:37.317693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:37.325273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:37.325904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:37.326486 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:37.327356 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:37.327975 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:37.328524 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:37.511908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:37.521012 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-87a25fae-6f05-4496-b415-19a15c4bfbbb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.210266 Aug 29 12:00:37.522307 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3639/7312] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:37 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:38.550169 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:38.550943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:38.561495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:38.562100 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:38.562661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:38.563494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:38.564011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:38.564499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:38.741764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:38.751569 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6ca3067-3258-4f29-84b9-d7aee2d66473 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.205430 Aug 29 12:00:38.752349 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3674/7313] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:38 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:39.774900 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:39.775529 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:39.783561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:39.784053 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:39.784495 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:39.785210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:39.785667 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:39.786128 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:39.941366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:39.950181 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7f4408fe-b6e7-4ae5-8c7b-a0f727537876 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.179353 Aug 29 12:00:39.950776 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3640/7314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:39 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:40.987442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:40.988679 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:40.997389 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:40.998006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:40.998611 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:40.999530 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:41.000158 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:41.000757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:41.160944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:41.172482 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-59acdeec-5036-4e52-a21d-e44e1a8e7b38 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.189564 Aug 29 12:00:41.173261 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3675/7315] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:40 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:42.198180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:42.199151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:42.206926 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:42.207518 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:42.208035 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:42.210402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:42.210928 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:42.211421 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:42.367856 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:42.376308 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb906354-8a3f-4547-9c61-b20411b7a375 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.182548 Aug 29 12:00:42.376922 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3641/7316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:42 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:43.397665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:43.398352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:43.405881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:43.406392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:43.406846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:43.407579 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:43.408048 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:43.408487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:43.571857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:43.580399 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-826794a6-ccde-4f5a-8070-db5522786819 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.186805 Aug 29 12:00:43.581009 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3676/7317] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:43 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:44.604188 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:44.605833 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:44.614041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:44.615168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:44.616088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:44.616517 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:44.616981 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:44.617413 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:44.775098 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:44.783736 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8c30e615-8ad4-4faf-8aff-223832972b3d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.185248 Aug 29 12:00:44.784345 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3642/7318] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:44 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:45.806294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:45.806972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:45.814467 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:45.815293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:45.815791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:45.816562 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:45.817082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:45.818195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:45.993951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:46.008590 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6f40ac39-dbb9-4f20-98b6-8b6c5d2fb6c8 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.206465 Aug 29 12:00:46.009726 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3677/7319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:45 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:00:47.031867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:47.032521 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:47.040690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:47.041180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:47.041623 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:47.042369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:47.042824 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:47.043257 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:47.222823 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:47.232673 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9fb74519-875b-4c6d-a131-74b8697a34e5 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.204721 Aug 29 12:00:47.233218 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3643/7320] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:47 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:00:48.269335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:48.270022 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:48.278353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:48.278903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:48.279448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:48.280182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:48.280664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:48.281112 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:48.440824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:48.450266 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3b900424-5c75-47f3-bcb3-584bce5a4ec3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.184971 Aug 29 12:00:48.450877 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3678/7321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:48 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:49.472418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:49.473168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:49.480735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:49.481225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:49.481670 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:49.482437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:49.482901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:49.483338 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:49.636514 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:49.644804 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9150ccd3-a49f-4fcf-a43c-ae589f4a7406 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.176429 Aug 29 12:00:49.645411 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3644/7322] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:49 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:50.668603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:50.669370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:50.678181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:50.678833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:50.679298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:50.680120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:50.680680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:50.681349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:50.835711 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:50.844977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3aabbf4d-c4ff-4f0c-a859-2f15a0a0bb53 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1692 microversion: 2.1 time: 0.180498 Aug 29 12:00:50.845675 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3679/7323] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:50 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:51.869504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:51.870313 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:51.878032 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:51.878528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:51.878988 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:51.879708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:51.880289 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:51.881329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:52.034871 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:52.043498 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7fad1d48-c541-4f6b-8de9-64965972c533 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1669 microversion: 2.1 time: 0.179706 Aug 29 12:00:52.044112 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3645/7324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:51 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:53.573292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:53.575624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:53.582960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:53.583610 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:53.584162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:53.584999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:53.585480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:53.585955 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:53.646240 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50787274-6765-4e54-afa9-1f3a8dad9df1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action" status: 200 len: 38423 microversion: 2.1 time: 0.076307 Aug 29 12:00:53.647455 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3680/7325] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:00:53 2022] POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action => generated 38423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 12:00:53.660594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:00:53.668708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:53.669202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:53.669955 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:53.698825 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Going to try to start instance {{(pid=128682) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 12:00:53.764038 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2412db35-8157-40ce-98be-ed9d35575c14 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action" status: 202 len: 0 microversion: 2.1 time: 0.108044 Aug 29 12:00:53.764790 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3646/7326] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:00:53 2022] POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 12:00:53.779195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:53.780603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:53.794347 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:53.795261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:53.796099 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:53.797457 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:53.798410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:53.799219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:54.074105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:54.085572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-e0e01f4d-d9c0-4bc5-aa10-27a54d6ec908 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1678 microversion: 2.1 time: 0.314571 Aug 29 12:00:54.086269 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3681/7327] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:53 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:00:55.125113 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:00:55.126307 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:00:55.137446 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:55.138011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:55.138802 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:55.139604 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:00:55.140058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:00:55.140507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:00:55.305115 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:00:55.313954 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c713cb5a-4398-4065-85d6-28ebbd3630e6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1682 microversion: 2.1 time: 0.197059 Aug 29 12:00:55.314574 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3647/7328] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:00:55 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:01:19.530742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:19.533020 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:19.535904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=18 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:19.536999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=52 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:19.538395 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:01:19.538638 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:01:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action (ip 10.222.0.47) !!! Aug 29 12:01:19.549643 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:19.550266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:19.550856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:19.552730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:19.553264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:19.553748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:19.621081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-189f103d-5704-4ca0-ba1a-bc3fab5c1d16 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action" status: 200 len: 62985 microversion: 2.1 time: 0.094319 Aug 29 12:01:19.621838 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3682/7329] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:01:19 2022] POST /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6/action => generated 62985 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 12:01:27.056516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83091e88-2c60-4c8c-a7d4-56c46154baf6", "tag": "25307eff-cc43-4d22-9121-f5d1b92400ff"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:27.057455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:27.058211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:27.060936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=20 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:27.061678 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:27.071865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:27.072716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:27.073621 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:27.074591 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:27.075109 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:27.075570 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:27.078560 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:27.078960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:27.079706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:27.093908 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] Creating event network-changed:25307eff-cc43-4d22-9121-f5d1b92400ff for instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 on n-h2-854121-10 Aug 29 12:01:27.101572 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a7fb9b28-68e5-40c6-b002-81c58cbdb2a8 req-158d1e09-a881-4748-a52f-632aa9dd86dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049124 Aug 29 12:01:27.102629 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3683/7330] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:01:27.120151 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:01:27.233173 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-856555e6-c702-4be0-9d43-77fd459cae4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 204 len: 0 microversion: 2.1 time: 0.186460 Aug 29 12:01:27.235009 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3648/7331] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:01:27 2022] DELETE /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 12:01:27.247580 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:27.248346 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:27.260403 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:27.261449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:27.262651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:27.264079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:27.264962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:27.266078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:27.568463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:27.578320 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-61f7ba21-1e17-44fb-8432-fe64d0fb3317 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1688 microversion: 2.1 time: 0.335105 Aug 29 12:01:27.578971 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3684/7332] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:27 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1688 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:01:28.608751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:28.610242 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:28.623680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:28.624615 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:28.625447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:28.626831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:28.627682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:28.628499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:28.994206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:29.016654 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4a1e1567-7028-4113-83e8-05664914a56d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 200 len: 1688 microversion: 2.1 time: 0.416888 Aug 29 12:01:29.017678 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3649/7333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:28 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 1688 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:29.402905 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83091e88-2c60-4c8c-a7d4-56c46154baf6", "name": "network-vif-deleted", "tag": "25307eff-cc43-4d22-9121-f5d1b92400ff"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:29.415471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:29.415975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:29.416434 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:29.431949 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] Creating event network-vif-deleted:25307eff-cc43-4d22-9121-f5d1b92400ff for instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 on n-h2-854121-10 Aug 29 12:01:29.439607 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-05f86d0d-339c-4cf1-82a4-0c3d7621d6db req-fa0fdf83-efb2-4ed8-a3d3-556e0bb8d5ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040914 Aug 29 12:01:29.440589 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3685/7334] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:01:30.062885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:30.063927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 83091e88-2c60-4c8c-a7d4-56c46154baf6] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:30.080636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:30.081194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:30.081742 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:30.083401 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:30.084207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:30.085062 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:30.107475 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] HTTP exception thrown: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Request method failure captured: Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 HTTP/1.1 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKkLEmdnA0xMF-NdPOv0FhV0FW-2hWnGx89xD61lzT4Ysf9JBvfY2kgJadn6ZJPMOMlC4mWIQSLtjxL0tOUooX_m-7eThhiK-nuxDtKZqmSeVM5ExwnlXdmQaSDXpDzHG1z6VgXcPUf3IF3gYOndLzbo_J5Nh2tHEIr1vuajsgtA9s4 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f10ac2093cdc444cb2f2cdde61f4257e Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '83091e88-2c60-4c8c-a7d4-56c46154baf6'} Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:01:30.109079 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Returning 404 to user: Instance 83091e88-2c60-4c8c-a7d4-56c46154baf6 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fe0a4c28-907d-4c55-8f65-392c5c2c6ce9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6" status: 404 len: 111 microversion: 2.1 time: 0.052287 Aug 29 12:01:30.118543 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3650/7335] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:30 2022] GET /compute/v2.1/servers/83091e88-2c60-4c8c-a7d4-56c46154baf6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 12:01:34.687415 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-884e955d-b630-4149-9ee2-a5d0dac62c7d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '.version_select at 0x7f66b478f430>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:34.721524 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-884e955d-b630-4149-9ee2-a5d0dac62c7d tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1025682781" status: 202 len: 0 microversion: 2.1 time: 0.043999 Aug 29 12:01:34.722359 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3686/7336] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 12:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1025682781 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:01:34.771528 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d20a8bdc-941c-49d0-ad52-2b1f32142e68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: .version_select at 0x7f66c5d65670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1514907076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQtf5ZevJ3P2ajB3BZtM7Ifsit24LyUcM7tehVlEUqluejcH9+CXIiJ17F3WPBl75YLY6V4qJ/+srWqqkuVDLlvkSShVxjvlqcR6a/oNyf9wBWGJpa6v2BUJErpm18gsw=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:34.790202 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d20a8bdc-941c-49d0-ad52-2b1f32142e68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:01:34.797965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-d20a8bdc-941c-49d0-ad52-2b1f32142e68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:01:34.828969 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d20a8bdc-941c-49d0-ad52-2b1f32142e68 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062810 Aug 29 12:01:34.829859 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3651/7337] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 12:01:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:01:43.151956 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=14 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:43.161054 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1508180104", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "networks": [{"uuid": "b8d8e0cc-c920-46a9-a7f1-063f2ee8fcb3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1514907076", "security_groups": [{"name": "tempest-secgroup-smoke-1408728843"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:43.353813 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] validate_networks() for [('b8d8e0cc-c920-46a9-a7f1-063f2ee8fcb3', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 12:01:44.087224 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 12:01:44.088645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 12:01:44.089757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 12:01:44.090621 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 12:01:44.091490 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 12:01:44.108301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:44.108871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:44.109810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:44.110968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:44.111735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:44.112417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:44.136829 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:01:44.143577 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Getting quotas for user f10ac2093cdc444cb2f2cdde61f4257e and project 01616f5d88d0492ea8db6a054207c2af. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:01:44.163105 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 12:01:44.166096 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 12:01:44.248101 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8254270a-226c-4d17-aa7a-981cf641b005 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.099165 Aug 29 12:01:44.249743 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3687/7338] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 12:01:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 12:01:44.262206 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4c350452-8013-4f22-b00e-da137b1546d9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:44.264103 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4c350452-8013-4f22-b00e-da137b1546d9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:44.272024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:44.368866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4c350452-8013-4f22-b00e-da137b1546d9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:44.380894 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4c350452-8013-4f22-b00e-da137b1546d9 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1267 microversion: 2.1 time: 0.122663 Aug 29 12:01:44.381496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3652/7339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:44 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:45.444657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:45.448154 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:45.463500 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:45.464732 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:45.465634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:45.467356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:45.468563 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:45.469638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:45.578384 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:45.591144 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-74c63419-b689-47a8-95c1-2cbcf4f74e47 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1319 microversion: 2.1 time: 0.185376 Aug 29 12:01:45.600184 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3688/7340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:45 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:46.623714 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:46.624953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:46.636792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:46.637465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:46.638208 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:46.639054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:46.640042 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:46.640671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:46.716539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:46.730643 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-af1b88b5-780a-4964-9ac1-7de2ecf93266 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1325 microversion: 2.1 time: 0.117308 Aug 29 12:01:46.740463 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3653/7341] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:46 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:47.756618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:47.757678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:47.767895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:47.768876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:47.770273 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:47.771221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:47.771772 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:47.772620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:47.946845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1", "tag": "2fa634bb-549b-46c9-8a22-b9c3f333eab3"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:47.947919 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:47.959912 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-04e58797-f755-414a-906b-95cf4a0551fa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1393 microversion: 2.1 time: 0.209248 Aug 29 12:01:47.961809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:47.962508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:47.963121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:47.974485 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3689/7342] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:47 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:47.980911 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] Creating event network-changed:2fa634bb-549b-46c9-8a22-b9c3f333eab3 for instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 on n-h2-854121-10 Aug 29 12:01:47.991423 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4bd88bff-4ec3-422b-a138-651f379abea5 req-da2ab0cd-1e2b-4255-bb26-206cb8d4954f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055998 Aug 29 12:01:47.992864 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3654/7343] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:01:48.980988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:48.982561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:48.991284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:48.991792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:48.992241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:48.992998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:48.993478 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:48.993948 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:49.152865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:49.162130 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3299026c-5b95-447c-a24a-01bb19580a4e tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1393 microversion: 2.1 time: 0.185111 Aug 29 12:01:49.162832 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3690/7344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:48 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:50.200130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:50.200901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:50.208649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:50.209156 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:50.209612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:50.210395 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:50.210866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:50.211310 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:50.397498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:50.406278 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-aeb5dbfa-76a0-47d8-8317-80ae49aa991f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1393 microversion: 2.1 time: 0.211507 Aug 29 12:01:50.406907 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3655/7345] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:50 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:51.427423 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:51.428199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:51.430943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:51.436597 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:51.437160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:51.437639 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:51.438449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:51.438933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:51.439650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:51.600393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:51.614879 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-cf0575a6-55f3-441a-b724-c4838dbb9c51 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1393 microversion: 2.1 time: 0.191134 Aug 29 12:01:51.615994 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3691/7346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:51 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:52.488652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1", "name": "network-vif-plugged", "status": "completed", "tag": "2fa634bb-549b-46c9-8a22-b9c3f333eab3"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:52.502898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:52.503457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:52.504499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:52.517271 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] Creating event network-vif-plugged:2fa634bb-549b-46c9-8a22-b9c3f333eab3 for instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 on n-h2-854121-10 Aug 29 12:01:52.523350 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-4fe4867c-1afe-40ae-bccd-48c067721f57 req-5deef3ef-700e-4dc9-b2b2-421d84af34b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038942 Aug 29 12:01:52.524429 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3656/7347] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:01:52.637450 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:52.638447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:52.647658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:52.648309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:52.648968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:52.650056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:52.650818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:52.651364 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:52.811458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:52.820994 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8a37b698-ffc1-46e2-b743-689528848ce7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1393 microversion: 2.1 time: 0.188231 Aug 29 12:01:52.821604 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3692/7348] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:52 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:53.850406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:53.851654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:53.863884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:53.864775 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:53.865572 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:53.866934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:53.867787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:53.868576 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:54.107345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:54.122449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c8bb1da3-2d24-4876-a95c-f037288760d4 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1565 microversion: 2.1 time: 0.282068 Aug 29 12:01:54.123393 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3657/7349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:53 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1565 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:54.151393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:54.152759 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:54.159819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:54.161301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:54.171354 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:54.172659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:54.173487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:54.174855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:54.175869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:54.176699 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:54.360329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:54.370031 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31e75f63-2c1b-4c08-83f2-ec66728d90aa tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1565 microversion: 2.1 time: 0.227928 Aug 29 12:01:54.370654 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3693/7350] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:54 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:01:56.810849 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:01:56.811910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:01:56.814943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1", "tag": "2fa634bb-549b-46c9-8a22-b9c3f333eab3"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:01:56.818609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:01:56.828273 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:56.829263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:56.830253 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:56.832040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:56.833315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:56.834168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:56.838502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:01:56.839823 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:01:56.840592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:01:56.862440 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] Creating event network-changed:2fa634bb-549b-46c9-8a22-b9c3f333eab3 for instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 on n-h2-854121-10 Aug 29 12:01:56.873327 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7de4c56d-0d05-401d-8fad-4150d3d220f6 req-f395211e-7e5a-49c1-a142-63fc6008898f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065424 Aug 29 12:01:56.874479 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3694/7351] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:01:57.053562 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:01:57.066135 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b31f490-1563-4978-abba-20ed63821345 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1565 microversion: 2.1 time: 0.260911 Aug 29 12:01:57.067524 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3658/7352] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:01:56 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:02:17.540609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=7 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:17.541447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=40 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:17.546418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:17.548881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:17.558723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:17.560368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:17.560882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:17.561687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:17.562244 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:17.562728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:17.619518 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-733940a3-cbae-4c31-a5f0-701ee882e3b7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action" status: 200 len: 24574 microversion: 2.1 time: 0.080711 Aug 29 12:02:17.620435 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3695/7353] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:02:17 2022] POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action => generated 24574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 12:02:28.651705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:28.652649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:28.656488 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:28.657746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=28 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:28.669697 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:28.670607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:28.671392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:28.672674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:28.673550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:28.674353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:28.723779 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lazy-loading 'flavor' on Instance uuid 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:02:28.809785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5a675ac5-6bb5-4983-8c42-35b00d1fdfea tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.166701 Aug 29 12:02:28.810457 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3659/7354] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:02:28 2022] POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:02:28.822603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:28.823344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:28.828036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:28.828797 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=4 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:28.835664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:28.836431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:28.837201 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:28.838086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:28.838583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:28.839040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:29.013221 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:29.022374 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4d1256b3-a959-4766-a817-b1e530227000 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1692 microversion: 2.1 time: 0.204204 Aug 29 12:02:29.023301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3696/7355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:28 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:30.052315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:30.053049 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:30.060079 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:30.060648 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:30.061136 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:30.061960 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:30.062429 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:30.062896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:30.221229 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:30.231551 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-038468fa-dce2-49b6-8ce0-27f418f11aad tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1675 microversion: 2.1 time: 0.185789 Aug 29 12:02:30.232164 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3660/7356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:30 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:31.354160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:31.356366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:31.364803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.365323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.365846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.366566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.367046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.367498 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.425872 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-48f6b57a-6f97-42d0-a755-e4889fc5eed7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action" status: 200 len: 38445 microversion: 2.1 time: 0.074809 Aug 29 12:02:31.426774 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3697/7357] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:02:31 2022] POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action => generated 38445 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 12:02:31.445020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:31.445804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:31.453862 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.454371 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.454820 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.455547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.456013 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.456475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.538923 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c69b8248-4cad-45bc-96a0-a616d6389f96 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.098443 Aug 29 12:02:31.539845 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3661/7358] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:02:31 2022] POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:02:31.551352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:31.552481 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:31.560585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.561323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.561600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.562442 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:31.562915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:31.563369 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:31.777266 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:31.786830 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-245374fe-e002-40c4-bc54-9831fee350b3 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1681 microversion: 2.1 time: 0.241458 Aug 29 12:02:31.787442 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3698/7359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:31 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:02:32.810699 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:32.811599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:32.818936 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:32.819504 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:32.820019 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:32.820831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:32.821418 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:32.822046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:32.996148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:33.005272 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9fbbb172-3fdb-4d54-88fc-3fde62c4a771 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1681 microversion: 2.1 time: 0.199791 Aug 29 12:02:33.005986 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3662/7360] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:32 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:34.028453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:34.029197 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:34.037750 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:34.038239 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:34.038695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:34.039443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:34.039917 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:34.040360 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:34.198330 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:34.207656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a29e11fb-0de4-4f8d-abfe-495278c5b597 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1684 microversion: 2.1 time: 0.183418 Aug 29 12:02:34.208424 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3699/7361] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:34 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:34.310612 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:34.313041 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:34.322361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:34.322859 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:34.323303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:34.324020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:34.324476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:34.324907 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:34.373640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f54e43a7-62ad-4843-9c3e-6eda209636e7 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action" status: 200 len: 38445 microversion: 2.1 time: 0.066759 Aug 29 12:02:34.374371 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3663/7362] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:02:34 2022] POST /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1/action => generated 38445 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 12:02:35.515587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:35.516612 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:35.520605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1", "tag": "2fa634bb-549b-46c9-8a22-b9c3f333eab3"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:35.527551 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:35.528334 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:35.528933 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:35.529918 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:35.530576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:35.531356 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:35.534301 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:35.534831 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:35.535531 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:35.548309 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] Creating event network-changed:2fa634bb-549b-46c9-8a22-b9c3f333eab3 for instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 on n-h2-854121-10 Aug 29 12:02:35.554224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1be81d5f-0154-44af-aee0-4da0dad630d9 req-e7dd0f64-366e-4bd4-9ada-1710e6e74c41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043912 Aug 29 12:02:35.555655 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3664/7363] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:02:35.576407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:02:35.705289 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b34ad04c-bdbe-4485-a7dd-6f3f47f6d5c1 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 204 len: 0 microversion: 2.1 time: 0.196978 Aug 29 12:02:35.707265 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3700/7364] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:02:35 2022] DELETE /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 12:02:35.722402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:35.724169 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:35.737750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:35.739240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:35.740192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:35.743093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:35.743093 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:35.744044 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:35.934565 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:35.951378 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d54c651a-a80f-435b-b680-c556729ce6a6 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1690 microversion: 2.1 time: 0.237180 Aug 29 12:02:35.952208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3665/7365] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:35 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:36.979104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:36.979104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:36.991293 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:36.992436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:36.992561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:36.993685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:36.994373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:36.994865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:37.190426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:37.200499 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a6f0c033-59ca-4623-84a4-546d73463c89 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1690 microversion: 2.1 time: 0.227507 Aug 29 12:02:37.201147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3701/7366] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:36 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1690 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:37.800723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1", "name": "network-vif-deleted", "tag": "2fa634bb-549b-46c9-8a22-b9c3f333eab3"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:37.816168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:37.817135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:37.817866 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:37.831921 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] Creating event network-vif-deleted:2fa634bb-549b-46c9-8a22-b9c3f333eab3 for instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 on n-h2-854121-10 Aug 29 12:02:37.837511 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-ff92cdec-40a1-48b4-88c0-bff660cd532a req-c1b83acf-6903-4f56-ae70-c37d83605edd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044308 Aug 29 12:02:37.838185 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3666/7367] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:02:38.236121 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:38.237826 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:38.247550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:38.248328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:38.248869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:38.250061 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:38.250708 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:38.251388 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:38.316862 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:38.317775 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:38.318600 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:38.319477 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lazy-loading 'fault' on Instance uuid 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:02:38.392986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f10ac2093cdc444cb2f2cdde61f4257e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01616f5d88d0492ea8db6a054207c2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:02:38.402782 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6182f3ae-d7a1-4da5-99f7-bf0645d4f1fb tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 200 len: 1357 microversion: 2.1 time: 0.182084 Aug 29 12:02:38.403535 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3702/7368] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:38 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:02:39.431781 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:39.433173 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] [instance: 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:02:39.440827 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:39.441369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:39.441947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:39.442711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:02:39.443211 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:02:39.443770 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:02:39.459375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] HTTP exception thrown: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Request method failure captured: Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 HTTP/1.1 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKkLEmdnA0xMF-NdPOv0FhV0FW-2hWnGx89xD61lzT4Ysf9JBvfY2kgJadn6ZJPMOMlC4mWIQSLtjxL0tOUooX_m-7eThhiK-nuxDtKZqmSeVM5ExwnlXdmQaSDXpDzHG1z6VgXcPUf3IF3gYOndLzbo_J5Nh2tHEIr1vuajsgtA9s4 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01616f5d88d0492ea8db6a054207c2af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 01616f5d88d0492ea8db6a054207c2af Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1344960160 Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: f10ac2093cdc444cb2f2cdde61f4257e Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1344960160-project Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1'} Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:02:39.461060 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Returning 404 to user: Instance 7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-599e5315-611b-47dd-9ade-7fa1b8cffbb2 tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1" status: 404 len: 111 microversion: 2.1 time: 0.035065 Aug 29 12:02:39.465585 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3667/7369] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:02:39 2022] GET /compute/v2.1/servers/7fc9d94d-b7ed-4e4e-b03c-53d078fd6ce1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 12:02:43.656805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31f47136-8e38-4072-b32b-7d1c83e1d92f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] Calling method '.version_select at 0x7f66c5ad5820>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:02:43.688136 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31f47136-8e38-4072-b32b-7d1c83e1d92f tempest-TestNetworkAdvancedServerOps-1344960160 tempest-TestNetworkAdvancedServerOps-1344960160-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1514907076" status: 202 len: 0 microversion: 2.1 time: 0.034867 Aug 29 12:02:43.700938 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3703/7370] 10.222.0.47 () {58 vars in 1284 bytes} [Mon Aug 29 12:02:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1514907076 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:02:58.446139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=18 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:58.447008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:02:58.656526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4b97aa74-1a0f-4d0a-8bdd-f9f3b31580e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'create', calling method: .version_select at 0x7f66c5c93160>, body: {"keypair": {"name": "tempest-TestShelveInstance-532646966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAtnwblXRd1r84q8CXgQPOkNNGYx48qfR9X7JHBJ6iOIYDF+v9z4PM7f6qPnRB8iXZQ74/d+tRiwPhVEjCCnOs2vDA0s5Q2H2l0BOqzdJxL79FDyFpT7Jkk685jCHq84A=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:02:58.676353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4b97aa74-1a0f-4d0a-8bdd-f9f3b31580e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for project 41eb65664b334ab79bce9d19399cd652. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:02:58.683644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-4b97aa74-1a0f-4d0a-8bdd-f9f3b31580e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for user 510b5ef6aef04249947654314ba6852b and project 41eb65664b334ab79bce9d19399cd652. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:02:58.718375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4b97aa74-1a0f-4d0a-8bdd-f9f3b31580e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.279542 Aug 29 12:02:58.725629 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3668/7371] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 12:02:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:03:00.240736 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:03:00.241658 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:03:00.247335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-557694617", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-532646966", "security_groups": [{"name": "tempest-secgroup-smoke-469467968"}], "networks": [{"uuid": "62ce6012-ea08-4950-b887-74641148a75e"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:03:00.412778 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] validate_networks() for [('62ce6012-ea08-4950-b887-74641148a75e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 12:03:00.916564 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 12:03:00.917011 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 12:03:00.917511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 12:03:00.918002 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 12:03:00.918440 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 12:03:00.929851 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:00.930365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:00.930821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:00.931576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:00.932055 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:00.932499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:00.956009 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for project 41eb65664b334ab79bce9d19399cd652. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:03:00.963090 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for user 510b5ef6aef04249947654314ba6852b and project 41eb65664b334ab79bce9d19399cd652. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:03:00.981104 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 12:03:00.983841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 12:03:01.039794 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2dcc0f63-579b-4305-81cd-3464365697a5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800901 Aug 29 12:03:01.040648 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3704/7372] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 12:03:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 12:03:01.053148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5366b617-2233-4acd-893f-0254e90bdb40 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:01.053868 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5366b617-2233-4acd-893f-0254e90bdb40 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:01.148443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5366b617-2233-4acd-893f-0254e90bdb40 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:01.157589 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5366b617-2233-4acd-893f-0254e90bdb40 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1245 microversion: 2.1 time: 0.109207 Aug 29 12:03:01.158971 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3669/7373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:01 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:02.182080 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:02.182727 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:02.192522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:02.193110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:02.193680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:02.194485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:02.194963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:02.195437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:02.275149 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:02.290960 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5b07f74a-e6cd-4944-9f54-869c9c654875 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1297 microversion: 2.1 time: 0.113823 Aug 29 12:03:02.292085 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3705/7374] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:02 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1297 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:03.344170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:03.346162 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:03.358221 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:03.359485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:03.360414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:03.366852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:03.367934 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:03.368762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:03.774312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:03.784358 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e998e3f-0c96-44bf-a3c3-39a3031e96de tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.454139 Aug 29 12:03:03.784959 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3670/7375] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:03 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:04.689393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:03:04.707698 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:04.708667 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:04.709553 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:04.728521 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] Creating event network-changed:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:03:04.735453 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-8c67db38-3e80-47a0-8f89-7e8f7b0fd361 req-675a3aad-efc2-4314-b665-34f2fd8236cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050946 Aug 29 12:03:04.737649 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3706/7376] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:03:04.805806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:04.806497 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:04.814129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:04.815125 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:04.815567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:04.816284 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:04.816734 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:04.817157 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:05.092767 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:05.110563 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-bf5a0e48-11aa-4a09-b18b-5b9cf0f1bde5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.308750 Aug 29 12:03:05.125638 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3671/7377] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:04 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:06.147549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:06.148447 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:06.155229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:06.155748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:06.156208 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:06.156944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:06.157425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:06.157911 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:06.436844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:06.449788 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dff4f3f0-2840-4690-b593-11be30eb2ce5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.306938 Aug 29 12:03:06.450915 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3707/7378] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:06 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:07.473008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:07.473633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:07.476906 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:03:07.477086 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca (ip 10.222.0.47) !!! Aug 29 12:03:07.484235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:07.484727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:07.485170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:07.485916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:07.486916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:07.487691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:07.655015 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:07.665056 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a567fbbd-9d4a-4093-b8a9-914a831a4b61 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.196619 Aug 29 12:03:07.666060 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3672/7379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:07 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:08.691383 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:08.692561 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:08.703601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:08.704226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:08.704921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:08.706340 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:08.706901 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:08.707430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:08.847674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "name": "network-vif-plugged", "status": "completed", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:03:08.868940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:08.870002 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:08.871818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:08.899235 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] Creating event network-vif-plugged:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:03:08.901632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:08.905192 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3053500e-d8fe-41d2-a9b0-ec32169143d4 req-c953f597-78b9-4d84-a888-4f48cd900554 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061752 Aug 29 12:03:08.905838 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3673/7380] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:03:08.919968 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0601a588-2903-475c-bfc2-c91df8cd2fa8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.234831 Aug 29 12:03:08.921082 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3708/7381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:08 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:09.944536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:09.945235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:09.952047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:09.952534 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:09.952969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:09.953676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:09.954161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:09.954597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:10.148755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:10.159359 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6794b3f5-6286-469a-8281-4424862ad473 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1370 microversion: 2.1 time: 0.219754 Aug 29 12:03:10.160333 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3674/7382] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:09 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:11.181204 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:11.181872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:11.184892 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:03:11.185623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:03:11.192666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:11.193182 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:11.193674 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:11.194618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:11.195111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:11.195861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:11.346655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:11.355774 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f5a5551d-fb9b-42e6-b071-0e9377abbdce tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1554 microversion: 2.1 time: 0.178597 Aug 29 12:03:11.356390 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3709/7383] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:11 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:11.378135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:03:11.379022 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:03:11.381969 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:03:11.388325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:11.388839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:11.389277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:11.390046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:11.390510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:11.390941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:11.556526 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:03:11.566449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-db3c5f8b-aef9-4176-b266-152bdec1e61a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1554 microversion: 2.1 time: 0.193013 Aug 29 12:03:11.567068 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3675/7384] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:03:11 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:03:13.465433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:03:13.485791 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:03:13.487185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:03:13.488214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:03:13.502703 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] Creating event network-changed:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:03:13.509923 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-53959cff-a36d-4e48-b758-fb1b0463ba6c req-b8d5318a-15f4-4ff1-9e30-d42467fa4ca3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051743 Aug 29 12:03:13.511047 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3710/7385] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:05:08.003285 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 12:05:08.004672 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 12:05:08.005321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:08.006442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=32 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:08.007696 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 12:05:08.013430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:05:08.014088 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:08.025058 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:08.025611 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:08.026133 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:08.027020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:08.027530 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:08.027997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:08.054762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lazy-loading 'flavor' on Instance uuid a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:05:08.489243 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ef930b8-7572-4410-b81b-8f5e999ca8ee tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca/action" status: 202 len: 0 microversion: 2.1 time: 0.487665 Aug 29 12:05:08.489976 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3676/7386] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:05:08 2022] POST /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:05:08.499943 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 12:05:08.503651 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 12:05:08.505131 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:08.506382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=30 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:08.508143 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:05:08.508337 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:05:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca (ip 10.222.0.47) !!! Aug 29 12:05:08.524960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:08.526016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:08.536890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:08.537908 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:08.538458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:08.539312 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:08.539921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:08.540461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:08.777426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:08.787000 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3928f3d6-c034-4499-85e5-17ce7dcdad63 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.290876 Aug 29 12:05:08.787835 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3711/7387] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:08 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:09.824350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:09.825083 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:09.836737 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:09.837237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:09.837692 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:09.838455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:09.838916 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:09.839380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:09.846741 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42058. Aug 29 12:05:09.850245 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42060. Aug 29 12:05:10.054815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:10.064586 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9e69ecd-1fe6-4e79-90b8-3f5e6121ab0d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.249567 Aug 29 12:05:10.065594 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3677/7388] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:09 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:11.087994 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:11.088681 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:11.109136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:11.110032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:11.110824 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:11.112110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:11.112962 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:11.113845 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:11.122953 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42064. Aug 29 12:05:11.124925 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42066. Aug 29 12:05:11.285630 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:11.294359 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7751c9bc-a43e-443c-be39-4e21034dbefa tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.210260 Aug 29 12:05:11.294969 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3712/7389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:11 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:12.317318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:12.317915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:12.325180 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:12.325865 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:12.326407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:12.327806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:12.328352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:12.328711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:12.482451 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:12.491912 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8fdb1e76-faa8-417e-b80a-876b43a21f9d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.178885 Aug 29 12:05:12.492916 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3678/7390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:12 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:13.516558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:13.517351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:13.525659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:13.526240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:13.526857 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:13.527607 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:13.528113 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:13.528569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:13.691492 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:13.700977 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d1ca8e93-df4e-44f8-8cb8-70bbb7819710 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.189976 Aug 29 12:05:13.701772 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3713/7391] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:13 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:14.737560 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:14.738239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:14.745999 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:14.746463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:14.746904 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:14.747630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:14.748084 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:14.749447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:14.916561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:14.926814 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e39db52d-dea1-4863-936c-590970dc5771 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.193852 Aug 29 12:05:14.927516 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3679/7392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:14 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:15.950585 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:15.951365 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:15.960033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:15.960546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:15.961006 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:15.961815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:15.962358 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:15.962865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:16.123188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:16.133956 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dbf4aec1-c13b-464d-82ae-f2295aa134e5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.187452 Aug 29 12:05:16.134688 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3714/7393] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:15 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:17.158631 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:17.159351 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:17.167225 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:17.167867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:17.168318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:17.169043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:17.169508 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:17.169965 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:17.323740 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:17.339166 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5db211c0-bce9-4be5-8154-cb4e4752f130 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.185835 Aug 29 12:05:17.339998 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3680/7394] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:17 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:18.363304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:18.364217 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:18.371792 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:18.372299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:18.372764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:18.374193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:18.375351 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:18.375809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:18.541518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:18.551950 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-50395ed7-f6be-43d5-bd3e-7bc1fe3b7640 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.193694 Aug 29 12:05:18.552897 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3715/7395] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:18 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:19.576167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:19.577684 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:19.585210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:19.585885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:19.586380 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:19.587168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:19.587671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:19.588140 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:19.744616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:19.754341 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-fc56333e-b735-4501-8bde-e6dd04eea606 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1699 microversion: 2.1 time: 0.182458 Aug 29 12:05:19.755024 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3681/7396] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:19 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:20.780941 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:20.782044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:20.789856 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:20.790371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:20.790834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:20.791594 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:20.792071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:20.792515 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:21.035139 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:21.050688 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0445045e-720b-40f3-ac44-96aee40d3226 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.273977 Aug 29 12:05:21.051605 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3716/7397] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:20 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:22.083475 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:22.084642 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:22.100838 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:22.101674 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:22.102459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:22.103603 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:22.104092 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:22.104607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:22.322761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:22.332260 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9014948-579d-43a3-a98d-4e4506752605 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.255981 Aug 29 12:05:22.333155 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3682/7398] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:22 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:23.357445 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:23.359214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:23.401581 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:23.404076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:23.406566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:23.407777 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:23.415021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:23.418294 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:23.533533 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "name": "network-vif-plugged", "status": "completed", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:05:23.566258 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:23.572385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:23.575052 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:23.589161 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] Creating event network-vif-plugged:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:05:23.596048 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3d970c16-b6fb-421b-8331-046e339c0f62 req-7e9b058b-1677-4452-81bf-28d0b190aa19 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231598 Aug 29 12:05:23.597351 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3683/7399] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:05:23.904246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:23.923931 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58c95edf-863d-4f8b-8275-7ad456f1f08d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.570143 Aug 29 12:05:23.925184 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3717/7400] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:23 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:24.962277 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:24.964620 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:24.985437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:24.987804 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:24.988654 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:24.990077 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:24.990944 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:24.991712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:25.277821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:25.293887 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5b56ca70-6452-4d69-b516-af21cbf007e2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.339480 Aug 29 12:05:25.297363 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3684/7401] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:24 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:26.335196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:26.337602 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:26.350461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:26.351406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:26.352485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:26.353558 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:26.354222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:26.354921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:26.556769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:26.574336 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-49a3c0ae-c814-408e-b5f4-408ad4cead49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.249786 Aug 29 12:05:26.575541 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3718/7402] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:26 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:27.606749 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:27.607464 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:27.617406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:27.618193 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:27.618864 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:27.619915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:27.620746 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:27.621192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:27.841873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:27.858124 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2f5a4ef9-c0c9-4a28-9879-95e6b17db290 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.255145 Aug 29 12:05:27.859278 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3685/7403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:27 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:28.890185 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:28.893654 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:28.911882 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:28.913128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:28.914115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:28.915738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:28.916840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:28.918053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:29.148685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:29.169025 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d68b4e4a-b731-49b2-9ee8-02918ab8a0bb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.286589 Aug 29 12:05:29.184147 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3719/7404] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:28 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:30.201047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:30.204119 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:30.218717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:30.220234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:30.221739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:30.223696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:30.224873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:30.225891 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:30.475946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:30.493992 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eb39b72f-6a02-4132-a3c0-0b4ee56f1094 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.300621 Aug 29 12:05:30.494597 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3686/7405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:30 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:31.532474 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:31.534068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:31.543068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:31.544026 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:31.544758 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:31.546583 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:31.547452 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:31.548473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:31.789323 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:31.804090 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-acbb6323-0946-4943-9fa1-0fa9e5c754f7 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1694 microversion: 2.1 time: 0.276231 Aug 29 12:05:31.818365 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3720/7406] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:31 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1694 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:32.840910 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:32.842203 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:32.849997 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:32.850773 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:32.851333 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:32.852145 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:32.852712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:32.853239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:33.106501 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:33.117558 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c5ef5222-96f1-48be-9b29-cd7a84f484f9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1676 microversion: 2.1 time: 0.283987 Aug 29 12:05:33.118336 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3687/7407] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:32 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1676 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:34.152827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:34.153566 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:34.161853 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:34.162378 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:34.162843 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:34.163601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:34.164079 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:34.164527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:34.352605 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:34.361430 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3e0b4956-b7ef-4336-b14d-51ec478acbf3 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1676 microversion: 2.1 time: 0.212572 Aug 29 12:05:34.362080 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3721/7408] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:34 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:35.384319 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:35.385275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:35.393903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:35.394436 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:35.394985 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:35.396190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:35.396190 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:35.396708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:35.591080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:35.601320 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b2804572-b106-49d7-bf5b-6db1d73a02a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1619 microversion: 2.1 time: 0.221647 Aug 29 12:05:35.602100 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3688/7409] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:35 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1619 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:35.628930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:05:35.630064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:35.642970 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:35.643870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:35.644655 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:35.645846 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:35.646739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:35.647485 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:35.785454 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128681) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 12:05:35.876836 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [6920e7b3-7a54-41cb-860b-883bfc6bc14c] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:05:36.887104 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [6920e7b3-7a54-41cb-860b-883bfc6bc14c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42168. Aug 29 12:05:36.892497 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1937fe70-d1b5-41c6-9ecb-d20038c2bb36 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca/action" status: 202 len: 0 microversion: 2.1 time: 1.271735 Aug 29 12:05:36.893235 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3722/7410] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:05:35 2022] POST /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca/action => generated 0 bytes in 1274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:05:36.907014 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:36.908183 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:36.921484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:36.922460 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:36.922980 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:36.924153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:36.924976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:36.925607 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:37.140217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:37.149552 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8bd2ba76-ca97-42f5-a081-179567c1e670 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1627 microversion: 2.1 time: 0.251019 Aug 29 12:05:37.150259 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3689/7411] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:36 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1627 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:37.299471 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "name": "network-vif-unplugged", "status": "completed", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:05:37.326839 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:37.327730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:37.328809 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:37.352680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.compute.server_external_events [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] Unable to find a host for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca. Dropping event network-vif-unplugged {{(pid=128681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 12:05:37.354543 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-3ff26756-df2a-47ed-bd36-9631b151f63f req-cd13eecc-cbeb-4eb2-8671-04dfd22fb034 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063820 Aug 29 12:05:37.355698 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3723/7412] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 12:05:38.182012 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:38.184040 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:38.188821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=29 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:38.196716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:38.197194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:38.197818 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:38.198630 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:38.199224 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:38.199747 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:38.204711 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:38.415286 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:38.430478 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2eb8881-8f1e-4131-b882-8d58a4c3d199 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1627 microversion: 2.1 time: 0.253357 Aug 29 12:05:38.431130 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3690/7413] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:38 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1627 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:39.468046 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:39.468887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:39.471522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:39.477234 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:39.477841 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:39.478306 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:39.479037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:39.479518 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:39.480106 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:39.486724 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:05:40.167575 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:40.184810 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-aea79be1-92ab-4382-aa31-cb9536268c8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.720698 Aug 29 12:05:40.188507 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3724/7414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:39 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:41.224602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:41.225240 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:41.233090 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:41.234100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:41.234569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:41.235325 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:41.235798 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:41.236236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:41.438210 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:41.450793 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e55e9079-5b93-48b9-ba89-ebca1fb5a0c5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.229844 Aug 29 12:05:41.464618 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3691/7415] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:41 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:42.477031 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:42.477746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:42.486111 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:42.486690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:42.487216 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:42.488008 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:42.488700 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:42.489280 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:42.713455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:42.728560 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-251470e7-cc98-4094-be94-84d58420f7db tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.255032 Aug 29 12:05:42.740120 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3725/7416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:42 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:43.773633 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:43.774755 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:43.791070 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:43.793481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:43.794571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:43.796201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:43.797176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:43.798085 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:44.081507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:44.103763 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-30118835-dbce-4de5-ab84-ed6f99ec6c51 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.337975 Aug 29 12:05:44.104737 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3692/7417] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:43 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:45.144894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:45.149160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:45.177571 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:45.179230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:45.180411 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:45.182292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:45.183754 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:45.184925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:45.448532 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:45.459439 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd427b87-df73-4483-8604-5720f194e373 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.323307 Aug 29 12:05:45.460544 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3726/7418] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:45 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:46.495005 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:46.495961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:46.506104 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:46.506590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:46.507047 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:46.507787 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:46.508250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:46.508716 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:46.674390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:46.691525 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e541d8dc-a39a-406b-83b2-ffe386b6c898 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.200932 Aug 29 12:05:46.692735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3693/7419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:46 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:47.730656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:47.732281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:47.746126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:47.747576 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:47.750101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:47.751861 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:47.753136 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:47.754301 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:47.957257 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:47.973819 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-77615c79-7be4-48b5-8f60-812d23392539 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.247582 Aug 29 12:05:47.974659 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3727/7420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:47 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:48.997108 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:48.999671 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:49.007411 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:49.007915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:49.008364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:49.009122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:49.009587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:49.010060 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:49.169949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:49.181151 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c33d39a7-754b-45d8-b0c3-b06fb3bac63f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.188253 Aug 29 12:05:49.181800 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3694/7421] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:48 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:50.206390 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:50.207114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:50.215506 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:50.216016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:50.216984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:50.218214 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:50.218774 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:50.219237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:50.387432 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:50.398247 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-bedaab59-f284-45de-bafd-d460ce0026e4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.197006 Aug 29 12:05:50.399135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3728/7422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:50 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:51.422217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:51.422852 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:51.431100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:51.431601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:51.432048 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:51.432812 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:51.433252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:51.433686 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:51.649219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:51.664168 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-43ac397d-52d8-4435-ab20-f6841a7d5306 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.246543 Aug 29 12:05:51.665208 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3695/7423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:51 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:52.693344 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:52.694120 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:52.701640 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:52.702194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:52.702659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:52.703418 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:52.703898 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:52.704345 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:52.866381 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:52.875512 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8f12ad39-2e9a-4afa-932b-62cc0431da45 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.186379 Aug 29 12:05:52.876127 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3729/7424] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:52 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:05:53.412964 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "name": "network-vif-plugged", "status": "completed", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:05:53.431237 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:53.432185 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:53.432726 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:53.457978 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] Creating event network-vif-plugged:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:05:53.464625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1ca6062f-0189-4978-92ba-69ff8c0b9ed1 req-b0a53ed3-1829-495a-9e1b-e8f19575ce2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056188 Aug 29 12:05:53.465901 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3696/7425] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:05:53.898818 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:53.899710 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:53.907632 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:53.908172 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:53.908618 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:53.909417 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:53.909943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:53.910397 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:54.078162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:54.087081 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9ccd798f-c2cb-4a58-ba1d-407f1dfc7455 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.192258 Aug 29 12:05:54.087632 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3730/7426] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:53 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:55.114097 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:55.115260 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:55.125586 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:55.126235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:55.126805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:55.127762 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:55.128305 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:55.128905 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:55.319438 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:55.328437 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b9d35392-6899-480d-9622-d3e86f005a87 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1685 microversion: 2.1 time: 0.223059 Aug 29 12:05:55.329232 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3697/7427] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:55 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1685 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:05:56.353101 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:05:56.353742 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:05:56.361508 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:56.362051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:56.362511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:56.363251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:05:56.363730 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:05:56.364179 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:05:56.540661 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:05:56.550749 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-0a6ece5e-166d-465f-bfc1-2aab5d5a77d6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1672 microversion: 2.1 time: 0.203211 Aug 29 12:05:56.551359 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3731/7428] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:05:56 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:08.640878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=15 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:08.644676 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=15 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:08.645735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=43 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:08.647355 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:07:08.647567 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca (ip 10.222.0.47) !!! Aug 29 12:07:08.649945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=47 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:08.651220 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:07:08.651426 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 29 12:07:08.666507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:08.667165 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:08.686750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:08.687511 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:08.688122 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:08.689353 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:08.691914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:08.692158 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:08.757288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:07:08.804998 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:08.845220 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:08.846707 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:08.848155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:08.874287 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] Creating event network-changed:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:07:08.884443 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-bb789ccf-e694-43d2-86cd-f8c6ebd799bf req-3b527954-5cf1-40eb-ae69-31b9634a37b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245287 Aug 29 12:07:08.887238 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3732/7429] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:07:08.922374 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-9b298adb-7229-46db-9160-53a6f2c7da4c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 204 len: 0 microversion: 2.1 time: 0.287353 Aug 29 12:07:08.923298 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3698/7430] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:07:08 2022] DELETE /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 12:07:08.934133 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:08.934953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:08.942219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:08.942738 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:08.943199 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:08.943949 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:08.944522 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:08.944972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:09.148328 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:09.158334 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-935bc3d0-7f1b-42d5-a743-024c2c069e86 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.229182 Aug 29 12:07:09.159082 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3733/7431] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:08 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:10.197387 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:10.198500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:10.211095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:10.212127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:10.212922 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:10.214124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:10.216579 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:10.217296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:10.602466 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:10.615127 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c27707b4-15f5-403c-a664-20fd14f20b64 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 200 len: 1678 microversion: 2.1 time: 0.425120 Aug 29 12:07:10.630034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3699/7432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:10 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:10.920078 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca", "name": "network-vif-deleted", "tag": "e3fdcbc7-8b43-447b-b19b-a534f3618c9b"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:10.930604 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:10.931117 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:10.931768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:10.945430 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] Creating event network-vif-deleted:e3fdcbc7-8b43-447b-b19b-a534f3618c9b for instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca on n-h2-854121-10 Aug 29 12:07:10.952373 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-2439dc23-4965-4031-8bd6-e27a59dbe66c req-bea688ba-b592-43e2-873e-4fe6e3e9a067 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107650 Aug 29 12:07:10.953366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3734/7433] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:07:11.638763 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:11.639385 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:11.647998 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:11.648499 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:11.648951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:11.649693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:11.650196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:11.650634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:11.666517 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] HTTP exception thrown: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Request method failure captured: Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca HTTP/1.1 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKrrZ0Kt92I52MVFF-HM9xUnEjHZMYsVeJ-Rna7BiQfIGtK32VlseCTHJGZ0jwxGNgsdP6Nhhaw_N6ou9yUEnGt-hPggHq4rpQn7VHE0QThF1K6IO2-lPRRDCz1jjCK4Mpjv6KsuQ5ca0xg72KiUF2qbjriQGAGz1kuSYb1xVrPA-ds Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 41eb65664b334ab79bce9d19399cd652 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestShelveInstance-1051849752 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41eb65664b334ab79bce9d19399cd652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestShelveInstance-1051849752 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 41eb65664b334ab79bce9d19399cd652 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestShelveInstance-1051849752 Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestShelveInstance-1051849752-project Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 510b5ef6aef04249947654314ba6852b Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestShelveInstance-1051849752-project Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': 'a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca'} Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:07:11.668569 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Returning 404 to user: Instance a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0ed0ff5a-a272-4b1d-9259-a3330fbf7467 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca" status: 404 len: 111 microversion: 2.1 time: 0.037503 Aug 29 12:07:11.674282 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3700/7434] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:11 2022] GET /compute/v2.1/servers/a2aaf782-2f5a-4fb5-8e97-8d7e4b4992ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 12:07:11.898392 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-072edf63-7fb0-49fb-a45e-651a44c2b520 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '.version_select at 0x7f66b4764790>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:11.933145 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-072edf63-7fb0-49fb-a45e-651a44c2b520 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-532646966" status: 202 len: 0 microversion: 2.1 time: 0.048281 Aug 29 12:07:11.937591 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3735/7435] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 29 12:07:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-532646966 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:07:11.960715 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-957d9ac5-c217-4a36-8c76-52d1649739be tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'create', calling method: .version_select at 0x7f66c670b310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1853703118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+1ckwGHSOlRzMUsaHYhPm83Yx/7qQX8xKm03tdt8cIH9MQCoFmXGjWWV8G288WtJnRuQyOxl9elFbgxQ63q/G42NRkKFHdM3v8uPkXA456QEjAyU8i1WbJkKivemp4zA=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:11.981571 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-957d9ac5-c217-4a36-8c76-52d1649739be tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for project 41eb65664b334ab79bce9d19399cd652. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:07:11.991688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-957d9ac5-c217-4a36-8c76-52d1649739be tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for user 510b5ef6aef04249947654314ba6852b and project 41eb65664b334ab79bce9d19399cd652. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:07:12.029588 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-957d9ac5-c217-4a36-8c76-52d1649739be tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072929 Aug 29 12:07:12.030467 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3701/7436] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 12:07:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:07:32.120873 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=10 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:32.122250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:32.127620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-185050080", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1853703118", "security_groups": [{"name": "tempest-secgroup-smoke-117525313"}], "networks": [{"uuid": "62ce6012-ea08-4950-b887-74641148a75e"}], "block_device_mapping_v2": [{"uuid": "fadf07dc-b8a7-47b0-a8d7-f910bd884a99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:32.269042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] validate_networks() for [('62ce6012-ea08-4950-b887-74641148a75e', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 12:07:32.774547 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 12:07:32.774999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 12:07:32.775491 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 12:07:32.775922 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 12:07:32.776382 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 12:07:32.791716 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:32.792805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:32.793142 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:32.795416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:32.795416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:32.795416 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:32.818849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for project 41eb65664b334ab79bce9d19399cd652. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:07:32.826263 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Getting quotas for user 510b5ef6aef04249947654314ba6852b and project 41eb65664b334ab79bce9d19399cd652. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:07:32.906261 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 12:07:32.909071 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fadf07dc-b8a7-47b0-a8d7-f910bd884a99',volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 12:07:33.134573 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6bd0dccd-88b3-400e-a03f-be272b0a65b2 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.015469 Aug 29 12:07:33.136124 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3736/7437] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 12:07:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 12:07:33.155101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-44abf2c3-6f29-4080-a6f5-7be3a8bdfe68 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:33.159329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-44abf2c3-6f29-4080-a6f5-7be3a8bdfe68 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:33.164696 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:33.166440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=4 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:33.167459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:33.267725 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-44abf2c3-6f29-4080-a6f5-7be3a8bdfe68 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:33.279799 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-44abf2c3-6f29-4080-a6f5-7be3a8bdfe68 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1088 microversion: 2.1 time: 0.134421 Aug 29 12:07:33.281100 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3702/7438] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:33 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1088 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:34.308951 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:34.309573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:34.317249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:34.318068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:34.318449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:34.319246 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:34.319869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:34.320401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:34.414152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:34.429896 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7d7359d0-49bb-4393-abcf-72d3c16dce73 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1194 microversion: 2.1 time: 0.125671 Aug 29 12:07:34.431366 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3737/7439] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:34 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:35.459665 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:35.461361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:35.470419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:35.471564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:35.472192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:35.473130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:35.473806 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:35.474432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:35.677433 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:35.699899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-29d03363-1872-452f-954b-6822f35bb957 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1271 microversion: 2.1 time: 0.244244 Aug 29 12:07:35.701319 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3703/7440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:35 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:36.368141 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:36.418073 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:36.419082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:36.420159 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:36.442878 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] Creating event network-changed:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h2-854121-10 Aug 29 12:07:36.448953 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f3527a43-3a49-4623-9471-e98318fe4605 req-8e0affb8-e04b-45a6-b752-49d91da0429e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090040 Aug 29 12:07:36.450111 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3738/7441] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:07:36.742875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:36.744312 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:36.758541 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:36.761350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:36.762532 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:36.763870 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:36.764735 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:36.765516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:37.005723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:37.020542 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-297fc96f-9d35-4712-9b21-c2479f7f107f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1271 microversion: 2.1 time: 0.285630 Aug 29 12:07:37.022034 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3704/7442] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:36 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1271 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:38.048241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:38.049459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:38.059695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:38.060482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:38.061110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:38.062349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:38.062938 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:38.063556 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:38.265448 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:38.282296 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-160c0fff-479e-48d2-888e-57f70aa6cdbe tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1271 microversion: 2.1 time: 0.239739 Aug 29 12:07:38.283395 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3739/7443] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:38 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:39.305946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:39.306751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:39.314694 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:39.315191 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:39.315644 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:39.316440 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:39.316908 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:39.317341 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:39.507940 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:39.518647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3aa6591d-15ce-44b1-b1e4-561917b29aa9 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1271 microversion: 2.1 time: 0.216943 Aug 29 12:07:39.519473 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3705/7444] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:39 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:40.546757 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:40.547726 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:40.556657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:40.557459 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:40.558614 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:40.560395 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:40.561516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:40.562396 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:40.761476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:40.770452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b765e884-c0be-4004-9130-635dbbab3c94 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1271 microversion: 2.1 time: 0.229683 Aug 29 12:07:40.771140 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3740/7445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:40 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:41.797729 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:41.798877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:41.809898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:41.810739 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:41.811774 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:41.813021 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:41.813860 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:41.814595 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:41.972991 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:41.984107 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-34b5b2b0-bbe3-4649-8d24-adc0a20e7d1d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.195130 Aug 29 12:07:41.984814 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3706/7446] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:41 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:43.005453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:43.006178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:43.008299 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:43.009012 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:43.016634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:43.017140 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:43.017603 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:43.018379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:43.018855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:43.019304 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:43.172572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:43.181457 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-31729ef1-e512-4ead-bc08-21902ae94529 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.180149 Aug 29 12:07:43.182802 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3741/7447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:42 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:44.205163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:44.206254 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:44.209601 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:07:44.217835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:44.218537 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:44.219135 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:44.219990 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:44.220605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:44.221164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:44.414320 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:44.425966 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8335ab69-bb58-4c35-9d16-fe6e0a53dfb5 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.224865 Aug 29 12:07:44.426832 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3707/7448] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:44 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:45.461502 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:45.462225 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:45.471045 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:45.471638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:45.472211 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:45.473173 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:45.473678 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:45.474228 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:45.634453 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:45.649079 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-7718dc15-6cf9-4881-938b-d9a7ad6fa3ec tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.191232 Aug 29 12:07:45.650158 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3742/7449] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:45 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:46.671510 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:46.672127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:46.679542 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:46.680031 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:46.680472 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:46.681192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:46.681647 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:46.682152 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:46.855845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:46.865914 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-303b159e-7f0e-45fb-ab73-74e571584d23 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.198595 Aug 29 12:07:46.866536 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3708/7450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:46 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:47.889226 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:47.890271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:47.903971 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:47.904893 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:47.905787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:47.907132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:47.908036 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:47.908869 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:48.109800 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:48.118643 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-c2b41af4-2fcb-40b6-ac03-2fabf70a3d08 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.234894 Aug 29 12:07:48.119264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3743/7451] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:47 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:49.141252 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:49.142154 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:49.149861 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:49.150427 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:49.151645 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:49.152705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:49.153239 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:49.153895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:49.318265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:49.327446 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-5ae0efbe-c78c-4da5-b6a9-1d80d5177f6d tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.190407 Aug 29 12:07:49.328127 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3709/7452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:49 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:50.069368 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "name": "network-vif-plugged", "status": "completed", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:50.094787 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:50.096014 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:50.096899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:50.124312 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] Creating event network-vif-plugged:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h2-854121-10 Aug 29 12:07:50.131714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-7a19a6d4-a11f-4377-ba02-861107b20560 req-70d5da97-fa5b-42f2-99a7-9be58806cbc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071292 Aug 29 12:07:50.132924 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3744/7453] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:07:50.349256 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:50.350011 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:50.358204 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:50.358682 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:50.359134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:50.359898 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:50.360370 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:50.360805 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:50.545124 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:50.555224 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cb24808-8d85-4cb0-b61a-93ddb731c1f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1259 microversion: 2.1 time: 0.210023 Aug 29 12:07:50.556087 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3710/7454] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:50 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:07:51.581451 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:51.582284 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:51.590641 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:51.591254 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:51.591765 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:51.592586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:51.593160 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:51.593929 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:51.762271 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:51.771134 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-97abd5c6-3961-45aa-9904-c18034463e44 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1444 microversion: 2.1 time: 0.195952 Aug 29 12:07:51.771758 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3745/7455] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:51 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1444 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:51.794382 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:07:51.795329 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:07:51.803055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:51.803568 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:51.804020 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:51.804796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:51.805408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:51.805881 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:51.972766 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:07:51.983752 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-32b37630-1b71-4429-9983-abd1f4544764 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1444 microversion: 2.1 time: 0.194293 Aug 29 12:07:51.984532 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3711/7456] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:07:51 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:07:54.413495 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:07:54.426094 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:07:54.426620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:07:54.427085 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:07:54.441052 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] Creating event network-changed:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h2-854121-10 Aug 29 12:07:54.447771 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-36e85de3-8e4b-46cf-b5fe-4e92503af94d req-e7660080-92ce-4ef7-a57c-482a68f98cf7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038153 Aug 29 12:07:54.448908 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3746/7457] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:09:52.354490 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=22 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:09:52.355396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=54 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:09:52.356847 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 12:09:52.357083 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action (ip 10.222.0.47) !!! Aug 29 12:09:52.359760 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 12:09:52.360004 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action (ip 10.222.0.47) !!! Aug 29 12:09:52.457679 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:09:52.458396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:52.466406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:52.466946 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:52.467430 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:52.468181 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:52.468672 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:52.469143 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:52.499976 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lazy-loading 'flavor' on Instance uuid 164ea118-8154-49be-9e19-b9e3170e14c3 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:09:52.588082 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b15289ef-242c-4c08-9769-f9eb832780f4 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action" status: 202 len: 0 microversion: 2.1 time: 0.235521 Aug 29 12:09:52.588972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3712/7458] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:09:52 2022] POST /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 12:09:52.598082 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:09:52.600044 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:09:52.601114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:09:52.602281 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=50 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:09:52.605425 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 12:09:52.605723 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 (ip 10.222.0.47) !!! Aug 29 12:09:52.628598 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:52.629656 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:52.643925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:52.644821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:52.645623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:52.647039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:52.647902 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:52.648879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:52.829272 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:52.839127 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a25508e1-9bc6-47ba-90a7-dc9eb95a146c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.243583 Aug 29 12:09:52.839755 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3747/7459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:52 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:09:53.864303 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:53.864917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:53.872839 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:53.873344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:53.873830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:53.874564 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:53.875024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:53.875447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:54.048134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:54.057191 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-e2886f81-a159-4e5a-843b-b7888e886d05 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.198680 Aug 29 12:09:54.057815 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3713/7460] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:53 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:09:55.080773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:55.081651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:55.097476 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42602. Aug 29 12:09:55.099960 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:55.100472 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:55.101513 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:55.102422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:55.102899 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:55.103353 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:55.104348 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42604. Aug 29 12:09:55.268037 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:55.277292 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-26c31f4c-00dd-4bb2-99dd-7305d9f031ff tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.200769 Aug 29 12:09:55.277929 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3748/7461] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:55 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:09:56.299552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:56.300166 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:56.308527 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:56.309016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:56.309458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:56.310459 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:56.310917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:56.311344 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:56.459131 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:56.467918 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6652e5e-9f16-4e8c-b9ff-f4cb1dc147fc tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.172320 Aug 29 12:09:56.468551 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3714/7462] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:56 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:09:57.493903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:57.494996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:57.504150 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:57.504666 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:57.505128 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:57.505912 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:57.506393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:57.506855 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:57.664240 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:57.672726 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b51dc2eb-c27a-4919-b5dd-326f4f2b0c49 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.187246 Aug 29 12:09:57.673344 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3749/7463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:57 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:09:58.699951 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:58.701089 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:58.713873 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:58.714432 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:58.714918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:58.715689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:58.716201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:58.716751 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:58.869493 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:09:58.878695 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0eac7f5d-cad2-4959-a363-3df000156b26 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.186304 Aug 29 12:09:58.879326 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3715/7464] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:58 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:09:59.901872 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:09:59.902528 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:09:59.910069 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:59.910587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:59.911042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:09:59.911793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:09:59.912270 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:09:59.912717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:00.072322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:00.080748 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a4ea4c7f-7876-41bb-a83b-cda60ed79b46 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.183875 Aug 29 12:10:00.081411 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3750/7465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:09:59 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:01.111769 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:01.112397 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:01.120727 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:01.121283 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:01.121895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:01.122705 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:01.123383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:01.123867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:01.285471 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:01.294451 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c1e86bc-57d0-4b6a-8fb1-72ee6a978b8b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.186604 Aug 29 12:10:01.295427 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3716/7466] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:01 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:02.318735 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:02.320066 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:02.328895 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:02.329412 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:02.329927 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:02.330687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:02.331190 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:02.331622 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:02.492590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:02.501386 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-36a609bc-0376-412d-86ea-d9d6674f9d82 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.186903 Aug 29 12:10:02.502044 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3751/7467] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:02 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:03.523901 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:03.524539 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:03.532345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:03.532835 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:03.533275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:03.534024 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:03.534484 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:03.534917 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:03.695811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:03.704742 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0272fb66-b201-47f2-9d84-efd949f570eb tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.185018 Aug 29 12:10:03.705362 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3717/7468] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:03 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:04.729086 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:04.729768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:04.737685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:04.738236 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:04.738719 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:04.739438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:04.739915 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:04.740374 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:04.912250 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:04.925769 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-4fbdd0f8-5817-4dc2-8373-ec5d285183e1 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.201393 Aug 29 12:10:04.926495 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3752/7469] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:04 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:05.953408 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:05.954282 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:05.964153 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:05.964741 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:05.965321 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:05.966299 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:05.966840 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:05.967345 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:06.159318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:06.172326 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-0c825446-cd9b-4049-ba3d-718e655e8203 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.223067 Aug 29 12:10:06.173366 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3718/7470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:05 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:07.214032 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:07.215114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:07.229935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.230977 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.231876 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.233278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.234193 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.234995 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.420059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:07.430906 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-44c64097-8923-44c1-9817-b34bbb71d5f8 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1570 microversion: 2.1 time: 0.226226 Aug 29 12:10:07.431534 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3753/7471] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:07 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:07.456800 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:10:07.457691 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:07.470130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.470924 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.471662 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.472614 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.473117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.473606 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.619437 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128682) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 12:10:07.719936 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-b7a6cfc7-b02c-460e-b65c-7bc972df0266 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "POST /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action" status: 202 len: 0 microversion: 2.1 time: 0.270301 Aug 29 12:10:07.721394 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3719/7472] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:10:07 2022] POST /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:10:07.732685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:07.733665 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:07.740309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.740835 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.741648 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.742729 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:07.743249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:07.743739 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:07.929968 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:07.939732 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-11c463fe-323f-430a-8c9c-8b892e349d42 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1518 microversion: 2.1 time: 0.213286 Aug 29 12:10:07.940346 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3754/7473] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:07 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:08.488318 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "name": "network-vif-unplugged", "status": "completed", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:10:08.512728 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:08.513599 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:08.514290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:08.533244 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.compute.server_external_events [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] Unable to find a host for instance 164ea118-8154-49be-9e19-b9e3170e14c3. Dropping event network-vif-unplugged {{(pid=128682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 12:10:08.534456 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fb13d91d-fc9a-40f8-8bc6-2d27b70833bf req-d9fa10d7-fe6f-4e30-bad1-24de962812d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054068 Aug 29 12:10:08.535575 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3720/7474] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 12:10:08.968324 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:08.969737 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:08.983793 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:08.984690 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:08.985511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:08.986935 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:08.987852 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:08.988651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:09.258410 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:09.270657 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-161cc762-53f7-48b7-81b1-ce05dc452913 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1520 microversion: 2.1 time: 0.310407 Aug 29 12:10:09.271667 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3755/7475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:08 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:10.297551 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:10.298376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:10.309404 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:10.310658 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:10.311443 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:10.312736 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:10.313574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:10.314306 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:10.555016 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:10.564262 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7b88c518-ba6e-4347-988d-2b4fd4c84800 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1520 microversion: 2.1 time: 0.271234 Aug 29 12:10:10.564877 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3721/7476] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:10 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:11.593834 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:11.594683 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:11.607538 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:11.608480 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:11.609332 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:11.610695 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:11.611229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:11.611972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:11.818064 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:11.828065 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9d436de6-d573-4267-8b88-fc3fdd92feed tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1520 microversion: 2.1 time: 0.240461 Aug 29 12:10:11.828674 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3756/7477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:11 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:12.864513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:12.865331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:12.875441 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:12.876086 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:12.876636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:12.877485 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:12.878118 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:12.878760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:13.091622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:13.107481 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a683efa0-3691-40e3-9888-9f8193fb7833 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1520 microversion: 2.1 time: 0.247171 Aug 29 12:10:13.108581 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3722/7478] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:12 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:14.142975 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:14.144075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:14.153520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:14.154230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:14.154840 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:14.155953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:14.157222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:14.158040 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:14.349219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:14.363905 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-58139c7e-c4ea-41e2-b72e-0ef670f74f30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1520 microversion: 2.1 time: 0.225404 Aug 29 12:10:14.365098 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3757/7479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:14 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:15.392196 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:15.393037 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:15.406192 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:15.407127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:15.408023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:15.409450 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:15.410328 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:15.411126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:15.661216 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:15.671308 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-80d63942-3bc7-47f3-875a-a15499d8dca6 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.284752 Aug 29 12:10:15.672264 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3723/7480] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:15 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:15.833996 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:10:15.851443 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:15.851842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:15.852425 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:15.868999 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] Creating event network-changed:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h1-854121-10 Aug 29 12:10:15.873914 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:10:16.693681 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:16.694952 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:16.702738 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:16.703234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:16.703669 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:16.704391 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:16.704972 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:16.705407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:16.865265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:16.874981 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-8ef5816c-5db5-48d1-a746-ea0fddecfd2a tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.185121 Aug 29 12:10:16.875603 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3724/7481] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:16 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:16.894257 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] [9b28b051-3e65-4a75-9c22-eb5ba1d79aec] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42666. Aug 29 12:10:16.899110 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-dac25cfe-59ce-4e92-85fb-ddcfb6ec3860 req-1df1574a-fa07-422d-bfdf-3453fecbe0be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.069347 Aug 29 12:10:16.899953 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3758/7482] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:10:17.896733 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:17.898278 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:17.906961 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:17.907481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:17.907986 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:17.908708 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:17.909250 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:17.909680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:18.071238 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:18.081603 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-816783d0-dce7-4951-a396-b34879c52080 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.188677 Aug 29 12:10:18.082406 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3725/7483] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:17 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:19.117591 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:19.118253 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:19.125107 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:19.125620 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:19.126110 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:19.126847 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:19.127322 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:19.127769 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:19.288025 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:19.296732 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5174f72d-895b-4214-945d-7da061629d1f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.184718 Aug 29 12:10:19.297339 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3759/7484] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:19 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:20.321059 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:20.321809 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:20.329867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:20.330388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:20.330875 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:20.331566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:20.332066 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:20.332503 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:20.337918 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:10:20.504730 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:20.514024 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a1bd5268-72df-4993-b6f9-d6e2650c9477 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.198001 Aug 29 12:10:20.514735 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3726/7485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:20 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:21.546990 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:21.547684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:21.557371 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:21.557984 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:21.558546 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:21.559437 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:21.560223 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:21.560715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:21.728241 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:21.738420 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a45b418b-a43e-41a2-92db-476a488941f0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.195587 Aug 29 12:10:21.739354 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3760/7486] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:21 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:22.762950 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:22.763786 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:22.766567 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:10:22.780296 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:22.781160 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:22.781935 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:22.783163 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:22.783949 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:22.784721 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:22.967388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:22.977363 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6cee4af0-6b4e-4f54-8373-4bf402e56c34 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.218479 Aug 29 12:10:22.978160 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3727/7487] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:22 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:24.005278 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:24.006815 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:24.010249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=29 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:10:24.016206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:24.016718 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:24.017178 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:24.017953 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:24.018433 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:24.018879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:24.022578 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=81 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:10:24.176890 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:24.192769 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-daedb272-98d2-4720-9e23-b4b8fbd68b6c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.190971 Aug 29 12:10:24.194388 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3761/7488] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:24 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:25.217509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:25.219369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:25.228509 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:25.229018 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:25.229500 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:25.230290 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:25.230759 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:25.231357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:25.413813 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:25.422851 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-acd9f646-aee9-41dc-a543-5c79b0dffcac tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.209654 Aug 29 12:10:25.423480 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3728/7489] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:25 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:10:26.464931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:26.465687 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:26.472773 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:26.473286 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:26.473771 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:26.474533 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:26.475520 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:26.476260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:26.655510 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:26.678216 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-fd6db385-98f6-42bb-a5fe-6a260884308b tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.214182 Aug 29 12:10:26.679910 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3762/7490] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:26 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:26.836398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "name": "network-vif-plugged", "status": "completed", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:10:26.848468 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:26.849087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:26.849587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:26.863449 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] Creating event network-vif-plugged:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h1-854121-10 Aug 29 12:10:26.870774 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-3108b2c0-0e83-4402-b8c1-cc6bf557d76f req-4e5c2430-6121-4508-ae5e-4affe88cf74e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127529 Aug 29 12:10:26.871546 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3729/7491] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:10:27.714865 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:27.715494 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:27.723184 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:27.723764 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:27.724260 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:27.725176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:27.725746 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:27.726256 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:27.975127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:27.990465 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-dfbe477a-0677-49e6-ac34-f31fe705bd30 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1576 microversion: 2.1 time: 0.279215 Aug 29 12:10:27.991562 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3763/7492] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:27 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:10:29.028673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:10:29.029383 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:10:29.036155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:29.036652 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:29.037096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:29.039814 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:10:29.040396 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:10:29.041201 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:10:29.198930 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:10:29.208157 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-737fe9ba-dcf8-4472-a919-183f1534dd2e tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1563 microversion: 2.1 time: 0.184993 Aug 29 12:10:29.209561 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3730/7493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:10:29 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:11:46.350152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=5 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:11:46.352116 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=17 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:11:46.353816 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:11:46.354275 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 (ip 10.222.0.47) !!! Aug 29 12:11:46.361655 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=7 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:11:46.365043 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:11:46.366794 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:46.368196 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:46.381167 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:11:46.382503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:46.383706 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:46.384833 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:46.386487 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:46.387649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:46.388836 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:46.405340 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:46.406350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:46.408275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:46.446277 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] Creating event network-changed:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h1-854121-10 Aug 29 12:11:46.459589 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:11:46.461366 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fc04cc75-9d34-4b06-af14-4a8c11734f97 req-15a845ec-1aa9-4194-aee4-3df8ac988fef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105724 Aug 29 12:11:46.464150 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3731/7494] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:11:46.656796 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-8403f931-7af4-4afb-965b-0c023e05b34f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "DELETE /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 204 len: 0 microversion: 2.1 time: 0.309712 Aug 29 12:11:46.658342 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3764/7495] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:11:46 2022] DELETE /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 12:11:46.677959 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:46.679706 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:46.696750 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:46.697646 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:46.698512 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:46.701414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:46.701414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:46.701414 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:46.914054 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:46.924072 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-38ad79a0-f716-4bad-8000-2b52e4f4d881 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.256474 Aug 29 12:11:46.925812 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3732/7496] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:46 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:47.961650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:47.962431 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:47.970985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:47.971499 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:47.971985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:47.973489 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:47.974033 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:47.974574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:48.233242 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:48.248058 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f408814f-2ed2-4905-8fb6-fb4d328f6fa0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1569 microversion: 2.1 time: 0.290714 Aug 29 12:11:48.249767 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3765/7497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:47 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:48.783334 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ea118-8154-49be-9e19-b9e3170e14c3", "name": "network-vif-deleted", "tag": "fb389ae0-77e6-4fbc-9711-155cb6aa3e09"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:11:48.801184 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:48.802129 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:48.802920 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:48.831163 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] Creating event network-vif-deleted:fb389ae0-77e6-4fbc-9711-155cb6aa3e09 for instance 164ea118-8154-49be-9e19-b9e3170e14c3 on n-h1-854121-10 Aug 29 12:11:48.842705 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-104300d2-56b9-4d62-be19-3c0e68c01435 req-fd33b134-162e-4a0b-8da5-4b8f85ab5b7b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062777 Aug 29 12:11:48.843865 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3733/7498] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:11:49.275016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:49.275870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:49.289309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:49.290162 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:49.290992 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:49.292298 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:49.293156 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:49.294051 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:49.399903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:49.411714 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-288799be-ff0a-4be7-b781-7c8e6fa5e616 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1219 microversion: 2.1 time: 0.144453 Aug 29 12:11:49.412833 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3766/7499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:49 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:50.452797 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:50.453941 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:50.463712 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:50.464360 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:50.465127 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:50.466226 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:50.466863 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:50.467376 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:50.579830 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:50.590822 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-ba947421-5e39-4c87-a852-526cba41552f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1219 microversion: 2.1 time: 0.145379 Aug 29 12:11:50.591723 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3734/7500] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:50 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:51.618755 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:51.620127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:51.633864 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:51.634878 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:51.635768 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:51.637126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:51.638059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:51.638930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:51.742473 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:51.753131 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1aa96d35-f477-41e3-9638-3f9238ce097c tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1219 microversion: 2.1 time: 0.143344 Aug 29 12:11:51.754853 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3767/7501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:51 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:52.782095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:52.783235 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:52.795811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:52.796688 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:52.797481 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:52.798761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:52.799587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:52.800361 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:52.904137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:52.918982 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-655b3b00-8a62-4f09-938a-b88b69d97c91 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1219 microversion: 2.1 time: 0.143534 Aug 29 12:11:52.920037 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3735/7502] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:52 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:53.945181 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:53.946709 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:53.955333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:53.956043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:53.956664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:53.957680 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:53.958314 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:53.958871 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:54.012634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:54.013050 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:54.013524 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:54.014056 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.objects.instance [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lazy-loading 'fault' on Instance uuid 164ea118-8154-49be-9e19-b9e3170e14c3 {{(pid=128681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:11:54.089943 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510b5ef6aef04249947654314ba6852b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41eb65664b334ab79bce9d19399cd652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:11:54.104429 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3391ae24-9cc8-4b1a-a641-c0fb430177a0 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 200 len: 1224 microversion: 2.1 time: 0.164683 Aug 29 12:11:54.106035 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3768/7503] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:53 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:11:55.134516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:55.135590 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] [instance: 164ea118-8154-49be-9e19-b9e3170e14c3] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:11:55.143867 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:55.145076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:55.145821 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:55.146937 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:11:55.147574 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:11:55.148117 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:11:55.165343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.wsgi [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] HTTP exception thrown: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Request method failure captured: Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: request: GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 HTTP/1.1 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Accept: application/json Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Accept-Encoding: identity Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Connection: close Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Content-Length: 0 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Content-Type: application/json Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Host: 10.222.0.47 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: Openstack-System-Scope: None Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: User-Agent: python-urllib3/1.26.12 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Auth-Token: gAAAAABjDKrrZ0Kt92I52MVFF-HM9xUnEjHZMYsVeJ-Rna7BiQfIGtK32VlseCTHJGZ0jwxGNgsdP6Nhhaw_N6ou9yUEnGt-hPggHq4rpQn7VHE0QThF1K6IO2-lPRRDCz1jjCK4Mpjv6KsuQ5ca0xg72KiUF2qbjriQGAGz1kuSYb1xVrPA-ds Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Id: None Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Domain-Name: None Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Identity-Status: Confirmed Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Is-Admin-Project: True Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Id: default Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Domain-Name: Default Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Id: 41eb65664b334ab79bce9d19399cd652 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Project-Name: tempest-TestShelveInstance-1051849752 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Role: reader,member Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Roles: reader,member Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41eb65664b334ab79bce9d19399cd652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41eb65664b334ab79bce9d19399cd652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant: tempest-TestShelveInstance-1051849752 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Id: 41eb65664b334ab79bce9d19399cd652 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-Tenant-Name: tempest-TestShelveInstance-1051849752 Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-User: tempest-TestShelveInstance-1051849752-project Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Id: default Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-User-Domain-Name: Default Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-User-Id: 510b5ef6aef04249947654314ba6852b Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: X-User-Name: tempest-TestShelveInstance-1051849752-project Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: method: > Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: exception: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: action_args: {'id': '164ea118-8154-49be-9e19-b9e3170e14c3'} Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:11:55.167121 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: ERROR nova.api.openstack.wsgi Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Returning 404 to user: Instance 164ea118-8154-49be-9e19-b9e3170e14c3 could not be found. {{(pid=128682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-2819ebd9-7031-4bac-a8e5-21933e18848f tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3" status: 404 len: 111 microversion: 2.1 time: 0.038502 Aug 29 12:11:55.178076 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3736/7504] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:11:55 2022] GET /compute/v2.1/servers/164ea118-8154-49be-9e19-b9e3170e14c3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 12:11:55.407379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-01b3df05-80d7-442f-afad-d919ad3dd609 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] Calling method '.version_select at 0x7f66c5e310d0>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:11:55.445517 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-01b3df05-80d7-442f-afad-d919ad3dd609 tempest-TestShelveInstance-1051849752 tempest-TestShelveInstance-1051849752-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853703118" status: 202 len: 0 microversion: 2.1 time: 0.045579 Aug 29 12:11:55.459750 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3769/7505] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 29 12:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853703118 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 12:12:18.771761 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=12 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:18.773023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:19.114561 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-eaa5ac64-28e8-4692-9e14-148cc83fb476 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Action: 'create', calling method: .version_select at 0x7f66c5b913a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1294190160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqSD9BbRGhgdonvaDvq4UP5cvaw0waQIg41T2fAIG93XLTILwGtpBcK23hW5hEkHq2o23a4MpCdJztJ8kzCYR2Os5Cr8Zp6dEdEJq2e6VznMu56Q+z7XeRx1YBjg5CLpg=="}} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:12:19.133288 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eaa5ac64-28e8-4692-9e14-148cc83fb476 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:12:19.139945 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.quota [None req-eaa5ac64-28e8-4692-9e14-148cc83fb476 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for user e243eead018647b5b77a7348c57846b0 and project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'key_pairs'} {{(pid=128682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:12:19.176381 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-eaa5ac64-28e8-4692-9e14-148cc83fb476 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.410916 Aug 29 12:12:19.176381 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3737/7506] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 29 12:12:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:12:20.752195 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:20.757728 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:20.763717 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-719287315", "imageRef": "2f170d57-7e4d-481e-9b6b-0fb69678ffde", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1294190160", "security_groups": [{"name": "tempest-secgroup-smoke-1899808641"}], "networks": [{"uuid": "a42fe808-3bf4-49bf-87c8-9ad6a75ab943"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:12:20.924430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] validate_networks() for [('a42fe808-3bf4-49bf-87c8-9ad6a75ab943', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 12:12:21.609449 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 12:12:21.609944 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 12:12:21.610468 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 12:12:21.610909 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 12:12:21.611342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 12:12:21.623624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:21.624249 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:21.624760 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:21.625573 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:21.626144 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:21.626625 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:21.647986 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:12:21.656422 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for user e243eead018647b5b77a7348c57846b0 and project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:12:21.672592 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 12:12:21.675821 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f170d57-7e4d-481e-9b6b-0fb69678ffde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 12:12:21.744853 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-25c290bc-11d2-405f-9f3c-de714af03d98 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994694 Aug 29 12:12:21.746161 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3770/7507] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 12:12:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 12:12:21.778690 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1955bd37-fcf9-49ba-8a77-7b6238e019f7 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:21.779966 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1955bd37-fcf9-49ba-8a77-7b6238e019f7 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:21.884624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1955bd37-fcf9-49ba-8a77-7b6238e019f7 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:21.896463 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1955bd37-fcf9-49ba-8a77-7b6238e019f7 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1248 microversion: 2.1 time: 0.136592 Aug 29 12:12:21.897065 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3738/7508] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:21 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:22.937267 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff884f23-4f77-48a4-8c4b-b9ac63d8c7b3 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:22.938476 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff884f23-4f77-48a4-8c4b-b9ac63d8c7b3 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:23.014664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff884f23-4f77-48a4-8c4b-b9ac63d8c7b3 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:23.023531 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff884f23-4f77-48a4-8c4b-b9ac63d8c7b3 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1248 microversion: 2.1 time: 0.095436 Aug 29 12:12:23.024148 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3771/7509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:22 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:12:24.053651 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:24.054399 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:24.062663 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:24.063170 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:24.063617 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:24.064349 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:24.064811 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:24.065264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:24.139126 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:24.149252 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c29a7eaa-53e9-4ee8-9f93-2009a13a4f2d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1252 microversion: 2.1 time: 0.100438 Aug 29 12:12:24.150252 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3739/7510] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:24 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1252 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:25.178903 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:25.180313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:25.193645 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:25.194601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:25.195749 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:25.197132 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:25.198188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:25.199161 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:25.379904 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:25.399751 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-f65c32a2-0c18-4bf8-8dec-22aff3bc8b90 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1308 microversion: 2.1 time: 0.228762 Aug 29 12:12:25.400683 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3772/7511] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:25 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:26.437447 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:26.438139 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:26.449294 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:26.451236 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:26.452327 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:26.455575 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:26.456896 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:26.460046 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:26.659743 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:26.676515 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-1937866c-1a66-4077-8ec7-be7174d2566e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.246065 Aug 29 12:12:26.678134 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3740/7512] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:26 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:27.415601 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:12:27.436527 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:27.437461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:27.438333 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:27.452084 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] Creating event network-changed:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:12:27.458417 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-d2af4543-04e3-4a51-b8c4-3e25d3b187cb req-83f1398b-0310-4a10-9eba-3422382b01c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170596 Aug 29 12:12:27.459078 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3773/7513] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:12:27.701577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:27.702435 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:27.712458 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:27.713164 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:27.713897 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:27.715003 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:27.715616 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:27.716265 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:27.944364 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:27.954032 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-f8729d36-0010-4600-8228-b8869b364b77 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.256701 Aug 29 12:12:27.954643 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3741/7514] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:27 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:28.977972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:28.978819 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:28.986916 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:28.988379 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:28.989044 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:28.990098 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:28.990789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:28.991335 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:29.542947 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:29.553027 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-08f04aea-7c51-4ccc-b42e-459aed65ca41 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.579574 Aug 29 12:12:29.553752 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3774/7515] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:28 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:12:30.574953 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:30.575597 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:30.583274 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:30.583765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:30.584207 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:30.584927 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:30.585388 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:30.585850 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:30.743795 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:30.752647 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-3c06b0d6-8b07-46fa-a686-9caa5cbdece5 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.181855 Aug 29 12:12:30.753866 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3742/7516] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:30 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:12:31.788615 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:31.789309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:31.792349 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:31.798458 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:31.798972 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:31.799430 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:31.801222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:31.801427 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:31.801914 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:31.970572 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:31.982904 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-3764becf-bbec-48ad-b5fa-7061612cdd9f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.199176 Aug 29 12:12:31.983778 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3775/7517] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:31 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:33.008816 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:33.009784 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:33.013168 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=6 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:33.022179 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:33.022914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:33.023476 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:33.024297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:33.024884 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:33.025403 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:33.125503 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "name": "network-vif-plugged", "status": "completed", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:12:33.143188 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=8 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:12:33.152599 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:33.153930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:33.153930 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:33.178192 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] Creating event network-vif-plugged:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:12:33.190267 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-1804f60d-67d4-4ba2-a49d-81fa05fdc428 req-17b04578-9fea-4e18-90b9-ca4e82a999cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068893 Aug 29 12:12:33.192264 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3776/7518] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:12:33.258956 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:33.267792 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-6aeb35f7-8b1f-46d7-852b-ae5fe427f9e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.264831 Aug 29 12:12:33.268511 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3743/7519] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:33 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:12:34.291688 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:34.292320 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:34.299237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:34.300989 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:34.301590 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:34.302393 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:34.302879 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:34.303329 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:34.473881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:34.484482 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-461a202a-1ec5-4cc3-8943-88339f16ea8a tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1374 microversion: 2.1 time: 0.197945 Aug 29 12:12:34.485103 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3777/7520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:34 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:12:35.506552 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:35.507609 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:35.515723 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:35.516222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:35.516673 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:35.517406 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:35.517915 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:35.518892 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:35.681091 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:35.690891 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c7bd78be-531f-46a6-a291-439a5cb4e85f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1560 microversion: 2.1 time: 0.188443 Aug 29 12:12:35.691679 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3744/7521] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:35 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:35.712870 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:12:35.713516 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:12:35.721659 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:35.722089 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:35.722297 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:35.723060 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:35.723549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:35.724019 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:35.878999 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:12:35.888273 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-00f2aba9-61d7-4291-b052-e140c7322321 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1560 microversion: 2.1 time: 0.179407 Aug 29 12:12:35.888887 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3778/7522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:12:35 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:12:38.183668 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:12:38.196402 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:12:38.197055 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:12:38.197605 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:12:38.216035 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] Creating event network-changed:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:12:38.225343 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-63a15e43-d042-4cde-b4d9-1bb002063c57 req-f76e7f2c-d3e4-450b-9d79-346d0a20751f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142154 Aug 29 12:12:38.226496 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3745/7523] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:14:32.171856 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 12:14:32.174008 n-d-854121-10 devstack@n-api.service[128681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 12:14:32.174783 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:32.175586 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=36 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:32.182042 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-94626978"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:14:32.184646 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:32.194207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:32.194723 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:32.195206 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:32.196076 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:32.196595 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:32.197039 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:32.427898 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-9fffeebd-cbad-4982-ba1e-a4d8df52af69 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "POST /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486/action" status: 202 len: 0 microversion: 2.1 time: 0.257829 Aug 29 12:14:32.428587 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3779/7524] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:14:32 2022] POST /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 12:14:37.878557 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:14:37.881292 n-d-854121-10 devstack@n-api.service[128682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 12:14:37.882656 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:37.884095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=38 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:37.885817 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:14:37.886619 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 29 12:14:37.915463 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "name": "network-vif-plugged", "status": "completed", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:14:37.936457 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:37.937760 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:37.939107 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:37.964917 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] Creating event network-vif-plugged:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:14:37.974829 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-1ff950e3-2076-49d3-9294-5cff21874ad8 req-1ae40cf5-40b9-4928-8a45-031eaaa615a3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099951 Aug 29 12:14:37.976136 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3746/7525] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:14:47.313609 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:47.314828 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:47.321587 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1913870555", "imageRef": "a1be6758-fb8a-4c6e-86e6-bb170fc2047b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1294190160", "security_groups": [{"name": "tempest-secgroup-smoke-1899808641"}], "networks": [{"uuid": "a42fe808-3bf4-49bf-87c8-9ad6a75ab943"}]}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:14:47.351006 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f4ae655-b5fa-4a12-be8e-ad3c9472e786] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43116. Aug 29 12:14:47.352920 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c0b25b-b44a-48a2-9ca6-569e9a683075] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43114. Aug 29 12:14:47.457207 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.network.neutron [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] validate_networks() for [('a42fe808-3bf4-49bf-87c8-9ad6a75ab943', None, None, None, None, None)] {{(pid=128681) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 12:14:47.916635 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Flavor limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 12:14:47.917087 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Image limits 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 12:14:47.917588 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Flavor pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 12:14:47.918068 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Image pref 0:0:0 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 12:14:47.918537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.virt.hardware [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 12:14:47.928366 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:47.928874 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:47.929342 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:47.930138 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:47.930624 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:47.931075 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:47.950463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 12:14:47.958657 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.quota [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Getting quotas for user e243eead018647b5b77a7348c57846b0 and project 9870c6cfc24147f684f75a0c68d41c56. Resources: {'ram', 'instances', 'cores'} {{(pid=128681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 12:14:47.974988 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Going to run 1 instances... {{(pid=128681) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 12:14:47.977649 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be6758-fb8a-4c6e-86e6-bb170fc2047b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 12:14:48.029526 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b0474aef-ea1e-45cc-af86-c4391dca4d74 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718722 Aug 29 12:14:48.030646 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3780/7526] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 29 12:14:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 12:14:48.048598 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a64d3972-7f0b-4d75-9e5d-047515aa5290 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:48.050947 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-a64d3972-7f0b-4d75-9e5d-047515aa5290 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:48.067977 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:48.084206 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a27fc3e-a394-482f-8ea5-677276ff3237] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43130. Aug 29 12:14:48.098378 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] [09d610d9-ef66-4544-bbca-4583f1500aa8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 43132. Aug 29 12:14:48.154064 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-a64d3972-7f0b-4d75-9e5d-047515aa5290 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:48.163684 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a64d3972-7f0b-4d75-9e5d-047515aa5290 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1249 microversion: 2.1 time: 0.123989 Aug 29 12:14:48.164576 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3747/7527] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:48 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:49.201251 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:49.202910 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:49.215550 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:49.216463 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:49.217264 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:49.219370 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:49.220245 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:49.221043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:49.345647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:49.354558 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-6580e6f6-8a8b-4153-ab74-3b3f0003b4d9 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1301 microversion: 2.1 time: 0.160625 Aug 29 12:14:49.355372 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3781/7528] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:49 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:50.381390 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:50.384639 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:50.410577 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:50.423033 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:50.424001 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:50.425444 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:50.426506 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:50.427352 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:50.711826 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:50.740022 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-49341466-a0ff-4b46-971b-7c60bc78b9e6 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.365398 Aug 29 12:14:50.743415 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3748/7529] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:50 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:51.787981 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:51.795350 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:51.819496 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:51.821288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:51.822642 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:51.823616 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:51.824493 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:51.825511 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:51.948520 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "name": "network-vif-unplugged", "status": "completed", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:14:52.023921 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:52.025323 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:52.031161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:52.093235 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] Creating event network-vif-unplugged:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:14:52.106485 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-fbb890c9-f6a4-4bee-a5b9-50c5a2faac68 req-5b92c57b-b747-4b9e-b628-5caf388de413 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165697 Aug 29 12:14:52.111972 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3749/7530] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:14:52.169763 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:52.185111 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-90673f63-e6be-44cb-90c7-768fda7d6943 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.406703 Aug 29 12:14:52.201869 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3782/7531] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:51 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:52.291392 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:14:52.311010 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:52.312498 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:52.313100 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:52.331396 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] Creating event network-changed:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:14:52.337821 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-894ff03d-15b6-458d-949f-23c5c63df97e req-2d171566-69a6-41c9-9701-2061f313bb0d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053062 Aug 29 12:14:52.339274 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3750/7532] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:14:53.208549 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:53.209186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:53.217053 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:53.217652 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:53.218176 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:53.219569 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:53.220126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:53.220531 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:53.397887 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:53.414100 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-2fae2fce-fc74-4483-a1c5-48e81e92593c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.209641 Aug 29 12:14:53.415437 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3783/7533] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:53 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:14:54.443772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:54.444993 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:54.459155 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:54.461480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:54.462335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:54.463634 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:54.464680 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:54.465419 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:54.708984 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:54.718585 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-976d6f05-e749-47be-a0c6-b3b66848f5b8 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.282922 Aug 29 12:14:54.719272 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3751/7534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:54 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:55.754849 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:55.757230 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:55.767438 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:55.767958 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:55.768638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:55.769413 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:55.769925 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:55.770377 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:56.038126 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:56.047368 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5cdc59a4-7bbb-4ea7-8516-12d08c3ad1ce tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.301579 Aug 29 12:14:56.048301 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3784/7535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:55 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:14:57.069636 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:57.070693 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:57.084550 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:57.086546 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:57.087624 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:57.089222 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:57.090330 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:57.091357 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:57.291895 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:57.323704 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-4e3476b5-d5aa-47f4-a2c3-f5d0cf9c25cd tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.257868 Aug 29 12:14:57.324613 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3752/7536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:57 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:58.366543 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:58.373088 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:58.377931 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:58.379127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell0:SELECT=6 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:58.385965 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:58.386685 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:58.387288 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:58.388209 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:58.388808 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:58.390027 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:58.601881 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:58.612352 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ff729b2f-e7b9-4bf6-88f9-1ee2ded7e6e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.253252 Aug 29 12:14:58.613001 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3785/7537] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:58 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:14:59.636632 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:14:59.637547 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:14:59.643366 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell0:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:14:59.654095 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:59.655794 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:59.656628 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:59.658008 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:14:59.658879 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:14:59.660082 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:14:59.869513 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:14:59.883239 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-7fcaf7fe-8d05-445c-8da6-5c14a751300b tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.251199 Aug 29 12:14:59.884231 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3753/7538] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:14:59 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:15:00.909125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:15:00.909803 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:15:00.917827 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:00.918373 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:00.918842 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:00.919647 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:00.920152 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:00.920753 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:01.075102 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:15:01.084656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-948e93b8-f28b-40d5-9005-18b7dafb5702 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.180486 Aug 29 12:15:01.085364 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3786/7539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:15:00 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:15:02.107796 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:15:02.109563 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:15:02.120322 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:02.120903 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:02.121412 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:02.122275 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:02.122876 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:02.123373 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:02.201455 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "name": "network-vif-plugged", "status": "completed", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:15:02.228780 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:02.229692 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:02.230574 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:02.252527 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] Creating event network-vif-plugged:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:15:02.262737 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-b9381893-68e9-4c39-a1b0-5dc311fbf14e req-82c38e2a-6575-4a2e-a5cb-4be8cd915be0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069263 Aug 29 12:15:02.266277 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3787/7540] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:15:02.346315 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:15:02.354785 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-dbac804b-8341-4ad3-9f49-f746fc9c443d tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.251735 Aug 29 12:15:02.355428 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3754/7541] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:15:02 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:15:03.390043 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:15:03.392748 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:15:03.401059 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:03.402072 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:03.402537 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:03.403313 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:03.403789 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:03.404237 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:03.589766 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:15:03.599765 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-1825e06f-3918-4be4-8c8f-fb627b162b61 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1375 microversion: 2.1 time: 0.215033 Aug 29 12:15:03.600447 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3788/7542] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:15:03 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1375 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:15:04.620845 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:15:04.621664 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:15:04.629339 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:04.629894 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:04.630335 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:04.631051 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:04.631507 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:04.631932 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:04.799101 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:15:04.807900 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d7b5a830-6f1d-45c7-8975-61ebf4abf868 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1560 microversion: 2.1 time: 0.190951 Aug 29 12:15:04.808562 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3755/7543] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:15:04 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:15:04.831486 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:15:04.832125 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:15:04.839435 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:04.839959 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:04.840428 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:04.841186 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:04.841684 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:04.842229 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:05.024265 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:15:05.039452 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-ac16081c-d10a-46d6-a16a-b942c09a8c67 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1560 microversion: 2.1 time: 0.212187 Aug 29 12:15:05.040548 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3789/7544] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:15:04 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 12:15:07.333482 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:15:07.352536 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:15:07.353516 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:15:07.354407 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:15:07.377627 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] Creating event network-changed:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:15:07.387114 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-2ef8260d-3dc3-49c5-9643-333669c4577e req-5cf4469e-b21d-41f4-83eb-41b9248b1d75 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060540 Aug 29 12:15:07.388257 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3756/7545] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:16:34.706127 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:34.707967 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=52 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:34.710812 n-d-854121-10 devstack@n-api.service[128681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:16:34.711141 n-d-854121-10 devstack@n-api.service[128681]: Mon Aug 29 12:16:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900/action (ip 10.222.0.47) !!! Aug 29 12:16:34.717993 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-789658524"}} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:34.720785 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:34.732213 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:34.732744 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:34.733219 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:34.734024 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:34.734523 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:34.734985 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:35.277831 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-a646a5da-b0ba-4406-8282-39caa4ad8a4c tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "POST /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900/action" status: 202 len: 0 microversion: 2.1 time: 0.574628 Aug 29 12:16:35.278581 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3790/7546] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 29 12:16:34 2022] POST /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 12:16:40.836219 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=24 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:40.838461 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=42 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:40.841468 n-d-854121-10 devstack@n-api.service[128682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 12:16:40.841916 n-d-854121-10 devstack@n-api.service[128682]: Mon Aug 29 12:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 29 12:16:41.008717 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "name": "network-vif-plugged", "status": "completed", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:41.026540 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:41.027331 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:41.028343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:41.042335 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] Creating event network-vif-plugged:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:16:41.051457 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-621c5ee8-8e8f-4ead-8c9a-669e3e76d188 req-d7d3ee27-9617-4fb3-959c-4774c5ea8038 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221201 Aug 29 12:16:41.052501 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3757/7547] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 12:16:51.514810 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_api:SELECT=2 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:51.515623 n-d-854121-10 devstack@n-api.service[128681]: DEBUG dbcounter [-] [128681] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:51.520222 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:51.521016 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:51.522602 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_api:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:51.523764 n-d-854121-10 devstack@n-api.service[128682]: DEBUG dbcounter [-] [128682] Writing DB stats nova_cell1:SELECT=2 {{(pid=128682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 12:16:51.530992 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:51.531407 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:51.531945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:51.532406 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:51.533155 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:51.533638 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:51.534114 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:51.573772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:51.578625 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:51.579120 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:51.580894 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Going to try to terminate instance {{(pid=128681) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:16:51.596122 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.compute.server_external_events [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] Creating event network-changed:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:16:51.606899 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [req-06419482-5a35-4830-8fd8-bf95e5905745 req-5d3eda3b-8146-4356-9d6b-d606fa17ddd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086316 Aug 29 12:16:51.608907 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3758/7548] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:16:51.706545 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-899f53df-3131-4836-8e4f-89cb0c7a3880 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 204 len: 0 microversion: 2.1 time: 0.193209 Aug 29 12:16:51.708016 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3791/7549] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:16:51 2022] DELETE /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 12:16:51.722885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:51.724161 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:51.737398 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:51.738442 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:51.739263 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:51.740578 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:51.741393 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:51.742130 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:52.065311 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:16:52.081640 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-c6ee1ce1-1ea6-4103-a2a7-0c347bd80042 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1684 microversion: 2.1 time: 0.367909 Aug 29 12:16:52.082752 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3759/7550] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:51 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1684 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:16:52.715479 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "name": "network-vif-unplugged", "status": "completed", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:52.737664 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:52.739171 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:52.740135 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:52.767073 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] Creating event network-vif-unplugged:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:16:52.776537 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-f4f02af2-1e46-4084-b955-c98cefd47e9c req-eadb6b86-4ea3-4df7-8d5d-6c2e5173e771 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067987 Aug 29 12:16:52.777809 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3792/7551] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:16:53.119474 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:53.120087 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:53.128350 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:53.128979 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:53.129465 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:53.130264 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:53.130765 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:53.131234 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:53.348080 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:16:53.363353 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-73d65eef-3fa4-4929-990f-7e6be6ba5428 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1684 microversion: 2.1 time: 0.247344 Aug 29 12:16:53.364850 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3760/7552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:53 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1684 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:16:53.880921 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f55176d-f7ca-4cce-88e8-a5b3d8396900", "name": "network-vif-deleted", "tag": "38874691-74b0-483e-a6f1-c22ddfddfed8"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:53.893461 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:53.894650 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:53.895103 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:53.909082 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] Creating event network-vif-deleted:38874691-74b0-483e-a6f1-c22ddfddfed8 for instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 on n-h1-854121-10 Aug 29 12:16:53.916451 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-a9ce759a-0950-45f5-9bf0-a892d053b6c8 req-b0eafb16-df15-4bab-879a-d956a1b8140c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040537 Aug 29 12:16:53.917746 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3793/7553] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:16:54.399232 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:54.400405 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:54.410137 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:54.410782 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:54.411346 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:54.412480 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:54.413194 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:54.413689 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:54.486367 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:54.487217 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:54.487996 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:54.488885 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lazy-loading 'fault' on Instance uuid 8f55176d-f7ca-4cce-88e8-a5b3d8396900 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:16:54.554389 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:16:54.569375 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-645d295f-5f73-464e-9e1f-3047f214113e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 200 len: 1339 microversion: 2.1 time: 0.174751 Aug 29 12:16:54.570281 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3761/7554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:54 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 1339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:16:55.604000 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:55.604805 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: 8f55176d-f7ca-4cce-88e8-a5b3d8396900] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:55.612021 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:55.612534 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:55.613001 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:55.613767 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:55.614255 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:55.614705 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:55.630474 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] HTTP exception thrown: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Request method failure captured: Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 HTTP/1.1 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDK0cEykwbqE3AfO0YLAiXYgeu29Iy_itUjst0dMilY3zwXsDbhCyQJl3gpRMsidg_lN9kxkOvUP44ahnLCd3IVAF9W_JNVfP2S-S0SHGcDxfNVP6Pd-MzZ54RzwGDLJqC0WBYsnaXqWbfqhkRjnbEtJXPkqDYTfE7iYZt_fY_BAV37w Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 9870c6cfc24147f684f75a0c68d41c56 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestSnapshotPattern-1423084507 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestSnapshotPattern-1423084507 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 9870c6cfc24147f684f75a0c68d41c56 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestSnapshotPattern-1423084507 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestSnapshotPattern-1423084507-project Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e243eead018647b5b77a7348c57846b0 Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestSnapshotPattern-1423084507-project Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': '8f55176d-f7ca-4cce-88e8-a5b3d8396900'} Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:16:55.632227 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Returning 404 to user: Instance 8f55176d-f7ca-4cce-88e8-a5b3d8396900 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-d3395350-47f9-4b31-a960-335d0bddc00e tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900" status: 404 len: 111 microversion: 2.1 time: 0.035192 Aug 29 12:16:55.639456 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3794/7555] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:55 2022] GET /compute/v2.1/servers/8f55176d-f7ca-4cce-88e8-a5b3d8396900 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 12:16:57.419134 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:57.420138 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:57.426115 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:57.434227 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:57.435096 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:57.436148 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:57.437772 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:57.438666 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:57.441009 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:57.447194 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:57.450082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:57.450082 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:57.472779 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] Creating event network-changed:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:16:57.482468 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-50640dfc-77a2-43b4-aa1f-9e18b96d5fcf req-1b11fb0f-94c5-4672-84d9-7c73eff82a10 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062403 Aug 29 12:16:57.484135 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3795/7556] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:16:57.500913 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Going to try to terminate instance {{(pid=128682) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 12:16:57.632625 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-51b5b4f5-f478-4c14-81a8-533e11a30ab0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 204 len: 0 microversion: 2.1 time: 0.219107 Aug 29 12:16:57.637610 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3762/7557] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 29 12:16:57 2022] DELETE /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 12:16:57.649634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:57.651634 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:57.663734 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:57.664844 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:57.665945 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:57.667401 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:57.668352 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:57.669168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:57.855436 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.policy [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128681) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:16:57.865641 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-5e98501a-084a-4ae9-ac2d-8a486cec7340 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1685 microversion: 2.1 time: 0.225197 Aug 29 12:16:57.866546 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3796/7558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:57 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:16:58.912023 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:16:58.913453 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:16:58.923176 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:58.923989 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:58.924622 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:58.925637 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:58.926702 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:58.927369 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:59.291792 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:16:59.307466 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-d157f343-e996-4302-9a95-9a23a608e4ca tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1685 microversion: 2.1 time: 0.417909 Aug 29 12:16:59.311188 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3763/7559] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:16:58 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1685 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:16:59.870292 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f5a424-25cb-41d6-ae34-821cb5bbf486", "name": "network-vif-deleted", "tag": "579e5246-f506-47f9-94de-903b11247aab"}]} {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 12:16:59.888715 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:16:59.889628 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:16:59.890426 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:16:59.911235 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.compute.server_external_events [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] Creating event network-vif-deleted:579e5246-f506-47f9-94de-903b11247aab for instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 on n-h2-854121-10 Aug 29 12:16:59.919086 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [req-cfe948d4-f684-4020-a319-7b72ade4ea23 req-48f04c6e-db7f-4e24-a06f-6956abe58557 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053693 Aug 29 12:16:59.920033 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3797/7560] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 29 12:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 12:17:00.350592 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:17:00.351618 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.compute.api [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128682) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:17:00.364587 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:17:00.365455 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:17:00.366297 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:17:00.367914 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:17:00.368815 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:17:00.369877 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:17:00.435566 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:17:00.436099 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:17:00.436649 n-d-854121-10 devstack@n-api.service[128682]: DEBUG oslo_concurrency.lockutils [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:17:00.437343 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.objects.instance [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lazy-loading 'fault' on Instance uuid f8f5a424-25cb-41d6-ae34-821cb5bbf486 {{(pid=128682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 12:17:00.491722 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.policy [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e243eead018647b5b77a7348c57846b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9870c6cfc24147f684f75a0c68d41c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128682) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 12:17:00.505492 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-07948412-6d82-4202-a3aa-7d8d3ff238e0 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 200 len: 1338 microversion: 2.1 time: 0.162204 Aug 29 12:17:00.506703 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3764/7561] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:17:00 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 1338 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 12:17:01.530231 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '>' {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:17:01.530963 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.compute.api [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] [instance: f8f5a424-25cb-41d6-ae34-821cb5bbf486] Fetching instance by UUID {{(pid=128681) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 12:17:01.537694 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:17:01.538309 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:17:01.538863 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:17:01.539651 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Acquiring lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 12:17:01.540482 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 12:17:01.541010 n-d-854121-10 devstack@n-api.service[128681]: DEBUG oslo_concurrency.lockutils [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Lock "63165a55-b78c-49ff-95c5-fdaa65ea00cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 12:17:01.560656 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.wsgi [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] HTTP exception thrown: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Request method failure captured: Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: request: GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 HTTP/1.1 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Accept: application/json Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Accept-Encoding: identity Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Connection: close Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Content-Length: 0 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Content-Type: application/json Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Host: 10.222.0.47 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: Openstack-System-Scope: None Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: User-Agent: python-urllib3/1.26.12 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Auth-Token: gAAAAABjDK0cEykwbqE3AfO0YLAiXYgeu29Iy_itUjst0dMilY3zwXsDbhCyQJl3gpRMsidg_lN9kxkOvUP44ahnLCd3IVAF9W_JNVfP2S-S0SHGcDxfNVP6Pd-MzZ54RzwGDLJqC0WBYsnaXqWbfqhkRjnbEtJXPkqDYTfE7iYZt_fY_BAV37w Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Id: None Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Domain-Name: None Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Identity-Status: Confirmed Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Is-Admin-Project: True Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Id: default Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Domain-Name: Default Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Id: 9870c6cfc24147f684f75a0c68d41c56 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Project-Name: tempest-TestSnapshotPattern-1423084507 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Role: reader,member Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Roles: reader,member Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9870c6cfc24147f684f75a0c68d41c56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant: tempest-TestSnapshotPattern-1423084507 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Id: 9870c6cfc24147f684f75a0c68d41c56 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-Tenant-Name: tempest-TestSnapshotPattern-1423084507 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-User: tempest-TestSnapshotPattern-1423084507-project Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Id: default Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-User-Domain-Name: Default Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-User-Id: e243eead018647b5b77a7348c57846b0 Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: X-User-Name: tempest-TestSnapshotPattern-1423084507-project Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: method: > Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: exception: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: action_args: {'id': 'f8f5a424-25cb-41d6-ae34-821cb5bbf486'} Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: {{(pid=128681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 12:17:01.564109 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: ERROR nova.api.openstack.wsgi Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: DEBUG nova.api.openstack.wsgi [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Returning 404 to user: Instance f8f5a424-25cb-41d6-ae34-821cb5bbf486 could not be found. {{(pid=128681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: INFO nova.api.openstack.requestlog [None req-b3747997-de9f-4e5e-9445-1dbab47e9189 tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486" status: 404 len: 111 microversion: 2.1 time: 0.041254 Aug 29 12:17:01.571168 n-d-854121-10 devstack@n-api.service[128681]: [pid: 128681|app: 0|req: 3798/7562] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 29 12:17:01 2022] GET /compute/v2.1/servers/f8f5a424-25cb-41d6-ae34-821cb5bbf486 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 12:17:01.770594 n-d-854121-10 devstack@n-api.service[128682]: DEBUG nova.api.openstack.wsgi [None req-a48a4f20-3b53-454f-8ba8-214f4b11565f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] Calling method '.version_select at 0x7f66c59eea60>' {{(pid=128682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 12:17:01.810902 n-d-854121-10 devstack@n-api.service[128682]: INFO nova.api.openstack.requestlog [None req-a48a4f20-3b53-454f-8ba8-214f4b11565f tempest-TestSnapshotPattern-1423084507 tempest-TestSnapshotPattern-1423084507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1294190160" status: 202 len: 0 microversion: 2.1 time: 0.044757 Aug 29 12:17:01.812138 n-d-854121-10 devstack@n-api.service[128682]: [pid: 128682|app: 0|req: 3765/7563] 10.222.0.47 () {58 vars in 1257 bytes} [Mon Aug 29 12:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1294190160 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)